-- Logs begin at Tue 2022-09-13 02:40:33 UTC, end at Tue 2022-09-13 03:48:55 UTC. -- Sep 13 03:10:11.623978 dv-cinder-857075-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 03:10:11.632748 dv-cinder-857075-2-smb devstack@keystone.service[81574]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 03:10:11.634867 dv-cinder-857075-2-smb devstack@keystone.service[81574]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 03:10:11 2022] *** Sep 13 03:10:11.634867 dv-cinder-857075-2-smb devstack@keystone.service[81574]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 03:10:11.634867 dv-cinder-857075-2-smb devstack@keystone.service[81574]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 03:10:11.634867 dv-cinder-857075-2-smb devstack@keystone.service[81574]: nodename: dv-cinder-857075-2-smb Sep 13 03:10:11.634867 dv-cinder-857075-2-smb devstack@keystone.service[81574]: machine: x86_64 Sep 13 03:10:11.634867 dv-cinder-857075-2-smb devstack@keystone.service[81574]: clock source: unix Sep 13 03:10:11.634867 dv-cinder-857075-2-smb devstack@keystone.service[81574]: pcre jit disabled Sep 13 03:10:11.634867 dv-cinder-857075-2-smb devstack@keystone.service[81574]: detected number of CPU cores: 4 Sep 13 03:10:11.634867 dv-cinder-857075-2-smb devstack@keystone.service[81574]: current working directory: / Sep 13 03:10:11.634867 dv-cinder-857075-2-smb devstack@keystone.service[81574]: detected binary path: /usr/bin/uwsgi-core Sep 13 03:10:11.635531 dv-cinder-857075-2-smb devstack@keystone.service[81574]: your processes number limit is 47680 Sep 13 03:10:11.635531 dv-cinder-857075-2-smb devstack@keystone.service[81574]: your memory page size is 4096 bytes Sep 13 03:10:11.635531 dv-cinder-857075-2-smb devstack@keystone.service[81574]: detected max file descriptor number: 2048 Sep 13 03:10:11.635531 dv-cinder-857075-2-smb devstack@keystone.service[81574]: lock engine: pthread robust mutexes Sep 13 03:10:11.635531 dv-cinder-857075-2-smb devstack@keystone.service[81574]: thunder lock: enabled Sep 13 03:10:11.635531 dv-cinder-857075-2-smb devstack@keystone.service[81574]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 03:10:11.635531 dv-cinder-857075-2-smb devstack@keystone.service[81574]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 03:10:11.677091 dv-cinder-857075-2-smb devstack@keystone.service[81574]: Python main interpreter initialized at 0x558b59b969c0 Sep 13 03:10:11.677091 dv-cinder-857075-2-smb devstack@keystone.service[81574]: python threads support enabled Sep 13 03:10:11.677091 dv-cinder-857075-2-smb devstack@keystone.service[81574]: your server socket listen backlog is limited to 100 connections Sep 13 03:10:11.677091 dv-cinder-857075-2-smb devstack@keystone.service[81574]: your mercy for graceful operations on workers is 90 seconds Sep 13 03:10:11.677456 dv-cinder-857075-2-smb devstack@keystone.service[81574]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 03:10:11.677529 dv-cinder-857075-2-smb devstack@keystone.service[81574]: *** Operational MODE: preforking *** Sep 13 03:10:11.677791 dv-cinder-857075-2-smb devstack@keystone.service[81574]: *** uWSGI is running in multiple interpreter mode *** Sep 13 03:10:11.677791 dv-cinder-857075-2-smb devstack@keystone.service[81574]: spawned uWSGI master process (pid: 81574) Sep 13 03:10:11.678033 dv-cinder-857075-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 13 03:10:11.680068 dv-cinder-857075-2-smb devstack@keystone.service[81574]: spawned uWSGI worker 1 (pid: 81585, cores: 1) Sep 13 03:10:11.680068 dv-cinder-857075-2-smb devstack@keystone.service[81574]: spawned uWSGI worker 2 (pid: 81586, cores: 1) Sep 13 03:10:11.680068 dv-cinder-857075-2-smb devstack@keystone.service[81574]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 03:10:15.974450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 03:10:15.974450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: from cryptography.utils import int_from_bytes Sep 13 03:10:15.975238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 03:10:15.975238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: from cryptography.utils import int_from_bytes Sep 13 03:10:15.975238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 03:10:15.975238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: from cryptography.utils import int_from_bytes Sep 13 03:10:15.975741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 03:10:15.975741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: from cryptography.utils import int_from_bytes Sep 13 03:10:16.030789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 03:10:16.030969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 03:10:16.030969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 03:10:16.031117 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 03:10:16.031194 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] command line args: [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 03:10:16.031270 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] command line args: [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 03:10:16.031907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 03:10:16.031993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 03:10:16.032069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ================================================================================ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 03:10:16.032143 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ================================================================================ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 03:10:16.032319 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] admin_token = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.032397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] admin_token = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.032563 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] config_dir = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.032641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] config_dir = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.032744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.032822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.032921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] config_source = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.032999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] config_source = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.033101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] debug = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.033185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] debug = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.033304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.033607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.033744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.033847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.033942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.034034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.034137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.034279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.034279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.034476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.034579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.034680 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.034774 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_config_append = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.034879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_config_append = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.034984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.035086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.035206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_dir = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.035338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_dir = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.035446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_file = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.035548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_file = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.035653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.035767 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.035862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.035946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.036011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.036118 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.036209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.036284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.036373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.036452 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.036522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.036601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.036672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.036740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.036842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.036977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.037059 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.037129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.037310 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.040648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.040648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.040819 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.040942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041556 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041624 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] publish_errors = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] publish_errors = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041868 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041927 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.041984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] standard_threads = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] standard_threads = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_journal = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.042972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] use_journal = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.043036 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_json = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.043099 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] use_json = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.043099 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] use_stderr = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.043200 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_stderr = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.043265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] use_syslog = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.043329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_syslog = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.043387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.043444 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 03:10:16.043500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.043556 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.043624 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.043685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.043747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.043811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.043874 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.043933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044257 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044631 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044694 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.044959 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.045024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.045087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.045145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.045209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.045297 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.045361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.045428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.045489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.045547 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.045751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.045829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.045951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.046026 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.046202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.046269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.046443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.046571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.046677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.046754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.046943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.047616 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.047854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.047937 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.048008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.048077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.048302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.048389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.048472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.048546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.048669 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.048749 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.048859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.049014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.049096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.049173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.049345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.049440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.049591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.049681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.049818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.049903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.050043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.050125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.050285 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.050369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.050526 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.050602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.050762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.050881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.050997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.051119 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.051241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.051357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.051470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.051589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.051703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.051861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.051993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.052112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.052227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.052341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.052453 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.052577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.052699 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.052815 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.052928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.053043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.053188 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.053368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.053474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.053576 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.053680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.053778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.053873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.053978 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.054081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.054186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.054290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.054387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.054504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.054628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.054758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.054874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.054996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.055119 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.055238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.055353 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.055475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.055597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.055719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.055842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.055958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.056072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.056195 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.056311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.056427 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.056615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.056734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.056852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.056976 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.057089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.057204 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.057353 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.057481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.057598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.057720 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.057845 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.057963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.058084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.058201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.058309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.058422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.058546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.058654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.058812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.058927 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.059041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.059164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.059288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.059406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.059521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.059642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.059766 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.059891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.060016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.060132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.060257 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.060376 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.060498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.060692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.060817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.060941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.061058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.061179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.061345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.061517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.061639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.061755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.061867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.061982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.062097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.062221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.062347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.062478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.062595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.062710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.062825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.062939 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.063054 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.063179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.063296 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.063411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.063527 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.063641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.063756 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.063879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.063995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.064109 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.064224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.064345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.064461 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.064585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.064705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.064820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.064934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.065048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.065171 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.065314 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.065431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.065547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.065663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.065777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.065892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.066019 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.066142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.066259 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.066373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.066488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.066488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.066712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.066829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.066943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.067057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.067171 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.067286 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.067409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.067525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.067639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.067755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.067869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.068015 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.external = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.068146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.068146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.external = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.068146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.068877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.068996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.069115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.069233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.069407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.069527 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.password = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.069656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.password = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.069781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.token = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.069900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.token = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.070017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.070141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.070259 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.070375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.070491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.070606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.070722 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.070847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.070966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.071083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.071199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.071314 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.071436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.071562 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.071680 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.071796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.071914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.072036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.072153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.072279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.072403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.072520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.072636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.072751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.072867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.072992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.073110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.073226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.073365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.073481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.073598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.073725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.073843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.073959 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.074077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.074193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.074308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.074440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.074567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.074687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.074810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.074928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.075044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.075237 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.075426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.075548 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.075761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.075885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.075992 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.076104 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.076204 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.076302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.076399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.076496 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.076496 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.076683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.076783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.076881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.076978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.077075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.077173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.077330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.077438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.077536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.077677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.077779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.077877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.080729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.080899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.080991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.081065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.081144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.081227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.081325 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.081395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.081467 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.081538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.081610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.081694 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.081769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.081841 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.081912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.081984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.082049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.082128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.082201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.082272 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.082343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.082415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.082486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.082565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.082640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.082710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.082781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.082852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.082923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083080 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083445 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083519 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083673 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083745 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083894 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.083968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084253 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084619 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.084986 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.085110 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.085192 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.085314 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.085392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.085464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.085536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.085618 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.085693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.085772 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.085847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.085918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.085996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.086069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.086141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.086220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.086293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.086364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.086435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.086506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.086577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.086656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.086729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.086801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.086871 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.086942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087527 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087813 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.087962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088177 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088247 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.088998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.089070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.089141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.089220 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.089310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.089384 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.089456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.089527 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.089598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.089680 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.089755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.089828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.089899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.089971 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.090135 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.090226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.090368 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.090449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.090600 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.090679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.090828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.090917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.091074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.091154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.091315 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.091393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.091556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.091656 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.091799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.091879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.092040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.092134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.092284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.092380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.092509 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.092589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.092742 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.092821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.092973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.093062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.093206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.093333 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.093462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.093541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.093704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.093796 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.094471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.094551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.094704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.094782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.094955 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.095042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.095180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.095259 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.095420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.095498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.095651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.095808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.095885 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.095956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.096101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.096181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.096342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.096428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.096579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.096657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.097063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.097159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.097230 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.097338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.097415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.097488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.097555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.097625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.097752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.097842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.097988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.098068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.098233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.098312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.098479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.098566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.098710 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.098788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.098954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.099034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.099187 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.099275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.099422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.099501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.099653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] role.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.099732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] role.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.099896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] role.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.099984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] role.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.100123 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.100202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.100367 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.100445 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.100610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.100693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.100852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.100932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.101093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.101172 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.101358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.101443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.101602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.101681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.101845 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.101923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.102089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.102169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.102318 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.102408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.102574 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.102710 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.102793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.102869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.103044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.103175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.103289 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.103553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.103682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.103916 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.103993 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.104162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.104240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.104411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.104505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.104659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.104737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.104904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.104981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.105136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.105226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.105394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.105475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.105642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.105718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.105878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.107496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.107592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.107659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.107752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.107860 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.107947 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108370 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.108985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.109055 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.109174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.109281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.109348 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.109438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.109539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.109641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.109721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.109807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.110373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.110451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.110522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.110593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.110663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.110743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.110816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.110896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.110967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.111042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.111113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.111191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.111264 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.111396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.111475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.111626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.111704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.111868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.111948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.112110 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.112197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.112352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.112439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.112597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.112683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.112850 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.112938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.113087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.113165 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.113353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.113437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.113593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.113701 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.113876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.113965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.114084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.114164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.114317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.114405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.114548 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.114627 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.114778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.114862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.115010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.115168 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.115244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.115314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.115466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.115546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.115703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.115792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.115936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.116016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.116169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.116248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.116400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.116488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.116626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.116705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.116854 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.116932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.117083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.117170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.117244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 03:10:16.117386 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 03:10:16.117503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 03:10:16.146513 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.146715 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.147917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.147917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.148072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.148072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.155309 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.155614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.184268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.184488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.184579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.186004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.241467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.241713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.293705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.293929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.294041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.294193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.456444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.456676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.456764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.456869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.456949 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.457070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.457156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.457306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.457393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.457523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.457609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.457805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.485718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.485938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.486048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.486161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.486248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.486382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.486467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.486597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.486682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.486811 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.486893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.487038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.487127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.487244 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.498905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.499007 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.511014 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.511244 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.511347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.511463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.511554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.511685 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.511808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.511903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.511981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.512093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.512176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.512302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.512400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.512522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 03:10:16.529559 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.529677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.529755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 03:10:16.529829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 03:10:16.530094 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.530179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.530294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 03:10:16.530376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 03:10:16.530564 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.530647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.530823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.530907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.531081 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.531162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.531390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.532036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.541532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.541631 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.541835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.541923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.542088 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.547189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.547189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.547327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.549361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.549447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.552228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.552318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.552514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.552596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.552798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.552887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.553081 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.553163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.553383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.553468 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.553645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.553729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.553914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.553998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.554187 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.554270 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.554459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.554541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.554729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.554808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.554994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.555082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.577544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.577760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.579542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.579828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.580098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.580570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.584489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.584772 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.585051 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.587596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.587885 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.588168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.591385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.591677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.595187 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.595471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.597873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.598170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.598459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.598746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.599026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.599306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.599575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.599840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.601171 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.601497 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.601787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.602074 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.602355 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.602634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.602910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.603178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.615314 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.615592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.619033 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.619314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.619473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.622732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.623026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.623245 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.626966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.627265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.627753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.630956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.631446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.634192 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.634493 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.634700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.634783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.635045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.635332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.635619 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.637920 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.638221 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.638507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.638793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.639080 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.639359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.652134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.652423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.652695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.652959 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.655812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.656104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.656396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.656658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.659848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.661412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.662940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.663219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.663629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.665158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.666021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.666313 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.666594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.666716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.666876 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.666996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.667266 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.669685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.669970 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.670251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.670533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.670929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.678386 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.678670 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.678945 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.679222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.679603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.679882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.680169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.682044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.682332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.682615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.682898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.683281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.683567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.683847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.695992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.698918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.699758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.701820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.702670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.703923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.705420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.705705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.706100 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.706182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.707601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.709143 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.709679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.710077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.712432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.713935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.716399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.721529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.721529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.721529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.721529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.721870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.721870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.721870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.721870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.721870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.725574 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.725866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.726148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.729459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.729749 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.730029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.732980 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.733286 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.733568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.733842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.734123 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.734409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.734695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.734975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.735242 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.735524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.735794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.736052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.736325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.736603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.737174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 03:10:16.737305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.737554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.737831 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.738105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.738375 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.738646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.738919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.739186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.739460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.739736 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.739995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.740266 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.740571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 03:10:16.771692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558b59b969c0 pid: 81586 (default app) Sep 13 03:10:16.774917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaff8a2-1e6e-4779-9267-4c57beb073aa None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:16.775201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaff8a2-1e6e-4779-9267-4c57beb073aa None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:16.775473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaff8a2-1e6e-4779-9267-4c57beb073aa None None] PATH_INFO: `/v3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:16.775674 dv-cinder-857075-2-smb devstack@keystone.service[81585]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558b59b969c0 pid: 81585 (default app) Sep 13 03:10:16.779608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Tue Sep 13 03:10:16 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:24.295805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c938f8-47eb-4cd5-a085-1e3fae369c2c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:24.296340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c938f8-47eb-4cd5-a085-1e3fae369c2c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:24.296340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c938f8-47eb-4cd5-a085-1e3fae369c2c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:24.300636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:10:24.305971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc08408-4574-4ccf-9d38-fc12dc434ca9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:24.306373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc08408-4574-4ccf-9d38-fc12dc434ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:24.306524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc08408-4574-4ccf-9d38-fc12dc434ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:24.377232 dv-cinder-857075-2-smb devstack@keystone.service[81586]: INFO dbcounter [None req-2cc08408-4574-4ccf-9d38-fc12dc434ca9 None None] Registered counter for database keystone Sep 13 03:10:24.396760 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG oslo_db.sqlalchemy.engines [None req-2cc08408-4574-4ccf-9d38-fc12dc434ca9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:10:24.403178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writer thread running {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:10:24.582430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG passlib.handlers.bcrypt [None req-2cc08408-4574-4ccf-9d38-fc12dc434ca9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81586) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 03:10:24.582814 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG passlib.handlers.bcrypt [None req-2cc08408-4574-4ccf-9d38-fc12dc434ca9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81586) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 03:10:24.640920 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2cc08408-4574-4ccf-9d38-fc12dc434ca9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:24.642548 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2cc08408-4574-4ccf-9d38-fc12dc434ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:24.768254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 03:10:25.215442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c938f8-47eb-4cd5-a085-1e3fae369c2c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:25.291130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: INFO dbcounter [None req-25c938f8-47eb-4cd5-a085-1e3fae369c2c None None] Registered counter for database keystone Sep 13 03:10:25.318914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG oslo_db.sqlalchemy.engines [None req-25c938f8-47eb-4cd5-a085-1e3fae369c2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 03:10:25.325062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writer thread running {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 03:10:25.443964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c938f8-47eb-4cd5-a085-1e3fae369c2c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:25.448177 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b391bde-1f28-486a-a9fd-77e0f3e98b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:25.448799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b391bde-1f28-486a-a9fd-77e0f3e98b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:25.449079 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b391bde-1f28-486a-a9fd-77e0f3e98b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:25.449378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b391bde-1f28-486a-a9fd-77e0f3e98b22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:25.458105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b391bde-1f28-486a-a9fd-77e0f3e98b22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:25.509363 dv-cinder-857075-2-smb devstack@keystone.service[81585]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9b391bde-1f28-486a-a9fd-77e0f3e98b22 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 03:10:25.509712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b391bde-1f28-486a-a9fd-77e0f3e98b22 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:25.519678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Sep 13 03:10:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 03:10:25.525708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc08408-4574-4ccf-9d38-fc12dc434ca9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:25.542870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc08408-4574-4ccf-9d38-fc12dc434ca9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:25.547269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7aa46-33e0-4f24-946f-78ec3e8bcf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:25.548372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7aa46-33e0-4f24-946f-78ec3e8bcf6e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:25.548649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7aa46-33e0-4f24-946f-78ec3e8bcf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:25.548913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7aa46-33e0-4f24-946f-78ec3e8bcf6e admin admin] PATH_INFO: `/v3/projects/579008ca5633416b90d9e0cc4088e0c7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:25.550520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7aa46-33e0-4f24-946f-78ec3e8bcf6e admin admin] RBAC: Authorizing `identity:get_project(project_id=579008ca5633416b90d9e0cc4088e0c7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:25.603378 dv-cinder-857075-2-smb devstack@keystone.service[81586]: WARNING keystone.common.rbac_enforcer.enforcer [None req-84b7aa46-33e0-4f24-946f-78ec3e8bcf6e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 03:10:25.603729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7aa46-33e0-4f24-946f-78ec3e8bcf6e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:25.608257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Sep 13 03:10:25 2022] GET /identity/v3/projects/579008ca5633416b90d9e0cc4088e0c7 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:27.718021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8037e84-1e28-4132-8c9c-c83a6057b9f6 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:27.719137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8037e84-1e28-4132-8c9c-c83a6057b9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:27.719137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8037e84-1e28-4132-8c9c-c83a6057b9f6 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:27.723229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:27.728540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97931-4dbe-49ac-a91a-2e0c7eeb90ea None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:27.728937 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97931-4dbe-49ac-a91a-2e0c7eeb90ea None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:27.729081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97931-4dbe-49ac-a91a-2e0c7eeb90ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:27.748596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-42d97931-4dbe-49ac-a91a-2e0c7eeb90ea None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:27.750126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-42d97931-4dbe-49ac-a91a-2e0c7eeb90ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:27.757772 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 03:10:28.027978 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8037e84-1e28-4132-8c9c-c83a6057b9f6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:28.040406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8037e84-1e28-4132-8c9c-c83a6057b9f6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:28.044588 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50611c6c-55de-412c-8ab3-dad471991b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:28.045176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50611c6c-55de-412c-8ab3-dad471991b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:28.045484 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50611c6c-55de-412c-8ab3-dad471991b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:28.045758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50611c6c-55de-412c-8ab3-dad471991b66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:28.053879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50611c6c-55de-412c-8ab3-dad471991b66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:28.055645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50611c6c-55de-412c-8ab3-dad471991b66 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:28.064288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Sep 13 03:10:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 03:10:28.069421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97931-4dbe-49ac-a91a-2e0c7eeb90ea None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:28.078321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97931-4dbe-49ac-a91a-2e0c7eeb90ea None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:28.082626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cac34-830f-4205-8a07-a9e3de930b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:28.083243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cac34-830f-4205-8a07-a9e3de930b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:28.083522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cac34-830f-4205-8a07-a9e3de930b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:28.083792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cac34-830f-4205-8a07-a9e3de930b3a admin admin] PATH_INFO: `/v3/users/809e7dc455e844f6967aa616532e4eb7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:28.085102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cac34-830f-4205-8a07-a9e3de930b3a admin admin] RBAC: Authorizing `identity:get_user(user_id=809e7dc455e844f6967aa616532e4eb7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:28.086954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cac34-830f-4205-8a07-a9e3de930b3a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:28.088457 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Sep 13 03:10:28 2022] GET /identity/v3/users/809e7dc455e844f6967aa616532e4eb7 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:30.278525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adfc53-951f-46de-b4cc-ca536ec9f4fc None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:30.279062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adfc53-951f-46de-b4cc-ca536ec9f4fc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:30.279062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adfc53-951f-46de-b4cc-ca536ec9f4fc None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:30.280383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:30.286168 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b724a-19ab-4b2d-bd07-2dbe34b93676 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:30.286567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b724a-19ab-4b2d-bd07-2dbe34b93676 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:30.286732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b724a-19ab-4b2d-bd07-2dbe34b93676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:30.304878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-077b724a-19ab-4b2d-bd07-2dbe34b93676 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:30.306059 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-077b724a-19ab-4b2d-bd07-2dbe34b93676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:30.331665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884a16b-214d-4936-b5a7-b03ed2f74657 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:30.331953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884a16b-214d-4936-b5a7-b03ed2f74657 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:30.332231 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884a16b-214d-4936-b5a7-b03ed2f74657 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:30.333590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:10:30.338684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69ee44-64c1-41da-83db-2ad17632636d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:30.338967 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69ee44-64c1-41da-83db-2ad17632636d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:30.339264 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69ee44-64c1-41da-83db-2ad17632636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:30.382037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG passlib.handlers.bcrypt [None req-db69ee44-64c1-41da-83db-2ad17632636d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81585) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 03:10:30.382426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG passlib.handlers.bcrypt [None req-db69ee44-64c1-41da-83db-2ad17632636d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81585) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 03:10:30.385867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:30.432019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-db69ee44-64c1-41da-83db-2ad17632636d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:30.433580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-db69ee44-64c1-41da-83db-2ad17632636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:30.532093 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:10:30.654221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b724a-19ab-4b2d-bd07-2dbe34b93676 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:30.678253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:30.755965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b724a-19ab-4b2d-bd07-2dbe34b93676 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:30.789532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16828332-6801-4e06-847c-057fbf4726e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:30.790158 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828332-6801-4e06-847c-057fbf4726e6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:30.790436 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828332-6801-4e06-847c-057fbf4726e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:30.790710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828332-6801-4e06-847c-057fbf4726e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:30.801820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16828332-6801-4e06-847c-057fbf4726e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:30.803424 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69ee44-64c1-41da-83db-2ad17632636d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-16828332-6801-4e06-847c-057fbf4726e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:30.810749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:30.811606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:30.812401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:30.812401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:30.812401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:30.812401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:30.812401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:30.812401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:30.812401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:30.812401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:30.812401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:30.812401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:30.812401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:10:30.812401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:10:30.812401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:10:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:30.817450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16828332-6801-4e06-847c-057fbf4726e6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:30.897776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:30.906030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69ee44-64c1-41da-83db-2ad17632636d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:30.908266 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:30.915074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16828332-6801-4e06-847c-057fbf4726e6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:30.943709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444454d-b823-45f1-979b-968ec486f15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:30.944837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444454d-b823-45f1-979b-968ec486f15e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:30.945114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444454d-b823-45f1-979b-968ec486f15e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:30.945413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444454d-b823-45f1-979b-968ec486f15e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:30.948056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cdb95-5112-4697-8e34-a918af4729e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:30.948657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cdb95-5112-4697-8e34-a918af4729e6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:30.948934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cdb95-5112-4697-8e34-a918af4729e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:30.949207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cdb95-5112-4697-8e34-a918af4729e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:30.949900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cdb95-5112-4697-8e34-a918af4729e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:30.950205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cdb95-5112-4697-8e34-a918af4729e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:30.951874 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cdb95-5112-4697-8e34-a918af4729e6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:30.963879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:10:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:10:30.969566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cdb95-5112-4697-8e34-a918af4729e6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:31.012971 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444454d-b823-45f1-979b-968ec486f15e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:31.014457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444454d-b823-45f1-979b-968ec486f15e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:31.065676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cdb95-5112-4697-8e34-a918af4729e6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:31.099000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c6d56-77df-4112-a386-110ee485a696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:31.099620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c6d56-77df-4112-a386-110ee485a696 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:31.099894 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c6d56-77df-4112-a386-110ee485a696 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:31.100166 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c6d56-77df-4112-a386-110ee485a696 None admin] PATH_INFO: `/v3/users/809e7dc455e844f6967aa616532e4eb7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:31.101336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c6d56-77df-4112-a386-110ee485a696 None admin] RBAC: Authorizing `identity:get_user(user_id=809e7dc455e844f6967aa616532e4eb7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:31.102812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c6d56-77df-4112-a386-110ee485a696 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:31.104371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 9/16] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:30 2022] GET /identity/v3/users/809e7dc455e844f6967aa616532e4eb7 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:10:31.109593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c6d56-77df-4112-a386-110ee485a696 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:31.111700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 8/17] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:10:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 03:10:31.116916 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444454d-b823-45f1-979b-968ec486f15e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:31.120390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:31.123447 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:31.209839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c6d56-77df-4112-a386-110ee485a696 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:31.216063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444454d-b823-45f1-979b-968ec486f15e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:31.243102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28734d-8ab5-4d7b-a2df-e20d07a91139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:31.243727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28734d-8ab5-4d7b-a2df-e20d07a91139 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:31.244006 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28734d-8ab5-4d7b-a2df-e20d07a91139 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:31.244283 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28734d-8ab5-4d7b-a2df-e20d07a91139 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:31.245412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28734d-8ab5-4d7b-a2df-e20d07a91139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:31.246913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28734d-8ab5-4d7b-a2df-e20d07a91139 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:31.248407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:10:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:10:31.251922 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fd4e0-d865-455f-999f-c49497f63ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:31.252772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fd4e0-d865-455f-999f-c49497f63ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:31.253050 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fd4e0-d865-455f-999f-c49497f63ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:31.253592 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fd4e0-d865-455f-999f-c49497f63ff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:31.254708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28734d-8ab5-4d7b-a2df-e20d07a91139 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:31.272265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fd4e0-d865-455f-999f-c49497f63ff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:31.273705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fd4e0-d865-455f-999f-c49497f63ff5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-7f6fd4e0-d865-455f-999f-c49497f63ff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:10:31.291535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:31.292801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:10:31.293624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:10:31.293624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:10:31.293624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:10:31.293624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:10:31.298990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fd4e0-d865-455f-999f-c49497f63ff5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:31.334839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:31.353114 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28734d-8ab5-4d7b-a2df-e20d07a91139 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:31.354793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:31.388730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf30ff5-0035-4dfc-a930-7a260949e702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:31.389362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf30ff5-0035-4dfc-a930-7a260949e702 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:31.389641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf30ff5-0035-4dfc-a930-7a260949e702 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:31.390203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf30ff5-0035-4dfc-a930-7a260949e702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:31.390924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf30ff5-0035-4dfc-a930-7a260949e702 None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.domain.id=default, user.id=809e7dc455e844f6967aa616532e4eb7) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:31.391229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf30ff5-0035-4dfc-a930-7a260949e702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:31.392681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf30ff5-0035-4dfc-a930-7a260949e702 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:31.399331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Tue Sep 13 03:10:31 2022] GET /identity/v3/role_assignments?user.id=809e7dc455e844f6967aa616532e4eb7&scope.domain.id=default&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:10:31.399734 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fd4e0-d865-455f-999f-c49497f63ff5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:31.435626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cd054-1bc5-4088-82ef-5e029c6bc1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:31.436256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cd054-1bc5-4088-82ef-5e029c6bc1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:31.436537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cd054-1bc5-4088-82ef-5e029c6bc1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:31.436812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cd054-1bc5-4088-82ef-5e029c6bc1d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:31.438117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cd054-1bc5-4088-82ef-5e029c6bc1d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:31.438420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cd054-1bc5-4088-82ef-5e029c6bc1d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:31.439855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cd054-1bc5-4088-82ef-5e029c6bc1d0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:31.459188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:10:33.943909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd0df2-65fe-4481-8a9b-1c37ecf6bb28 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:33.945006 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd0df2-65fe-4481-8a9b-1c37ecf6bb28 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:33.945514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd0df2-65fe-4481-8a9b-1c37ecf6bb28 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:33.947065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:33.953170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca90cd-7b3e-40f2-8d3e-3135051277ba None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:33.953624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca90cd-7b3e-40f2-8d3e-3135051277ba None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:33.953803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca90cd-7b3e-40f2-8d3e-3135051277ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:33.981540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-78ca90cd-7b3e-40f2-8d3e-3135051277ba None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:33.982753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-78ca90cd-7b3e-40f2-8d3e-3135051277ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:34.062570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cf19a-506d-41ec-87ec-d719ab81995b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:34.063198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cf19a-506d-41ec-87ec-d719ab81995b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:34.063680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cf19a-506d-41ec-87ec-d719ab81995b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:34.065207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 13/23] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:34.079408 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 11/24] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:34.093306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430542-96d7-4c0d-b975-1c00aed36dc6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:34.093842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430542-96d7-4c0d-b975-1c00aed36dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:34.094319 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430542-96d7-4c0d-b975-1c00aed36dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:34.122634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e9430542-96d7-4c0d-b975-1c00aed36dc6 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:34.124137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e9430542-96d7-4c0d-b975-1c00aed36dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:34.222295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 14/25] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:34.438680 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f049210-b8e4-4bd9-b4fe-d35c9c9b0b4a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:34.439218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f049210-b8e4-4bd9-b4fe-d35c9c9b0b4a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:34.439633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f049210-b8e4-4bd9-b4fe-d35c9c9b0b4a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:34.441407 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 12/26] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:34.446248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6dda4-2fee-4bf2-8ba5-25f04e4aab26 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:34.446784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6dda4-2fee-4bf2-8ba5-25f04e4aab26 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:34.447268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6dda4-2fee-4bf2-8ba5-25f04e4aab26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:34.474526 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e1c6dda4-2fee-4bf2-8ba5-25f04e4aab26 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:34.476045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e1c6dda4-2fee-4bf2-8ba5-25f04e4aab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:34.535091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f049210-b8e4-4bd9-b4fe-d35c9c9b0b4a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:34.594971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 15/27] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:34.624458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:34.651955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6dda4-2fee-4bf2-8ba5-25f04e4aab26 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:34.657011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:34.715055 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f049210-b8e4-4bd9-b4fe-d35c9c9b0b4a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:34.790489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6dda4-2fee-4bf2-8ba5-25f04e4aab26 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:34.797895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f616c-91bb-43d6-94db-7963983cbee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:34.798537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f616c-91bb-43d6-94db-7963983cbee5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:34.798812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f616c-91bb-43d6-94db-7963983cbee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:34.799082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f616c-91bb-43d6-94db-7963983cbee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:34.824458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f616c-91bb-43d6-94db-7963983cbee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:34.828381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f616c-91bb-43d6-94db-7963983cbee5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:34.846886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6143147-555b-473d-8c06-b961d3a20271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:34.847524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6143147-555b-473d-8c06-b961d3a20271 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:34.847802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6143147-555b-473d-8c06-b961d3a20271 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:34.848128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6143147-555b-473d-8c06-b961d3a20271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-be9f616c-91bb-43d6-94db-7963983cbee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:10:34.858139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:34.859085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:10:34.859983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:10:34.859983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:10:34.859983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:10:34.859983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 13/28] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:10:34.860932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0378e4-a130-4b4b-85c8-49d13553cb79 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:34.862054 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0378e4-a130-4b4b-85c8-49d13553cb79 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:34.862636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0378e4-a130-4b4b-85c8-49d13553cb79 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:34.866071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 14/29] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:34.866946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0378e4-a130-4b4b-85c8-49d13553cb79 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:34.870123 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6143147-555b-473d-8c06-b961d3a20271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-d6143147-555b-473d-8c06-b961d3a20271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:34.879997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:34.881045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:34.882016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:34.882016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:34.882016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:34.882016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:34.882016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:34.882016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:34.882016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:34.882016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:34.882016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:34.882016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:34.882016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:10:34.882016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:10:34.884336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 16/30] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:10:34.887948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137513-32b2-48ad-b564-ac990a2eff32 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:34.892135 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137513-32b2-48ad-b564-ac990a2eff32 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:34.892586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137513-32b2-48ad-b564-ac990a2eff32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:34.925541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-34137513-32b2-48ad-b564-ac990a2eff32 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:34.928020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-34137513-32b2-48ad-b564-ac990a2eff32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:35.005482 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:35.013929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 17/31] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:35.021419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34137513-32b2-48ad-b564-ac990a2eff32 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:35.028445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:35.039610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0378e4-a130-4b4b-85c8-49d13553cb79 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:35.092683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc6175-817c-46ca-8cfd-f0d5cfe67574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:35.093286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc6175-817c-46ca-8cfd-f0d5cfe67574 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:35.093565 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc6175-817c-46ca-8cfd-f0d5cfe67574 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:35.093834 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc6175-817c-46ca-8cfd-f0d5cfe67574 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:35.094474 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc6175-817c-46ca-8cfd-f0d5cfe67574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:35.094774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc6175-817c-46ca-8cfd-f0d5cfe67574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:35.096162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc6175-817c-46ca-8cfd-f0d5cfe67574 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:35.109130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 15/32] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:35.109961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc6175-817c-46ca-8cfd-f0d5cfe67574 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:35.225662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34137513-32b2-48ad-b564-ac990a2eff32 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:35.301568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc6175-817c-46ca-8cfd-f0d5cfe67574 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:35.303594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5472c2a-d13f-4b82-93f7-5d8265fa9e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:35.304212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5472c2a-d13f-4b82-93f7-5d8265fa9e79 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:35.304488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5472c2a-d13f-4b82-93f7-5d8265fa9e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:35.304759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5472c2a-d13f-4b82-93f7-5d8265fa9e79 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:35.305468 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5472c2a-d13f-4b82-93f7-5d8265fa9e79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:35.305832 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5472c2a-d13f-4b82-93f7-5d8265fa9e79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:35.307332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5472c2a-d13f-4b82-93f7-5d8265fa9e79 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:35.317590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 18/33] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:10:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:35.318391 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5472c2a-d13f-4b82-93f7-5d8265fa9e79 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:35.341469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf388f-df79-4e6f-aa1b-b1f58eb52961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:35.342606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf388f-df79-4e6f-aa1b-b1f58eb52961 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:35.343687 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf388f-df79-4e6f-aa1b-b1f58eb52961 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:35.344161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf388f-df79-4e6f-aa1b-b1f58eb52961 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:35.345057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf388f-df79-4e6f-aa1b-b1f58eb52961 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:35.346804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf388f-df79-4e6f-aa1b-b1f58eb52961 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:35.382569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:35.426048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5472c2a-d13f-4b82-93f7-5d8265fa9e79 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:35.458572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55a39d-a3e9-4dd5-a418-4c5150cabc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:35.459199 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55a39d-a3e9-4dd5-a418-4c5150cabc1b None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:35.459465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55a39d-a3e9-4dd5-a418-4c5150cabc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:35.459731 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55a39d-a3e9-4dd5-a418-4c5150cabc1b None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:35.460374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55a39d-a3e9-4dd5-a418-4c5150cabc1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:35.461935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55a39d-a3e9-4dd5-a418-4c5150cabc1b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:35.565399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 16/34] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 13 03:10:35 2022] POST /identity/v3/roles => generated 225 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:10:35.565399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf388f-df79-4e6f-aa1b-b1f58eb52961 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:35.594651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:35.657826 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 19/35] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:10:35 2022] POST /identity/v3/projects => generated 301 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:10:35.658649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55a39d-a3e9-4dd5-a418-4c5150cabc1b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:35.712269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf388f-df79-4e6f-aa1b-b1f58eb52961 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:35.793475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d551d6-70a5-4f2f-891f-83af491f5f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:35.794548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d551d6-70a5-4f2f-891f-83af491f5f55 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:35.795057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d551d6-70a5-4f2f-891f-83af491f5f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:35.795553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d551d6-70a5-4f2f-891f-83af491f5f55 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:35.796563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d551d6-70a5-4f2f-891f-83af491f5f55 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:35.799459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d551d6-70a5-4f2f-891f-83af491f5f55 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:35.857088 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55a39d-a3e9-4dd5-a418-4c5150cabc1b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:35.871359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:35.880803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 17/36] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 13 03:10:35 2022] POST /identity/v3/roles => generated 219 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:10:35.880803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed50323-0a8b-4dcd-bdbd-42dd6d63dd59 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:35.880803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed50323-0a8b-4dcd-bdbd-42dd6d63dd59 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:35.880803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed50323-0a8b-4dcd-bdbd-42dd6d63dd59 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:35.880803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 18/37] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:35.888713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f24a78-f176-4047-a9f4-320fca1f623d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:35.889030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f24a78-f176-4047-a9f4-320fca1f623d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:35.889811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f24a78-f176-4047-a9f4-320fca1f623d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:35.913884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-14f24a78-f176-4047-a9f4-320fca1f623d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:35.916752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-14f24a78-f176-4047-a9f4-320fca1f623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:35.921845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9698681-13a4-4022-a6b4-1b05f138c829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:35.922534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698681-13a4-4022-a6b4-1b05f138c829 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:35.922815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698681-13a4-4022-a6b4-1b05f138c829 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:35.923092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698681-13a4-4022-a6b4-1b05f138c829 None admin] PATH_INFO: `/v3/users/809e7dc455e844f6967aa616532e4eb7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:35.924492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9698681-13a4-4022-a6b4-1b05f138c829 None admin] RBAC: Authorizing `identity:get_user(user_id=809e7dc455e844f6967aa616532e4eb7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:35.926267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9698681-13a4-4022-a6b4-1b05f138c829 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:35.928746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:35 2022] GET /identity/v3/users/809e7dc455e844f6967aa616532e4eb7 => generated 247 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:35.930304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112dc0d-99a1-4931-ab8a-586011245026 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:35.931000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112dc0d-99a1-4931-ab8a-586011245026 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:35.931400 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112dc0d-99a1-4931-ab8a-586011245026 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:35.932989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 21/39] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:35.938109 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112dc0d-99a1-4931-ab8a-586011245026 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:36.013668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 19/40] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:36.016170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e6c28-758b-46ae-9b93-d748ad9c2c28 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:36.016463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e6c28-758b-46ae-9b93-d748ad9c2c28 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:36.016737 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e6c28-758b-46ae-9b93-d748ad9c2c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:36.040423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2a2e6c28-758b-46ae-9b93-d748ad9c2c28 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:36.041706 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2a2e6c28-758b-46ae-9b93-d748ad9c2c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:36.052900 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:36.076284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112dc0d-99a1-4931-ab8a-586011245026 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:36.119297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1fdd6-b2c3-4948-bdea-5769b0e4dd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:36.119887 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1fdd6-b2c3-4948-bdea-5769b0e4dd60 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:36.120166 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1fdd6-b2c3-4948-bdea-5769b0e4dd60 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:36.120436 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1fdd6-b2c3-4948-bdea-5769b0e4dd60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:36.121642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1fdd6-b2c3-4948-bdea-5769b0e4dd60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:36.123101 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1fdd6-b2c3-4948-bdea-5769b0e4dd60 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:36.125359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 22/41] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:10:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:36.129026 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 20/42] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:36.130936 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1fdd6-b2c3-4948-bdea-5769b0e4dd60 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:36.183426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:36.242741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1fdd6-b2c3-4948-bdea-5769b0e4dd60 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:36.277544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe638a-0aaa-4e1c-b78c-6fb8a6165fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:36.278202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe638a-0aaa-4e1c-b78c-6fb8a6165fb6 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:36.278504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe638a-0aaa-4e1c-b78c-6fb8a6165fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:36.278781 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe638a-0aaa-4e1c-b78c-6fb8a6165fb6 None admin] PATH_INFO: `/v3/domains/default/users/809e7dc455e844f6967aa616532e4eb7/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:36.280733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe638a-0aaa-4e1c-b78c-6fb8a6165fb6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=809e7dc455e844f6967aa616532e4eb7, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:36.282217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe638a-0aaa-4e1c-b78c-6fb8a6165fb6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:36.304873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e6c28-758b-46ae-9b93-d748ad9c2c28 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:36.371857 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 23/43] 10.222.0.48 () {58 vars in 1361 bytes} [Tue Sep 13 03:10:36 2022] PUT /identity/v3/domains/default/users/809e7dc455e844f6967aa616532e4eb7/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:10:36.407772 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe638a-0aaa-4e1c-b78c-6fb8a6165fb6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:36.411526 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e6c28-758b-46ae-9b93-d748ad9c2c28 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:36.451723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab65163-18ab-4a80-ba31-37af9e79e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:36.453059 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab65163-18ab-4a80-ba31-37af9e79e05d None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:36.453377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab65163-18ab-4a80-ba31-37af9e79e05d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:36.453654 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab65163-18ab-4a80-ba31-37af9e79e05d None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:36.454378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab65163-18ab-4a80-ba31-37af9e79e05d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:36.455857 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab65163-18ab-4a80-ba31-37af9e79e05d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:36.533708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:36.542045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 21/44] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 13 03:10:36 2022] POST /identity/v3/roles => generated 223 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:10:36.643323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe638a-0aaa-4e1c-b78c-6fb8a6165fb6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:36.646718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:36.682073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361922d-e82e-4391-90c4-cd6c9e041bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:36.682723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361922d-e82e-4391-90c4-cd6c9e041bdd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:36.683005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361922d-e82e-4391-90c4-cd6c9e041bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:36.683281 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361922d-e82e-4391-90c4-cd6c9e041bdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:36.684467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361922d-e82e-4391-90c4-cd6c9e041bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:36.685986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361922d-e82e-4391-90c4-cd6c9e041bdd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:36.688382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 24/45] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:10:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:10:36.694077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab65163-18ab-4a80-ba31-37af9e79e05d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:36.802134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab65163-18ab-4a80-ba31-37af9e79e05d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:36.836135 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bf1bc-83f1-4bd2-9181-ef5beb470362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:36.836744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bf1bc-83f1-4bd2-9181-ef5beb470362 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:36.837025 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bf1bc-83f1-4bd2-9181-ef5beb470362 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:36.837329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bf1bc-83f1-4bd2-9181-ef5beb470362 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:36.838248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bf1bc-83f1-4bd2-9181-ef5beb470362 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:36.839708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bf1bc-83f1-4bd2-9181-ef5beb470362 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:36.944825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 22/46] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:10:36 2022] POST /identity/v3/projects => generated 312 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:10:38.548860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320447c8-ac3b-48b4-880f-cf5c0a2dee95 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:38.549415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320447c8-ac3b-48b4-880f-cf5c0a2dee95 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:38.549513 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320447c8-ac3b-48b4-880f-cf5c0a2dee95 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:38.550783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 25/47] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:38.556112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45257ed8-a788-4987-b6be-af672e7fa685 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:38.556524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45257ed8-a788-4987-b6be-af672e7fa685 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:38.556744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45257ed8-a788-4987-b6be-af672e7fa685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:38.574656 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-45257ed8-a788-4987-b6be-af672e7fa685 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:38.575839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-45257ed8-a788-4987-b6be-af672e7fa685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:38.620997 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:38.641457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 23/48] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:38.907395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320447c8-ac3b-48b4-880f-cf5c0a2dee95 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:39.011507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320447c8-ac3b-48b4-880f-cf5c0a2dee95 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:39.046444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b0423-6241-41cc-967b-97000108ac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:39.047068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b0423-6241-41cc-967b-97000108ac9b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:39.047351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b0423-6241-41cc-967b-97000108ac9b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:39.047626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b0423-6241-41cc-967b-97000108ac9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:39.057621 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b0423-6241-41cc-967b-97000108ac9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-bc5b0423-6241-41cc-967b-97000108ac9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:39.062566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:39.063393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:39.064146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:39.064146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:39.064146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:39.064146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:39.064146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:39.064146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:39.064146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:39.064146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:39.064146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:39.064146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:39.064146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:10:39.064146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:10:39.064146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 26/49] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:10:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:39.069586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45257ed8-a788-4987-b6be-af672e7fa685 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:39.093964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c40b6-d6d6-42b3-ac34-235eea445057 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:39.094244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c40b6-d6d6-42b3-ac34-235eea445057 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:39.094518 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c40b6-d6d6-42b3-ac34-235eea445057 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:39.095838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 27/50] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:10:39.100729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf8f2a-87b0-4b38-abf4-4e443551c5f0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:39.101017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf8f2a-87b0-4b38-abf4-4e443551c5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:39.101326 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf8f2a-87b0-4b38-abf4-4e443551c5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:39.118973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-99bf8f2a-87b0-4b38-abf4-4e443551c5f0 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:39.120514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-99bf8f2a-87b0-4b38-abf4-4e443551c5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:39.147387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:39.173099 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45257ed8-a788-4987-b6be-af672e7fa685 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:39.188717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 28/51] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:10:39.206773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aebe5a-c796-4644-ba22-629ebd7a78d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:39.207373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aebe5a-c796-4644-ba22-629ebd7a78d4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:39.207648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aebe5a-c796-4644-ba22-629ebd7a78d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:39.207915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aebe5a-c796-4644-ba22-629ebd7a78d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:39.208564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aebe5a-c796-4644-ba22-629ebd7a78d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:39.208863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aebe5a-c796-4644-ba22-629ebd7a78d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:39.210301 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aebe5a-c796-4644-ba22-629ebd7a78d4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:39.221671 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 24/52] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:10:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:39.227287 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf8f2a-87b0-4b38-abf4-4e443551c5f0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:39.324147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf8f2a-87b0-4b38-abf4-4e443551c5f0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:39.357509 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473238e0-1266-4bc4-9224-e41c86d2ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:39.358133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473238e0-1266-4bc4-9224-e41c86d2ab87 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:39.358413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473238e0-1266-4bc4-9224-e41c86d2ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:39.358688 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473238e0-1266-4bc4-9224-e41c86d2ab87 None admin] PATH_INFO: `/v3/users/809e7dc455e844f6967aa616532e4eb7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:39.359821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473238e0-1266-4bc4-9224-e41c86d2ab87 None admin] RBAC: Authorizing `identity:get_user(user_id=809e7dc455e844f6967aa616532e4eb7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:39.361301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473238e0-1266-4bc4-9224-e41c86d2ab87 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:39.362863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 29/53] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:39 2022] GET /identity/v3/users/809e7dc455e844f6967aa616532e4eb7 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:10:39.368141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aebe5a-c796-4644-ba22-629ebd7a78d4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:39.411230 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:39.451831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473238e0-1266-4bc4-9224-e41c86d2ab87 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:39.466591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aebe5a-c796-4644-ba22-629ebd7a78d4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:39.482166 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:39.501105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126518a2-ecad-4d6b-bc50-37ca0e717046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:39.501768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126518a2-ecad-4d6b-bc50-37ca0e717046 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:39.502109 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126518a2-ecad-4d6b-bc50-37ca0e717046 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:39.502398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126518a2-ecad-4d6b-bc50-37ca0e717046 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:39.503512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126518a2-ecad-4d6b-bc50-37ca0e717046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:39.504967 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126518a2-ecad-4d6b-bc50-37ca0e717046 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:39.506571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 25/54] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:10:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:10:39.512191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126518a2-ecad-4d6b-bc50-37ca0e717046 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:39.551805 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473238e0-1266-4bc4-9224-e41c86d2ab87 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:39.585297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bb48f-fec0-4d26-878d-63f7c7a42ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:39.585917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bb48f-fec0-4d26-878d-63f7c7a42ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:39.586191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bb48f-fec0-4d26-878d-63f7c7a42ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:39.586458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bb48f-fec0-4d26-878d-63f7c7a42ba8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:39.587543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bb48f-fec0-4d26-878d-63f7c7a42ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:39.588972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bb48f-fec0-4d26-878d-63f7c7a42ba8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:39.590548 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 30/55] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:10:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:10:39.596046 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bb48f-fec0-4d26-878d-63f7c7a42ba8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:39.611029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126518a2-ecad-4d6b-bc50-37ca0e717046 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:39.695933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:39.700028 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bb48f-fec0-4d26-878d-63f7c7a42ba8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:39.725486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:39.735906 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae5e60-d05a-4eaf-9bce-22f61a0857b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:39.738394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae5e60-d05a-4eaf-9bce-22f61a0857b4 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:39.738394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae5e60-d05a-4eaf-9bce-22f61a0857b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:39.738394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae5e60-d05a-4eaf-9bce-22f61a0857b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:39.738394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae5e60-d05a-4eaf-9bce-22f61a0857b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:39.739442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae5e60-d05a-4eaf-9bce-22f61a0857b4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:39.748642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a09ffa-65ef-4fd6-9042-c9de595708ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:39.750152 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09ffa-65ef-4fd6-9042-c9de595708ab None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:39.750605 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09ffa-65ef-4fd6-9042-c9de595708ab None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:39.751218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09ffa-65ef-4fd6-9042-c9de595708ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:39.751957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a09ffa-65ef-4fd6-9042-c9de595708ab None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.domain.id=default, user.id=809e7dc455e844f6967aa616532e4eb7) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:39.752272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a09ffa-65ef-4fd6-9042-c9de595708ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:39.753741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a09ffa-65ef-4fd6-9042-c9de595708ab None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:39.762406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 26/56] 10.222.0.48 () {56 vars in 1322 bytes} [Tue Sep 13 03:10:39 2022] GET /identity/v3/role_assignments?user.id=809e7dc455e844f6967aa616532e4eb7&scope.domain.id=default&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 530 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:10:39.807897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 31/57] 10.222.0.48 () {60 vars in 1140 bytes} [Tue Sep 13 03:10:39 2022] POST /identity/v3/projects => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:10:41.986136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0478-f29f-429d-bc17-75308dde2b36 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:41.986680 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0478-f29f-429d-bc17-75308dde2b36 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:41.986762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0478-f29f-429d-bc17-75308dde2b36 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:41.988057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 27/58] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:41.993373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc09dc9-86eb-4de2-80f7-0ae276d82e21 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:41.993795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc09dc9-86eb-4de2-80f7-0ae276d82e21 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:41.993936 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc09dc9-86eb-4de2-80f7-0ae276d82e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:42.011654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bfc09dc9-86eb-4de2-80f7-0ae276d82e21 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:42.012837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bfc09dc9-86eb-4de2-80f7-0ae276d82e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:42.078678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 32/59] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:42.342936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede0478-f29f-429d-bc17-75308dde2b36 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:42.442775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede0478-f29f-429d-bc17-75308dde2b36 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:42.475513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683afb2-6b73-40c6-bbf2-56c703a8a7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:42.476128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683afb2-6b73-40c6-bbf2-56c703a8a7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:42.476409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683afb2-6b73-40c6-bbf2-56c703a8a7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:42.476681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683afb2-6b73-40c6-bbf2-56c703a8a7d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:42.477810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683afb2-6b73-40c6-bbf2-56c703a8a7d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:42.479337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683afb2-6b73-40c6-bbf2-56c703a8a7d0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:42.480884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 28/60] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:10:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:42.486862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc09dc9-86eb-4de2-80f7-0ae276d82e21 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:42.564132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:42.582298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc09dc9-86eb-4de2-80f7-0ae276d82e21 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:42.614628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a31611-f1c4-4b3d-a62c-b7578d693453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:42.615165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a31611-f1c4-4b3d-a62c-b7578d693453 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:42.615442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a31611-f1c4-4b3d-a62c-b7578d693453 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:42.615751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a31611-f1c4-4b3d-a62c-b7578d693453 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:42.616414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a31611-f1c4-4b3d-a62c-b7578d693453 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:42.617884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a31611-f1c4-4b3d-a62c-b7578d693453 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:42.702822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 33/61] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:10:42 2022] POST /identity/v3/users => generated 275 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:10:45.852862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19454ab0-5642-45f5-84d8-dee10b654a6f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:45.853723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19454ab0-5642-45f5-84d8-dee10b654a6f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:45.854143 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19454ab0-5642-45f5-84d8-dee10b654a6f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:45.855714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 29/62] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:45.860917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96143-9b4d-4520-98cc-0a4030b9158d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:45.861698 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96143-9b4d-4520-98cc-0a4030b9158d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:45.862126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96143-9b4d-4520-98cc-0a4030b9158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:45.891264 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-83f96143-9b4d-4520-98cc-0a4030b9158d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:45.892747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-83f96143-9b4d-4520-98cc-0a4030b9158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:45.980832 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 34/63] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:10:46.019355 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b180c5-85fe-44f1-bac9-c961ff55fad4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:46.019872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b180c5-85fe-44f1-bac9-c961ff55fad4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:46.020318 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b180c5-85fe-44f1-bac9-c961ff55fad4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:46.021856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 30/64] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:46.037981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fec7e5-8768-49c5-8769-a9a101845663 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:46.038403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fec7e5-8768-49c5-8769-a9a101845663 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:46.038777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fec7e5-8768-49c5-8769-a9a101845663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:46.061246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-71fec7e5-8768-49c5-8769-a9a101845663 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:46.062448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-71fec7e5-8768-49c5-8769-a9a101845663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:46.123403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96e24a-5b15-4757-9cf1-24b946056e39 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:46.124013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96e24a-5b15-4757-9cf1-24b946056e39 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:46.124496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96e24a-5b15-4757-9cf1-24b946056e39 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:46.126057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 31/65] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:10:46.133307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354e09e-1477-434c-87d5-a90a97fb5354 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:46.133307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354e09e-1477-434c-87d5-a90a97fb5354 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:46.133307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354e09e-1477-434c-87d5-a90a97fb5354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:46.161297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:46.166410 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2354e09e-1477-434c-87d5-a90a97fb5354 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:46.167859 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2354e09e-1477-434c-87d5-a90a97fb5354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:46.174025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 35/66] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:46.230306 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:46.273248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 32/67] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:10:46.385563 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fec7e5-8768-49c5-8769-a9a101845663 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:46.441252 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354e09e-1477-434c-87d5-a90a97fb5354 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:46.556493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354e09e-1477-434c-87d5-a90a97fb5354 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:46.594172 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4dc5-5c85-40be-bb0a-9b6ecddb4973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:46.595039 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4dc5-5c85-40be-bb0a-9b6ecddb4973 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:46.595461 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4dc5-5c85-40be-bb0a-9b6ecddb4973 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:46.595873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4dc5-5c85-40be-bb0a-9b6ecddb4973 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:46.596030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fec7e5-8768-49c5-8769-a9a101845663 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:46.608235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a4dc5-5c85-40be-bb0a-9b6ecddb4973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-123a4dc5-5c85-40be-bb0a-9b6ecddb4973 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:46.615051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:46.615923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:46.616683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:46.616683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:46.616683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:46.616683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:46.616683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:46.616683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:46.616683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:46.616683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:46.616683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:46.616683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:46.616683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:10:46.616683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:10:46.619294 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 33/68] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:10:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:10:46.620349 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4dc5-5c85-40be-bb0a-9b6ecddb4973 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:46.639593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fdd12-1524-4667-86e9-0f4344faff4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:46.641491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fdd12-1524-4667-86e9-0f4344faff4c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:46.642413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fdd12-1524-4667-86e9-0f4344faff4c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:46.642910 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fdd12-1524-4667-86e9-0f4344faff4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:46.657632 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:46.660896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fdd12-1524-4667-86e9-0f4344faff4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-173fdd12-1524-4667-86e9-0f4344faff4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:46.667599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:46.668519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:46.669301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:46.669301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:46.669301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:46.669301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:46.669301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:46.669301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:46.669301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:46.669301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:46.669301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:46.669301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:46.669301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:10:46.669301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:10:46.676594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 36/69] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:10:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:46.676594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fdd12-1524-4667-86e9-0f4344faff4c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:46.751079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:46.751271 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4dc5-5c85-40be-bb0a-9b6ecddb4973 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:46.791201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad221e9-54aa-4f24-bb40-8491c0a2fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:46.791831 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad221e9-54aa-4f24-bb40-8491c0a2fff2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:46.792120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad221e9-54aa-4f24-bb40-8491c0a2fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:46.792392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad221e9-54aa-4f24-bb40-8491c0a2fff2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:46.802984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad221e9-54aa-4f24-bb40-8491c0a2fff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:46.804439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fdd12-1524-4667-86e9-0f4344faff4c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-2ad221e9-54aa-4f24-bb40-8491c0a2fff2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:46.807933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:46.808768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:46.809898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:46.809898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:46.809898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:46.809898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:46.809898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:46.809898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:46.809898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:46.809898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:46.809898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:46.809898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:46.809898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:10:46.809898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:10:46.809898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 34/70] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:10:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:46.812086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad221e9-54aa-4f24-bb40-8491c0a2fff2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:46.846010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0de9ab-738d-477d-aa94-e542a6e9b3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:46.846615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de9ab-738d-477d-aa94-e542a6e9b3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:46.846892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de9ab-738d-477d-aa94-e542a6e9b3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:46.847161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0de9ab-738d-477d-aa94-e542a6e9b3a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:46.847820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0de9ab-738d-477d-aa94-e542a6e9b3a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:46.848122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0de9ab-738d-477d-aa94-e542a6e9b3a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:46.849546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0de9ab-738d-477d-aa94-e542a6e9b3a7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:46.857477 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 37/71] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:10:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:46.857477 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256e351-cc78-48b0-872c-74bf2e79d051 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:46.857477 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256e351-cc78-48b0-872c-74bf2e79d051 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:46.857477 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256e351-cc78-48b0-872c-74bf2e79d051 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:46.857477 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 38/72] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:46.857477 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256e351-cc78-48b0-872c-74bf2e79d051 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:46.908975 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:46.917350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad221e9-54aa-4f24-bb40-8491c0a2fff2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:46.950964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a905af3-0a2b-442a-8b3c-b37ea3ee05a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:46.951558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a905af3-0a2b-442a-8b3c-b37ea3ee05a9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:46.952452 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a905af3-0a2b-442a-8b3c-b37ea3ee05a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:46.952736 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a905af3-0a2b-442a-8b3c-b37ea3ee05a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:46.953429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a905af3-0a2b-442a-8b3c-b37ea3ee05a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:46.953723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a905af3-0a2b-442a-8b3c-b37ea3ee05a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:46.955111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a905af3-0a2b-442a-8b3c-b37ea3ee05a9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:46.962208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256e351-cc78-48b0-872c-74bf2e79d051 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:46.968725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 35/73] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:10:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:46.968725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b80b2e-ee22-44dc-a18f-6975b7c6f566 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:46.968725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b80b2e-ee22-44dc-a18f-6975b7c6f566 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:46.968725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b80b2e-ee22-44dc-a18f-6975b7c6f566 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:46.969907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 36/74] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:46.970614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b80b2e-ee22-44dc-a18f-6975b7c6f566 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:46.982686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:46.999815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a74f6-c899-4a09-8939-9d552b607b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:47.000436 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a74f6-c899-4a09-8939-9d552b607b33 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:47.000721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a74f6-c899-4a09-8939-9d552b607b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:47.000994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a74f6-c899-4a09-8939-9d552b607b33 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:47.001710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a74f6-c899-4a09-8939-9d552b607b33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:47.003487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a74f6-c899-4a09-8939-9d552b607b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:47.003487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a74f6-c899-4a09-8939-9d552b607b33 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:47.012198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 39/75] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:10:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:47.014888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734d171-d1e4-4273-bfd9-edc714998e01 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:47.015179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734d171-d1e4-4273-bfd9-edc714998e01 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:47.015497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734d171-d1e4-4273-bfd9-edc714998e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:47.032690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d734d171-d1e4-4273-bfd9-edc714998e01 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:47.033915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d734d171-d1e4-4273-bfd9-edc714998e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:47.078649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b80b2e-ee22-44dc-a18f-6975b7c6f566 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:47.099075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 40/76] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:47.099891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734d171-d1e4-4273-bfd9-edc714998e01 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:47.127293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017cc44-b71b-4704-965d-a504fdd56bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:47.128014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017cc44-b71b-4704-965d-a504fdd56bff None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:47.128300 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017cc44-b71b-4704-965d-a504fdd56bff None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:47.128574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017cc44-b71b-4704-965d-a504fdd56bff None admin] PATH_INFO: `/v3/users/34120ea2deec47d6b705c0a9193dce4e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:47.144056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017cc44-b71b-4704-965d-a504fdd56bff None admin] RBAC: Authorizing `identity:get_user(user_id=34120ea2deec47d6b705c0a9193dce4e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:47.145538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017cc44-b71b-4704-965d-a504fdd56bff None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:47.147348 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 37/77] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:46 2022] GET /identity/v3/users/34120ea2deec47d6b705c0a9193dce4e => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:47.152967 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544aa50e-c898-4460-b5bf-e1c457e9e138 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:47.153253 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544aa50e-c898-4460-b5bf-e1c457e9e138 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:47.153626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544aa50e-c898-4460-b5bf-e1c457e9e138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:47.171901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-544aa50e-c898-4460-b5bf-e1c457e9e138 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:47.173180 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-544aa50e-c898-4460-b5bf-e1c457e9e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:47.180863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:47.210985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734d171-d1e4-4273-bfd9-edc714998e01 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:47.222926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:47.244865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 38/78] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:47.246318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978186c-d0d8-4bd1-b7c8-413f606002e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:47.246959 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978186c-d0d8-4bd1-b7c8-413f606002e1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:47.247241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978186c-d0d8-4bd1-b7c8-413f606002e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:47.247517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978186c-d0d8-4bd1-b7c8-413f606002e1 None admin] PATH_INFO: `/v3/users/34120ea2deec47d6b705c0a9193dce4e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:47.248666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978186c-d0d8-4bd1-b7c8-413f606002e1 None admin] RBAC: Authorizing `identity:get_user(user_id=34120ea2deec47d6b705c0a9193dce4e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:47.250761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978186c-d0d8-4bd1-b7c8-413f606002e1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:47.252495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 41/79] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:47 2022] GET /identity/v3/users/34120ea2deec47d6b705c0a9193dce4e => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:47.265407 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544aa50e-c898-4460-b5bf-e1c457e9e138 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:47.265554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978186c-d0d8-4bd1-b7c8-413f606002e1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:47.376625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978186c-d0d8-4bd1-b7c8-413f606002e1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:47.382250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544aa50e-c898-4460-b5bf-e1c457e9e138 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:47.413191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5ce9d-44eb-4efd-9c0f-fc31470271d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:47.414261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5ce9d-44eb-4efd-9c0f-fc31470271d7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:47.414546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5ce9d-44eb-4efd-9c0f-fc31470271d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:47.414818 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5ce9d-44eb-4efd-9c0f-fc31470271d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:47.419664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8ec62-f8ce-4d61-83ad-5281d5b4bb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:47.420626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8ec62-f8ce-4d61-83ad-5281d5b4bb8d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:47.421661 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8ec62-f8ce-4d61-83ad-5281d5b4bb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:47.422000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8ec62-f8ce-4d61-83ad-5281d5b4bb8d None admin] PATH_INFO: `/v3/users/809e7dc455e844f6967aa616532e4eb7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:47.423480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8ec62-f8ce-4d61-83ad-5281d5b4bb8d None admin] RBAC: Authorizing `identity:get_user(user_id=809e7dc455e844f6967aa616532e4eb7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:47.424610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8ec62-f8ce-4d61-83ad-5281d5b4bb8d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:47.426443 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 39/80] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:47 2022] GET /identity/v3/users/809e7dc455e844f6967aa616532e4eb7 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:47.431424 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8ec62-f8ce-4d61-83ad-5281d5b4bb8d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:47.443372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:47.462152 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:47.486471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5ce9d-44eb-4efd-9c0f-fc31470271d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:47.488209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5ce9d-44eb-4efd-9c0f-fc31470271d7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:47.538553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8ec62-f8ce-4d61-83ad-5281d5b4bb8d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:47.572600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b1304-7cd9-4da9-b90e-7624dbef5572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:47.573206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b1304-7cd9-4da9-b90e-7624dbef5572 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:47.573517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b1304-7cd9-4da9-b90e-7624dbef5572 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:47.573790 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b1304-7cd9-4da9-b90e-7624dbef5572 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:47.587140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 42/81] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:10:47.587977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5ce9d-44eb-4efd-9c0f-fc31470271d7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:47.641792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b1304-7cd9-4da9-b90e-7624dbef5572 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:47.643293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b1304-7cd9-4da9-b90e-7624dbef5572 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:47.653905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:47.664837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:47.685618 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5ce9d-44eb-4efd-9c0f-fc31470271d7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:47.719333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a28ef-f539-4ead-bab9-aaaeddd6d7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:47.719981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a28ef-f539-4ead-bab9-aaaeddd6d7cc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:47.720259 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a28ef-f539-4ead-bab9-aaaeddd6d7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:47.720533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a28ef-f539-4ead-bab9-aaaeddd6d7cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:47.721664 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a28ef-f539-4ead-bab9-aaaeddd6d7cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:47.723111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a28ef-f539-4ead-bab9-aaaeddd6d7cc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:47.724899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 43/82] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:10:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:47.725525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a28ef-f539-4ead-bab9-aaaeddd6d7cc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:47.742017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 40/83] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:10:47.742932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b1304-7cd9-4da9-b90e-7624dbef5572 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:47.822489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a28ef-f539-4ead-bab9-aaaeddd6d7cc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:47.840608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b1304-7cd9-4da9-b90e-7624dbef5572 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:47.851585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:47.857846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9663cf5-155b-405a-aaaa-95fa69c9644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:47.858456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9663cf5-155b-405a-aaaa-95fa69c9644a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:47.858735 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9663cf5-155b-405a-aaaa-95fa69c9644a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:47.859001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9663cf5-155b-405a-aaaa-95fa69c9644a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:47.873571 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:47.874852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922d748-262a-416f-8433-bc161abd8cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:47.875835 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922d748-262a-416f-8433-bc161abd8cbb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:47.876116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922d748-262a-416f-8433-bc161abd8cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:47.876393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922d748-262a-416f-8433-bc161abd8cbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:47.886753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922d748-262a-416f-8433-bc161abd8cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a922d748-262a-416f-8433-bc161abd8cbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:47.892286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:47.893121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:47.894090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:47.894090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:47.894090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:47.894090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:47.894090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:47.894090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:47.894090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:47.894090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:47.894090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:47.894090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:47.894090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:10:47.894090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:10:47.894090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 41/84] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:10:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:47.895239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922d748-262a-416f-8433-bc161abd8cbb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:47.930017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9663cf5-155b-405a-aaaa-95fa69c9644a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:47.931507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9663cf5-155b-405a-aaaa-95fa69c9644a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:47.989346 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922d748-262a-416f-8433-bc161abd8cbb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:48.021987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe3c92-4fae-411a-b496-c74ca0e9eae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:48.022603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe3c92-4fae-411a-b496-c74ca0e9eae7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:48.022882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe3c92-4fae-411a-b496-c74ca0e9eae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:48.023156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe3c92-4fae-411a-b496-c74ca0e9eae7 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:48.024276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe3c92-4fae-411a-b496-c74ca0e9eae7 None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:48.025761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe3c92-4fae-411a-b496-c74ca0e9eae7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:48.027371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 42/85] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:10:47 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:48.028188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe3c92-4fae-411a-b496-c74ca0e9eae7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:48.028808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 44/86] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:10:48.029807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9663cf5-155b-405a-aaaa-95fa69c9644a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:48.066727 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:48.077550 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:48.126457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe3c92-4fae-411a-b496-c74ca0e9eae7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:48.130640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9663cf5-155b-405a-aaaa-95fa69c9644a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:48.163244 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba8d6b-0199-4711-9536-e8bde5765ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:48.163844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba8d6b-0199-4711-9536-e8bde5765ed2 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:48.164120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba8d6b-0199-4711-9536-e8bde5765ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:48.164389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba8d6b-0199-4711-9536-e8bde5765ed2 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:48.165027 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba8d6b-0199-4711-9536-e8bde5765ed2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:48.166501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba8d6b-0199-4711-9536-e8bde5765ed2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:48.166626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83485199-715e-4ae4-b785-d510293def15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:48.167248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83485199-715e-4ae4-b785-d510293def15 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:48.167524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83485199-715e-4ae4-b785-d510293def15 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:48.167796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83485199-715e-4ae4-b785-d510293def15 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:48.168909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83485199-715e-4ae4-b785-d510293def15 None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:48.170382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83485199-715e-4ae4-b785-d510293def15 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:48.172179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 45/87] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:10:48 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:48.172724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83485199-715e-4ae4-b785-d510293def15 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:48.262324 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 43/88] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:10:48 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:10:48.263075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba8d6b-0199-4711-9536-e8bde5765ed2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:48.270881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83485199-715e-4ae4-b785-d510293def15 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:48.287365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:48.309090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d05d6-5b6b-4cc1-8374-94b2d2c7d2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:48.309741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d05d6-5b6b-4cc1-8374-94b2d2c7d2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:48.310021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d05d6-5b6b-4cc1-8374-94b2d2c7d2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:48.310292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d05d6-5b6b-4cc1-8374-94b2d2c7d2b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:48.310965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d05d6-5b6b-4cc1-8374-94b2d2c7d2b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:48.311869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d05d6-5b6b-4cc1-8374-94b2d2c7d2b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:48.313450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d05d6-5b6b-4cc1-8374-94b2d2c7d2b5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:48.323207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 46/89] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:10:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:48.324078 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d05d6-5b6b-4cc1-8374-94b2d2c7d2b5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:48.384340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:48.392280 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba8d6b-0199-4711-9536-e8bde5765ed2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:48.434733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d05d6-5b6b-4cc1-8374-94b2d2c7d2b5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:48.434918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a250-e47c-430d-97c9-abfb59d4f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:48.435369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a250-e47c-430d-97c9-abfb59d4f987 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:48.436589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a250-e47c-430d-97c9-abfb59d4f987 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:48.436909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a250-e47c-430d-97c9-abfb59d4f987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:48.437920 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6a250-e47c-430d-97c9-abfb59d4f987 None admin] RBAC: Adding query filter params (role.id=e577106295c544bfbe1944b178cb95e5, scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0, user.id=34120ea2deec47d6b705c0a9193dce4e) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:48.438570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6a250-e47c-430d-97c9-abfb59d4f987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:48.440060 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6a250-e47c-430d-97c9-abfb59d4f987 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:48.447083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 44/90] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:10:48 2022] GET /identity/v3/role_assignments?user.id=34120ea2deec47d6b705c0a9193dce4e&scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0&role.id=e577106295c544bfbe1944b178cb95e5 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:48.447939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a250-e47c-430d-97c9-abfb59d4f987 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:48.480092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2caf-c351-4afb-802d-96f804c16edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:48.481319 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2caf-c351-4afb-802d-96f804c16edf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:48.482168 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2caf-c351-4afb-802d-96f804c16edf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:48.482654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2caf-c351-4afb-802d-96f804c16edf None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:48.484693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c2caf-c351-4afb-802d-96f804c16edf None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:48.487130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c2caf-c351-4afb-802d-96f804c16edf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:48.489752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 47/91] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:10:48 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:48.491447 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2caf-c351-4afb-802d-96f804c16edf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:48.566900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:48.600772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a250-e47c-430d-97c9-abfb59d4f987 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:48.659312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2caf-c351-4afb-802d-96f804c16edf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:48.685441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a3e4f-5fbd-44d0-8e30-45256684d8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:48.685441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a3e4f-5fbd-44d0-8e30-45256684d8ca None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:48.685441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a3e4f-5fbd-44d0-8e30-45256684d8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:48.685441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a3e4f-5fbd-44d0-8e30-45256684d8ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:48.685877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a3e4f-5fbd-44d0-8e30-45256684d8ca None admin] RBAC: Adding query filter params (role.id=367ec0d2bcdc49f09b0772bbd737e5ce, scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0, user.id=34120ea2deec47d6b705c0a9193dce4e) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:48.685877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a3e4f-5fbd-44d0-8e30-45256684d8ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:48.686357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a3e4f-5fbd-44d0-8e30-45256684d8ca None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:48.696067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 45/92] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:10:48 2022] GET /identity/v3/role_assignments?user.id=34120ea2deec47d6b705c0a9193dce4e&scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0&role.id=367ec0d2bcdc49f09b0772bbd737e5ce => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:48.696750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a3e4f-5fbd-44d0-8e30-45256684d8ca None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:48.732569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beab346-dd95-456f-9483-d5e425ba9570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:48.733362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beab346-dd95-456f-9483-d5e425ba9570 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:48.734645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beab346-dd95-456f-9483-d5e425ba9570 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:48.735000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beab346-dd95-456f-9483-d5e425ba9570 None admin] PATH_INFO: `/v3/users/34120ea2deec47d6b705c0a9193dce4e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:48.739613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beab346-dd95-456f-9483-d5e425ba9570 None admin] RBAC: Authorizing `identity:get_user(user_id=34120ea2deec47d6b705c0a9193dce4e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:48.742542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beab346-dd95-456f-9483-d5e425ba9570 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:48.744367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 48/93] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:48 2022] GET /identity/v3/users/34120ea2deec47d6b705c0a9193dce4e => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:48.750442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beab346-dd95-456f-9483-d5e425ba9570 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:48.751484 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:49.004976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a3e4f-5fbd-44d0-8e30-45256684d8ca None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:49.055731 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beab346-dd95-456f-9483-d5e425ba9570 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:49.075432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdda008-4234-4598-a8d0-2ffb500201c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:49.076054 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdda008-4234-4598-a8d0-2ffb500201c2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:49.076340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdda008-4234-4598-a8d0-2ffb500201c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:49.076615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdda008-4234-4598-a8d0-2ffb500201c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:49.077939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdda008-4234-4598-a8d0-2ffb500201c2 None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0, user.id=809e7dc455e844f6967aa616532e4eb7) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:49.078249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdda008-4234-4598-a8d0-2ffb500201c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:49.079706 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdda008-4234-4598-a8d0-2ffb500201c2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:49.094710 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 46/94] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:10:48 2022] GET /identity/v3/role_assignments?user.id=809e7dc455e844f6967aa616532e4eb7&scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 259 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:49.116377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:49.185021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2635b8-a16b-4a1d-ba0c-5ad3188140eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:49.185703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2635b8-a16b-4a1d-ba0c-5ad3188140eb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:49.185988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2635b8-a16b-4a1d-ba0c-5ad3188140eb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:49.189775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2635b8-a16b-4a1d-ba0c-5ad3188140eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:49.312159 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2635b8-a16b-4a1d-ba0c-5ad3188140eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:49.313640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2635b8-a16b-4a1d-ba0c-5ad3188140eb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:49.444205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 49/95] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:10:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:10:49.450210 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdda008-4234-4598-a8d0-2ffb500201c2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:49.563419 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:49.583410 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdda008-4234-4598-a8d0-2ffb500201c2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:49.619404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cbcbd-8628-4acd-b118-6b5aab8983fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:49.620044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cbcbd-8628-4acd-b118-6b5aab8983fd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:49.620332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cbcbd-8628-4acd-b118-6b5aab8983fd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:49.620608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cbcbd-8628-4acd-b118-6b5aab8983fd None admin] PATH_INFO: `/v3/projects/091454ece8864cc3928010772c7e4054` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:49.621816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cbcbd-8628-4acd-b118-6b5aab8983fd None admin] RBAC: Authorizing `identity:get_project(project_id=091454ece8864cc3928010772c7e4054)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:49.623274 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cbcbd-8628-4acd-b118-6b5aab8983fd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:49.625291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 47/96] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:10:49 2022] GET /identity/v3/projects/091454ece8864cc3928010772c7e4054 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:49.631013 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2635b8-a16b-4a1d-ba0c-5ad3188140eb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:49.647328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:49.746660 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2635b8-a16b-4a1d-ba0c-5ad3188140eb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:49.786259 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca24aa-83ee-45df-b4c6-b049f8e43319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:49.786877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca24aa-83ee-45df-b4c6-b049f8e43319 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:49.787155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca24aa-83ee-45df-b4c6-b049f8e43319 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:49.787468 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca24aa-83ee-45df-b4c6-b049f8e43319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:49.788206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca24aa-83ee-45df-b4c6-b049f8e43319 None admin] RBAC: Adding query filter params (role.id=367ec0d2bcdc49f09b0772bbd737e5ce, scope.project.id=091454ece8864cc3928010772c7e4054, user.id=34120ea2deec47d6b705c0a9193dce4e) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:49.788517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca24aa-83ee-45df-b4c6-b049f8e43319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:49.790013 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca24aa-83ee-45df-b4c6-b049f8e43319 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:49.800265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 50/97] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:10:49 2022] GET /identity/v3/role_assignments?user.id=34120ea2deec47d6b705c0a9193dce4e&scope.project.id=091454ece8864cc3928010772c7e4054&role.id=367ec0d2bcdc49f09b0772bbd737e5ce => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:51.551162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82e9b-1fcf-4ec7-9e64-836bf0ef710a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:51.551698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82e9b-1fcf-4ec7-9e64-836bf0ef710a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:51.551698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c82e9b-1fcf-4ec7-9e64-836bf0ef710a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:51.553043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 48/98] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:51.567044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c506130-399d-49a5-ad94-edb0ffe43937 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:51.567952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c506130-399d-49a5-ad94-edb0ffe43937 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:51.568511 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c506130-399d-49a5-ad94-edb0ffe43937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:51.594320 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3c506130-399d-49a5-ad94-edb0ffe43937 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:51.595849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3c506130-399d-49a5-ad94-edb0ffe43937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:51.679941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 51/99] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:51.687108 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b29e6d-10bd-4b2d-8225-cfabc369e572 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:51.687646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b29e6d-10bd-4b2d-8225-cfabc369e572 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:51.688116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b29e6d-10bd-4b2d-8225-cfabc369e572 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:51.689674 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 49/100] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:51.694947 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4787d0-8887-4d01-8894-d0697ffa918a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:51.695460 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4787d0-8887-4d01-8894-d0697ffa918a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:51.695956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4787d0-8887-4d01-8894-d0697ffa918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:51.714250 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:51.725569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5f4787d0-8887-4d01-8894-d0697ffa918a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:51.727004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5f4787d0-8887-4d01-8894-d0697ffa918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:51.812054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 52/101] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:52.080261 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6312c25-9396-4be8-b52c-da371d6ccc4d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:52.080921 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6312c25-9396-4be8-b52c-da371d6ccc4d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:52.081431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6312c25-9396-4be8-b52c-da371d6ccc4d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:52.083271 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 50/102] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:52.088194 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d85ff0-1e83-4c87-ab0e-5f201e6b6477 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:52.088487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d85ff0-1e83-4c87-ab0e-5f201e6b6477 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:52.088769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d85ff0-1e83-4c87-ab0e-5f201e6b6477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:52.114248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a8d85ff0-1e83-4c87-ab0e-5f201e6b6477 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:52.115434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a8d85ff0-1e83-4c87-ab0e-5f201e6b6477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:52.128349 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6312c25-9396-4be8-b52c-da371d6ccc4d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:52.235502 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 53/103] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:52.237658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa2c49-16a6-43ec-aaeb-adf91656ec74 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:52.237948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa2c49-16a6-43ec-aaeb-adf91656ec74 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:52.238226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa2c49-16a6-43ec-aaeb-adf91656ec74 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:52.241541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 54/104] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:52.244844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd27cd-d95f-4b72-962c-239223a8220c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:52.245126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd27cd-d95f-4b72-962c-239223a8220c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:52.245439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd27cd-d95f-4b72-962c-239223a8220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:52.282373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2efd27cd-d95f-4b72-962c-239223a8220c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:52.283723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2efd27cd-d95f-4b72-962c-239223a8220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:52.314392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6312c25-9396-4be8-b52c-da371d6ccc4d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:52.392464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9063dd-631e-49ba-b50d-732b3be592a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:52.393029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9063dd-631e-49ba-b50d-732b3be592a0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:52.393342 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9063dd-631e-49ba-b50d-732b3be592a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:52.393623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9063dd-631e-49ba-b50d-732b3be592a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:52.394215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:52.395224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9063dd-631e-49ba-b50d-732b3be592a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:52.396693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9063dd-631e-49ba-b50d-732b3be592a0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:52.398329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 51/105] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:10:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:10:52.399099 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9063dd-631e-49ba-b50d-732b3be592a0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:52.411659 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 55/106] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:52.412867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd27cd-d95f-4b72-962c-239223a8220c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:52.457290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:52.585139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd27cd-d95f-4b72-962c-239223a8220c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:52.585760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9063dd-631e-49ba-b50d-732b3be592a0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:52.621641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda67b72-1074-4f58-b244-13e9e936037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:52.622242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda67b72-1074-4f58-b244-13e9e936037c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:52.622523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda67b72-1074-4f58-b244-13e9e936037c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:52.622799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda67b72-1074-4f58-b244-13e9e936037c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:52.630926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03416b5-d57b-4f2a-95cb-9cfb724d5ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:52.632181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03416b5-d57b-4f2a-95cb-9cfb724d5ec1 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:52.632675 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03416b5-d57b-4f2a-95cb-9cfb724d5ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:52.633139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03416b5-d57b-4f2a-95cb-9cfb724d5ec1 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:52.634267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03416b5-d57b-4f2a-95cb-9cfb724d5ec1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:52.634666 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda67b72-1074-4f58-b244-13e9e936037c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:52.636146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03416b5-d57b-4f2a-95cb-9cfb724d5ec1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-eda67b72-1074-4f58-b244-13e9e936037c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:52.640867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:52.641747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:52.642558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:52.642558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:52.642558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:52.642558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:52.642558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:52.642558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:52.642558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:52.642558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:52.642558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:52.642558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:52.642558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:10:52.642558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:10:52.642558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 52/107] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:10:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:52.643909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aacb5-81e8-445d-ac1a-1b400c366b99 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:52.643909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aacb5-81e8-445d-ac1a-1b400c366b99 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:52.643909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aacb5-81e8-445d-ac1a-1b400c366b99 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:52.645360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 53/108] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:52.646386 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aacb5-81e8-445d-ac1a-1b400c366b99 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:52.713395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 56/109] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:10:52 2022] POST /identity/v3/projects => generated 302 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:10:52.716463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822536d-cad5-40ad-9332-cbb1d143ae32 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:52.716965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822536d-cad5-40ad-9332-cbb1d143ae32 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:52.718000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822536d-cad5-40ad-9332-cbb1d143ae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:52.743032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5822536d-cad5-40ad-9332-cbb1d143ae32 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:52.744814 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5822536d-cad5-40ad-9332-cbb1d143ae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:52.757779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:52.783874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aacb5-81e8-445d-ac1a-1b400c366b99 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:52.819575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:52.826048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41aaa1e-a046-4c58-9f93-df475b162cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:52.826539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41aaa1e-a046-4c58-9f93-df475b162cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:52.826827 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41aaa1e-a046-4c58-9f93-df475b162cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:52.827149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41aaa1e-a046-4c58-9f93-df475b162cd2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:52.840957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41aaa1e-a046-4c58-9f93-df475b162cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-e41aaa1e-a046-4c58-9f93-df475b162cd2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:52.847748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:52.848675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:52.849469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:52.849469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:52.849469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:52.849469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:52.849469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:52.849469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:52.849469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:52.849469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:52.849469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:52.849469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:52.849469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:10:52.849469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:10:52.853480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 54/110] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:10:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:52.854453 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 57/111] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:52.854558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41aaa1e-a046-4c58-9f93-df475b162cd2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:52.855611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822536d-cad5-40ad-9332-cbb1d143ae32 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:52.983239 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822536d-cad5-40ad-9332-cbb1d143ae32 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:52.987646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41aaa1e-a046-4c58-9f93-df475b162cd2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:53.021039 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7aaea-5ac4-448a-8b2a-0265dbb83303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:53.021732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7aaea-5ac4-448a-8b2a-0265dbb83303 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:53.022120 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7aaea-5ac4-448a-8b2a-0265dbb83303 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:53.022454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7aaea-5ac4-448a-8b2a-0265dbb83303 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:53.036681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7aaea-5ac4-448a-8b2a-0265dbb83303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:53.038969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e25755-8b22-4e20-8241-55b9873cd7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:53.039883 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e25755-8b22-4e20-8241-55b9873cd7ae None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:53.040359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e25755-8b22-4e20-8241-55b9873cd7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:53.040888 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e25755-8b22-4e20-8241-55b9873cd7ae None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-21c7aaea-5ac4-448a-8b2a-0265dbb83303 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:53.041691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:53.042549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:53.043303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:53.043303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:53.043303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:53.043303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:53.043303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:53.043303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:53.043303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:53.043303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:53.043303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:53.043303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:53.043303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:10:53.043303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:10:53.043303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 58/112] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:10:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:53.044498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7aaea-5ac4-448a-8b2a-0265dbb83303 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:53.044833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e25755-8b22-4e20-8241-55b9873cd7ae None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:53.045493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e25755-8b22-4e20-8241-55b9873cd7ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:53.047567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e25755-8b22-4e20-8241-55b9873cd7ae None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:53.060093 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 55/113] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:10:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:53.062351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ba3d-eab2-48ce-b3ab-501362ce914e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:53.062953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ba3d-eab2-48ce-b3ab-501362ce914e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:53.063427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ba3d-eab2-48ce-b3ab-501362ce914e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:53.065556 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 56/114] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:53.066456 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779ba3d-eab2-48ce-b3ab-501362ce914e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:53.071194 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:53.089531 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:53.159863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7aaea-5ac4-448a-8b2a-0265dbb83303 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:53.195472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d645c1-a834-4dba-bce1-d74507699ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:53.196080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d645c1-a834-4dba-bce1-d74507699ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:53.196360 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d645c1-a834-4dba-bce1-d74507699ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:53.196633 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d645c1-a834-4dba-bce1-d74507699ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:53.197323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d645c1-a834-4dba-bce1-d74507699ea0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:53.197632 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d645c1-a834-4dba-bce1-d74507699ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:53.199024 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d645c1-a834-4dba-bce1-d74507699ea0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:53.201635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779ba3d-eab2-48ce-b3ab-501362ce914e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:53.212036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 59/115] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:10:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:53.212036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d645c1-a834-4dba-bce1-d74507699ea0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:53.240518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc89333-5f4c-41b8-98c6-b9dbf51b0424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:53.241045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc89333-5f4c-41b8-98c6-b9dbf51b0424 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:53.241364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc89333-5f4c-41b8-98c6-b9dbf51b0424 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:53.241640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc89333-5f4c-41b8-98c6-b9dbf51b0424 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:53.242313 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc89333-5f4c-41b8-98c6-b9dbf51b0424 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:53.242613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc89333-5f4c-41b8-98c6-b9dbf51b0424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:53.243997 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc89333-5f4c-41b8-98c6-b9dbf51b0424 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:53.253448 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 57/116] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:10:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:53.254644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d93cf-61fc-470c-bfa2-3c8426d2de68 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:53.254934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d93cf-61fc-470c-bfa2-3c8426d2de68 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:53.255213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d93cf-61fc-470c-bfa2-3c8426d2de68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:53.272806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-135d93cf-61fc-470c-bfa2-3c8426d2de68 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:53.274048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-135d93cf-61fc-470c-bfa2-3c8426d2de68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:53.329741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:53.332671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d645c1-a834-4dba-bce1-d74507699ea0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:53.336461 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:53.353288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 58/117] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:53.353288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d93cf-61fc-470c-bfa2-3c8426d2de68 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:53.387958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f5388-34cc-43e3-8d99-bf931444d4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:53.389422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f5388-34cc-43e3-8d99-bf931444d4da None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:53.394925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f5388-34cc-43e3-8d99-bf931444d4da None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:53.394925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f5388-34cc-43e3-8d99-bf931444d4da None admin] PATH_INFO: `/v3/users/34120ea2deec47d6b705c0a9193dce4e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:53.394925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f5388-34cc-43e3-8d99-bf931444d4da None admin] RBAC: Authorizing `identity:get_user(user_id=34120ea2deec47d6b705c0a9193dce4e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:53.394925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f5388-34cc-43e3-8d99-bf931444d4da None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:53.395888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 60/118] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:53 2022] GET /identity/v3/users/34120ea2deec47d6b705c0a9193dce4e => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:53.397167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f5388-34cc-43e3-8d99-bf931444d4da None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:53.452769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d93cf-61fc-470c-bfa2-3c8426d2de68 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:53.489521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8af75-e789-432e-ac62-77935095267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:53.490429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8af75-e789-432e-ac62-77935095267f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:53.490866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8af75-e789-432e-ac62-77935095267f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:53.491168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8af75-e789-432e-ac62-77935095267f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:53.503491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8af75-e789-432e-ac62-77935095267f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b1d8af75-e789-432e-ac62-77935095267f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:53.509087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:53.509974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:53.510735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:53.510735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:53.510735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:53.510735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:53.510735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:53.510735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:53.510735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:53.510735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:53.510735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:53.510735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:53.510735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:10:53.510735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:10:53.510735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 59/119] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:53.511367 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8af75-e789-432e-ac62-77935095267f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:53.511629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f5388-34cc-43e3-8d99-bf931444d4da None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:53.549396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7d9f7-c60c-42e3-8c52-c643ce9c5444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:53.550057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7d9f7-c60c-42e3-8c52-c643ce9c5444 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:53.550429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7d9f7-c60c-42e3-8c52-c643ce9c5444 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:53.550716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7d9f7-c60c-42e3-8c52-c643ce9c5444 None admin] PATH_INFO: `/v3/users/34120ea2deec47d6b705c0a9193dce4e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:53.551869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7d9f7-c60c-42e3-8c52-c643ce9c5444 None admin] RBAC: Authorizing `identity:get_user(user_id=34120ea2deec47d6b705c0a9193dce4e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:53.553375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7d9f7-c60c-42e3-8c52-c643ce9c5444 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:53.559571 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 61/120] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:53 2022] GET /identity/v3/users/34120ea2deec47d6b705c0a9193dce4e => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:53.560530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7d9f7-c60c-42e3-8c52-c643ce9c5444 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:53.574919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:53.600244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:53.622837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8af75-e789-432e-ac62-77935095267f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:53.659933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f3a15-afb2-4ed5-86c1-8e6ea559c060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:53.660595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f3a15-afb2-4ed5-86c1-8e6ea559c060 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:53.660874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f3a15-afb2-4ed5-86c1-8e6ea559c060 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:53.661151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f3a15-afb2-4ed5-86c1-8e6ea559c060 None admin] PATH_INFO: `/v3/users/628ed052d3c3458d82d0904823fd1bce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:53.671245 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7d9f7-c60c-42e3-8c52-c643ce9c5444 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:53.676615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f3a15-afb2-4ed5-86c1-8e6ea559c060 None admin] RBAC: Authorizing `identity:get_user(user_id=628ed052d3c3458d82d0904823fd1bce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:53.678142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f3a15-afb2-4ed5-86c1-8e6ea559c060 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:53.681659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 60/121] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:53 2022] GET /identity/v3/users/628ed052d3c3458d82d0904823fd1bce => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:53.681659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f3a15-afb2-4ed5-86c1-8e6ea559c060 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:53.709089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ed1d0-5b30-4169-905f-53604ec44a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:53.709752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed1d0-5b30-4169-905f-53604ec44a0d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:53.710039 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed1d0-5b30-4169-905f-53604ec44a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:53.710324 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed1d0-5b30-4169-905f-53604ec44a0d None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:53.711448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ed1d0-5b30-4169-905f-53604ec44a0d None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:53.712931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ed1d0-5b30-4169-905f-53604ec44a0d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:53.714604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 62/122] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:10:53 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:53.714604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ed1d0-5b30-4169-905f-53604ec44a0d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:53.791936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f3a15-afb2-4ed5-86c1-8e6ea559c060 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:53.808484 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:53.821904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ed1d0-5b30-4169-905f-53604ec44a0d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:53.825352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:53.830771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1dba2-f1b1-422e-a9f4-eb63d9bb8b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:53.831375 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1dba2-f1b1-422e-a9f4-eb63d9bb8b37 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:53.831765 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1dba2-f1b1-422e-a9f4-eb63d9bb8b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:53.832045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1dba2-f1b1-422e-a9f4-eb63d9bb8b37 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:53.832773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1dba2-f1b1-422e-a9f4-eb63d9bb8b37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:53.833082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1dba2-f1b1-422e-a9f4-eb63d9bb8b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:53.834488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1dba2-f1b1-422e-a9f4-eb63d9bb8b37 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:53.843003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 61/123] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:53.848322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1dba2-f1b1-422e-a9f4-eb63d9bb8b37 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:53.859166 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb843df-565f-4719-b21f-17c87aeb064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:53.860341 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb843df-565f-4719-b21f-17c87aeb064b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:53.860800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb843df-565f-4719-b21f-17c87aeb064b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:53.861535 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb843df-565f-4719-b21f-17c87aeb064b None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:53.863072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb843df-565f-4719-b21f-17c87aeb064b None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:53.865031 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb843df-565f-4719-b21f-17c87aeb064b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:53.871432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 63/124] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:10:53 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:53.871432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb843df-565f-4719-b21f-17c87aeb064b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:53.962694 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1dba2-f1b1-422e-a9f4-eb63d9bb8b37 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:53.970119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb843df-565f-4719-b21f-17c87aeb064b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:54.000740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfab79-50c9-4447-a76c-b9a2829ee915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:54.001410 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfab79-50c9-4447-a76c-b9a2829ee915 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:54.001697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfab79-50c9-4447-a76c-b9a2829ee915 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:54.001974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfab79-50c9-4447-a76c-b9a2829ee915 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:54.004597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def43201-e20d-4941-9d0e-34c56a2f2b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:54.005416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def43201-e20d-4941-9d0e-34c56a2f2b6f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:54.005839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def43201-e20d-4941-9d0e-34c56a2f2b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:54.006116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def43201-e20d-4941-9d0e-34c56a2f2b6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:54.012877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfab79-50c9-4447-a76c-b9a2829ee915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-76bfab79-50c9-4447-a76c-b9a2829ee915 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:54.018554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:54.019599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:54.020451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:54.020451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:54.020451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:54.020451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:54.020451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:54.020451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:54.020451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:54.020451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:54.020451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:54.020451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:54.020451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:10:54.020451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:10:54.020451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 62/125] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:10:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:54.025111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfab79-50c9-4447-a76c-b9a2829ee915 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:54.053662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:54.065749 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:54.079487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def43201-e20d-4941-9d0e-34c56a2f2b6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:54.080969 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def43201-e20d-4941-9d0e-34c56a2f2b6f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:54.141534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfab79-50c9-4447-a76c-b9a2829ee915 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:54.186674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 64/126] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:10:54.186846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91042634-9523-4438-a8dd-00840d56ded9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:54.186950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def43201-e20d-4941-9d0e-34c56a2f2b6f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:54.187030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91042634-9523-4438-a8dd-00840d56ded9 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:54.187030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91042634-9523-4438-a8dd-00840d56ded9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:54.187030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91042634-9523-4438-a8dd-00840d56ded9 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0/users/34120ea2deec47d6b705c0a9193dce4e/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:54.188865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91042634-9523-4438-a8dd-00840d56ded9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef2673a95ec34eb9a8e8191d5e0551e0, user_id=34120ea2deec47d6b705c0a9193dce4e, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:54.190336 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91042634-9523-4438-a8dd-00840d56ded9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:54.252292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:54.280404 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def43201-e20d-4941-9d0e-34c56a2f2b6f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:54.293296 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 63/127] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:10:54 2022] PUT /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0/users/34120ea2deec47d6b705c0a9193dce4e/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:10:54.293296 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91042634-9523-4438-a8dd-00840d56ded9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:54.326863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874cac0-7766-4124-81b8-bfec63fe1b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:54.327537 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874cac0-7766-4124-81b8-bfec63fe1b69 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:54.327885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874cac0-7766-4124-81b8-bfec63fe1b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:54.328299 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874cac0-7766-4124-81b8-bfec63fe1b69 None admin] PATH_INFO: `/v3/users/809e7dc455e844f6967aa616532e4eb7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:54.329701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874cac0-7766-4124-81b8-bfec63fe1b69 None admin] RBAC: Authorizing `identity:get_user(user_id=809e7dc455e844f6967aa616532e4eb7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:54.331275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874cac0-7766-4124-81b8-bfec63fe1b69 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:54.333223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 65/128] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:54 2022] GET /identity/v3/users/809e7dc455e844f6967aa616532e4eb7 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:54.334169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874cac0-7766-4124-81b8-bfec63fe1b69 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:54.411555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:54.418611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91042634-9523-4438-a8dd-00840d56ded9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:54.454666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874cac0-7766-4124-81b8-bfec63fe1b69 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:54.469338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11b644-670b-433a-833d-13d513b43726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:54.470795 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11b644-670b-433a-833d-13d513b43726 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:54.471416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11b644-670b-433a-833d-13d513b43726 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:54.471844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11b644-670b-433a-833d-13d513b43726 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0/users/34120ea2deec47d6b705c0a9193dce4e/roles/e577106295c544bfbe1944b178cb95e5` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:54.474432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11b644-670b-433a-833d-13d513b43726 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef2673a95ec34eb9a8e8191d5e0551e0, user_id=34120ea2deec47d6b705c0a9193dce4e, role_id=e577106295c544bfbe1944b178cb95e5)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:54.476097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11b644-670b-433a-833d-13d513b43726 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:54.501093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f50c9d-91ca-4f4b-b4c8-5dbcd73291c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:54.501897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f50c9d-91ca-4f4b-b4c8-5dbcd73291c6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:54.502277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f50c9d-91ca-4f4b-b4c8-5dbcd73291c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:54.502553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f50c9d-91ca-4f4b-b4c8-5dbcd73291c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:54.503327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f50c9d-91ca-4f4b-b4c8-5dbcd73291c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:54.503679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f50c9d-91ca-4f4b-b4c8-5dbcd73291c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:54.505211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f50c9d-91ca-4f4b-b4c8-5dbcd73291c6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:54.514908 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 66/129] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:10:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:54.515720 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f50c9d-91ca-4f4b-b4c8-5dbcd73291c6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:54.520082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:54.555843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 64/130] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:10:54 2022] PUT /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0/users/34120ea2deec47d6b705c0a9193dce4e/roles/e577106295c544bfbe1944b178cb95e5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:10:54.557154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11b644-670b-433a-833d-13d513b43726 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:54.647518 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f50c9d-91ca-4f4b-b4c8-5dbcd73291c6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:54.725311 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf7f37-122b-48f4-9afd-133f1a6790c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:54.726219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf7f37-122b-48f4-9afd-133f1a6790c7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:54.726495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf7f37-122b-48f4-9afd-133f1a6790c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:54.726762 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf7f37-122b-48f4-9afd-133f1a6790c7 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:54.729140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf7f37-122b-48f4-9afd-133f1a6790c7 None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:54.731912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf7f37-122b-48f4-9afd-133f1a6790c7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:54.733744 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 67/131] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:10:54 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:54.736317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf7f37-122b-48f4-9afd-133f1a6790c7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:54.765878 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11b644-670b-433a-833d-13d513b43726 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:54.812091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422db54-2f62-4654-8b1b-7976bed82bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:54.812733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422db54-2f62-4654-8b1b-7976bed82bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:54.813008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422db54-2f62-4654-8b1b-7976bed82bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:54.813305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422db54-2f62-4654-8b1b-7976bed82bc2 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:54.814455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422db54-2f62-4654-8b1b-7976bed82bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:54.815900 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422db54-2f62-4654-8b1b-7976bed82bc2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:54.817872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 65/132] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:10:54 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:54.818643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422db54-2f62-4654-8b1b-7976bed82bc2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:54.825821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:54.846606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:54.872270 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf7f37-122b-48f4-9afd-133f1a6790c7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:54.917607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1deab5-9af4-436f-86c6-555ff8310149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:54.918489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1deab5-9af4-436f-86c6-555ff8310149 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:54.919487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1deab5-9af4-436f-86c6-555ff8310149 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:54.919941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1deab5-9af4-436f-86c6-555ff8310149 None admin] PATH_INFO: `/v3/users/34120ea2deec47d6b705c0a9193dce4e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:54.921812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1deab5-9af4-436f-86c6-555ff8310149 None admin] RBAC: Authorizing `identity:get_user(user_id=34120ea2deec47d6b705c0a9193dce4e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:54.924373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1deab5-9af4-436f-86c6-555ff8310149 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:54.931824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 68/133] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:54 2022] GET /identity/v3/users/34120ea2deec47d6b705c0a9193dce4e => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:54.931824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1deab5-9af4-436f-86c6-555ff8310149 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:54.942899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422db54-2f62-4654-8b1b-7976bed82bc2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:54.993605 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe57b3-6045-497c-b731-db6ae5a50b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:54.995256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe57b3-6045-497c-b731-db6ae5a50b34 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:54.995745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe57b3-6045-497c-b731-db6ae5a50b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:54.996519 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe57b3-6045-497c-b731-db6ae5a50b34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:54.997827 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe57b3-6045-497c-b731-db6ae5a50b34 None admin] RBAC: Adding query filter params (role.id=c924ec18040e4cc4b55053391fd47e8a, scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0, user.id=628ed052d3c3458d82d0904823fd1bce) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:54.999319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe57b3-6045-497c-b731-db6ae5a50b34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:55.001584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe57b3-6045-497c-b731-db6ae5a50b34 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:55.009866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 66/134] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:10:54 2022] GET /identity/v3/role_assignments?user.id=628ed052d3c3458d82d0904823fd1bce&scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0&role.id=c924ec18040e4cc4b55053391fd47e8a => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:55.011941 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe57b3-6045-497c-b731-db6ae5a50b34 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:55.044728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1deab5-9af4-436f-86c6-555ff8310149 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:55.083154 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff27ca6-6172-4071-a1e2-3a7c25127c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:55.083876 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff27ca6-6172-4071-a1e2-3a7c25127c16 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:55.084225 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff27ca6-6172-4071-a1e2-3a7c25127c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:55.084549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff27ca6-6172-4071-a1e2-3a7c25127c16 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0/users/809e7dc455e844f6967aa616532e4eb7/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:55.086723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff27ca6-6172-4071-a1e2-3a7c25127c16 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef2673a95ec34eb9a8e8191d5e0551e0, user_id=809e7dc455e844f6967aa616532e4eb7, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:55.087977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff27ca6-6172-4071-a1e2-3a7c25127c16 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:55.133238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:55.148173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe57b3-6045-497c-b731-db6ae5a50b34 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:55.177329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:55.182892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 69/135] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:10:54 2022] PUT /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0/users/809e7dc455e844f6967aa616532e4eb7/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:10:55.184404 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbad802-ff87-46df-9859-4d050a9390d6 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:55.184692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbad802-ff87-46df-9859-4d050a9390d6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:55.184966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbad802-ff87-46df-9859-4d050a9390d6 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:55.187215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 70/136] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:55.193065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff33ed-d26c-4b7e-8c7d-3aa25c9a51a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:55.193764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff33ed-d26c-4b7e-8c7d-3aa25c9a51a2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:55.193982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690a66c-1f24-46f8-a674-036890075757 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:55.194100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff33ed-d26c-4b7e-8c7d-3aa25c9a51a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:55.194274 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690a66c-1f24-46f8-a674-036890075757 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:55.199103 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff33ed-d26c-4b7e-8c7d-3aa25c9a51a2 None admin] PATH_INFO: `/v3/projects/091454ece8864cc3928010772c7e4054` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:55.199234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690a66c-1f24-46f8-a674-036890075757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:55.199306 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff33ed-d26c-4b7e-8c7d-3aa25c9a51a2 None admin] RBAC: Authorizing `identity:get_project(project_id=091454ece8864cc3928010772c7e4054)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:55.199306 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff33ed-d26c-4b7e-8c7d-3aa25c9a51a2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:55.199422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 67/137] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:10:55 2022] GET /identity/v3/projects/091454ece8864cc3928010772c7e4054 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:55.209953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff33ed-d26c-4b7e-8c7d-3aa25c9a51a2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:55.224182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8690a66c-1f24-46f8-a674-036890075757 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:55.225519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8690a66c-1f24-46f8-a674-036890075757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:55.415248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 71/138] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 13 03:10:55.453887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff33ed-d26c-4b7e-8c7d-3aa25c9a51a2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:55.514413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b424ede-22c6-4654-b80e-65e32b33fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:55.515094 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b424ede-22c6-4654-b80e-65e32b33fd32 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:55.515373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b424ede-22c6-4654-b80e-65e32b33fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:55.515646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b424ede-22c6-4654-b80e-65e32b33fd32 None admin] PATH_INFO: `/v3/projects/091454ece8864cc3928010772c7e4054/users/34120ea2deec47d6b705c0a9193dce4e/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:55.522564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b424ede-22c6-4654-b80e-65e32b33fd32 None admin] RBAC: Authorizing `identity:create_grant(project_id=091454ece8864cc3928010772c7e4054, user_id=34120ea2deec47d6b705c0a9193dce4e, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:55.524045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b424ede-22c6-4654-b80e-65e32b33fd32 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:55.617615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 68/139] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:10:55 2022] PUT /identity/v3/projects/091454ece8864cc3928010772c7e4054/users/34120ea2deec47d6b705c0a9193dce4e/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:10:55.882181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690a66c-1f24-46f8-a674-036890075757 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:55.992072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690a66c-1f24-46f8-a674-036890075757 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:56.021851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:56.032988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b07f0d-cdc6-4d7f-af99-79a8e35af13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:56.033661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b07f0d-cdc6-4d7f-af99-79a8e35af13c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:56.033941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b07f0d-cdc6-4d7f-af99-79a8e35af13c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:56.034217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b07f0d-cdc6-4d7f-af99-79a8e35af13c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:56.035350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b07f0d-cdc6-4d7f-af99-79a8e35af13c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:56.036889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b07f0d-cdc6-4d7f-af99-79a8e35af13c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:56.038788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 72/140] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:10:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:56.044247 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b424ede-22c6-4654-b80e-65e32b33fd32 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:56.079032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:56.206140 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b424ede-22c6-4654-b80e-65e32b33fd32 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:56.247480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31753f66-2a55-4fa3-a335-f267849a5c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:56.248099 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31753f66-2a55-4fa3-a335-f267849a5c83 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:56.248417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31753f66-2a55-4fa3-a335-f267849a5c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:56.248752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31753f66-2a55-4fa3-a335-f267849a5c83 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:56.249451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31753f66-2a55-4fa3-a335-f267849a5c83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:56.250924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31753f66-2a55-4fa3-a335-f267849a5c83 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:56.359834 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 69/141] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:10:56 2022] POST /identity/v3/users => generated 283 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:10:57.500656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926461c-5f1c-4565-88f6-8829ad757886 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:57.501736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926461c-5f1c-4565-88f6-8829ad757886 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:57.502237 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926461c-5f1c-4565-88f6-8829ad757886 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:57.504191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 73/142] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:57.509677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33d76-d9b7-4fea-854e-e63325419259 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:57.510583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33d76-d9b7-4fea-854e-e63325419259 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:57.511072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33d76-d9b7-4fea-854e-e63325419259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:57.537684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cac33d76-d9b7-4fea-854e-e63325419259 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:57.539286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cac33d76-d9b7-4fea-854e-e63325419259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:57.622131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853297a0-b7b9-4d0f-81b5-ba0faad823e6 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:57.622734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853297a0-b7b9-4d0f-81b5-ba0faad823e6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:57.623793 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853297a0-b7b9-4d0f-81b5-ba0faad823e6 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:57.625353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 74/143] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:10:57.626324 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 70/144] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:57.630643 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f03af1-7479-477a-9f37-951ce32467fe None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:57.631173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f03af1-7479-477a-9f37-951ce32467fe None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:57.631631 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f03af1-7479-477a-9f37-951ce32467fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:57.654946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-48f03af1-7479-477a-9f37-951ce32467fe None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:57.656515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-48f03af1-7479-477a-9f37-951ce32467fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:57.734929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 75/145] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:10:58.026725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff0e6c-44dd-4abe-b0fe-afb7ff9b1663 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:58.027394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff0e6c-44dd-4abe-b0fe-afb7ff9b1663 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:58.027887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff0e6c-44dd-4abe-b0fe-afb7ff9b1663 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:58.030002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 71/146] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:58.035500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd2460-0e31-4a23-858f-d807b701056c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:58.036023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd2460-0e31-4a23-858f-d807b701056c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:58.036487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd2460-0e31-4a23-858f-d807b701056c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:58.070268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-43cd2460-0e31-4a23-858f-d807b701056c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:58.071796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-43cd2460-0e31-4a23-858f-d807b701056c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:58.112192 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff0e6c-44dd-4abe-b0fe-afb7ff9b1663 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:58.115761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:58.182976 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 76/147] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:10:58.209743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd2460-0e31-4a23-858f-d807b701056c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:58.293523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:58.362522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd2460-0e31-4a23-858f-d807b701056c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:58.381691 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff0e6c-44dd-4abe-b0fe-afb7ff9b1663 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:58.439658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed647af-da32-42e5-ab8f-9d80904d0963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:58.440307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed647af-da32-42e5-ab8f-9d80904d0963 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:58.440585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed647af-da32-42e5-ab8f-9d80904d0963 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:58.440857 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed647af-da32-42e5-ab8f-9d80904d0963 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:58.460544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb1397-4904-4711-ab5b-53d1b66f74ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:58.461187 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb1397-4904-4711-ab5b-53d1b66f74ba None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:58.461496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb1397-4904-4711-ab5b-53d1b66f74ba None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:58.461771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb1397-4904-4711-ab5b-53d1b66f74ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:58.463246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed647af-da32-42e5-ab8f-9d80904d0963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4ed647af-da32-42e5-ab8f-9d80904d0963 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:58.477043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:58.477972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:58.478724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:58.478724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:58.478724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:58.478724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:58.478724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:58.478724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:58.478724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:58.478724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:58.478724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:58.478724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:58.478724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:10:58.478724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:10:58.478724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 77/148] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:10:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:58.480122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bedd3-3f86-4e80-831f-dff7592bb607 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:58.480122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bedd3-3f86-4e80-831f-dff7592bb607 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:58.480487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bedd3-3f86-4e80-831f-dff7592bb607 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:58.481800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 78/149] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:58.489869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb1397-4904-4711-ab5b-53d1b66f74ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b7fb1397-4904-4711-ab5b-53d1b66f74ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:58.494742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:58.495552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:58.497775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:58.497775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:58.497775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:58.497775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:58.497775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:58.497775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:58.497775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:58.497775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:58.497775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:58.497775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:58.497775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:10:58.497775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:10:58.497775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 72/150] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:10:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:58.499381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bedd3-3f86-4e80-831f-dff7592bb607 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:58.501668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16d138-ac44-4ade-905f-0ba8a8120c66 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:58.501958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16d138-ac44-4ade-905f-0ba8a8120c66 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:58.502235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16d138-ac44-4ade-905f-0ba8a8120c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:58.540939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1e16d138-ac44-4ade-905f-0ba8a8120c66 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:58.542173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1e16d138-ac44-4ade-905f-0ba8a8120c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:58.615200 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:58.627320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 73/151] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:58.628186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16d138-ac44-4ade-905f-0ba8a8120c66 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:58.712815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bedd3-3f86-4e80-831f-dff7592bb607 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:58.736540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:58.754849 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16d138-ac44-4ade-905f-0ba8a8120c66 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:58.791341 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd02ef6-691d-47e1-868b-b58c1e634fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:58.791541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521f5f6-7b7e-413b-b218-c33eecbec443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:58.791968 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd02ef6-691d-47e1-868b-b58c1e634fff None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:58.792139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521f5f6-7b7e-413b-b218-c33eecbec443 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:58.792229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd02ef6-691d-47e1-868b-b58c1e634fff None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:58.792371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521f5f6-7b7e-413b-b218-c33eecbec443 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:58.792517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd02ef6-691d-47e1-868b-b58c1e634fff None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:58.792615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521f5f6-7b7e-413b-b218-c33eecbec443 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:58.793162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd02ef6-691d-47e1-868b-b58c1e634fff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:58.793286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521f5f6-7b7e-413b-b218-c33eecbec443 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:58.793485 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd02ef6-691d-47e1-868b-b58c1e634fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:58.793580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521f5f6-7b7e-413b-b218-c33eecbec443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:58.794876 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd02ef6-691d-47e1-868b-b58c1e634fff None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:58.795015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521f5f6-7b7e-413b-b218-c33eecbec443 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:58.804781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 74/152] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:10:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:58.805441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521f5f6-7b7e-413b-b218-c33eecbec443 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:58.820899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 79/153] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:10:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:58.821799 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd02ef6-691d-47e1-868b-b58c1e634fff None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:58.867709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:58.915498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521f5f6-7b7e-413b-b218-c33eecbec443 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:58.960457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32680ee9-79be-41ea-a8d1-8e89e3968c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:58.961433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680ee9-79be-41ea-a8d1-8e89e3968c4e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:58.961853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680ee9-79be-41ea-a8d1-8e89e3968c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:58.962287 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680ee9-79be-41ea-a8d1-8e89e3968c4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:58.982275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32680ee9-79be-41ea-a8d1-8e89e3968c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-32680ee9-79be-41ea-a8d1-8e89e3968c4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:58.988615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:58.989861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:58.990892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:58.990892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:58.990892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:58.990892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:58.990892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:58.990892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:58.990892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:58.990892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:58.990892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:58.990892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:58.990892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:10:58.990892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:10:58.997673 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 75/154] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:58.999307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32680ee9-79be-41ea-a8d1-8e89e3968c4e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:59.046319 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd02ef6-691d-47e1-868b-b58c1e634fff None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:59.109572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32680ee9-79be-41ea-a8d1-8e89e3968c4e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:59.111796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cfc6e-5658-420f-9234-c17b2faa4047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:59.112847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cfc6e-5658-420f-9234-c17b2faa4047 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:59.112847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cfc6e-5658-420f-9234-c17b2faa4047 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:59.113050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cfc6e-5658-420f-9234-c17b2faa4047 None admin] PATH_INFO: `/v3/users/34120ea2deec47d6b705c0a9193dce4e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:59.114284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cfc6e-5658-420f-9234-c17b2faa4047 None admin] RBAC: Authorizing `identity:get_user(user_id=34120ea2deec47d6b705c0a9193dce4e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:59.115746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cfc6e-5658-420f-9234-c17b2faa4047 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:59.117638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 80/155] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:58 2022] GET /identity/v3/users/34120ea2deec47d6b705c0a9193dce4e => generated 275 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:59.119226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb5eca-b4dc-4c49-8eac-57af05cfde4b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:59.119226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb5eca-b4dc-4c49-8eac-57af05cfde4b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:59.119430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb5eca-b4dc-4c49-8eac-57af05cfde4b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:59.120582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 81/156] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:10:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:10:59.121334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb5eca-b4dc-4c49-8eac-57af05cfde4b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:59.130018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:59.157907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423a031-8c1a-451e-ac99-2820724e2720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:59.158809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423a031-8c1a-451e-ac99-2820724e2720 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:59.159261 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423a031-8c1a-451e-ac99-2820724e2720 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:59.159668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423a031-8c1a-451e-ac99-2820724e2720 None admin] PATH_INFO: `/v3/users/34120ea2deec47d6b705c0a9193dce4e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:59.161132 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423a031-8c1a-451e-ac99-2820724e2720 None admin] RBAC: Authorizing `identity:get_user(user_id=34120ea2deec47d6b705c0a9193dce4e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:59.162813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423a031-8c1a-451e-ac99-2820724e2720 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:59.164639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 76/157] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:58 2022] GET /identity/v3/users/34120ea2deec47d6b705c0a9193dce4e => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:59.165560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423a031-8c1a-451e-ac99-2820724e2720 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:59.217661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:59.280311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423a031-8c1a-451e-ac99-2820724e2720 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:59.318317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5191498-076f-4654-9a84-2548af1d7391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:59.319190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5191498-076f-4654-9a84-2548af1d7391 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:59.319611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5191498-076f-4654-9a84-2548af1d7391 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:59.320070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5191498-076f-4654-9a84-2548af1d7391 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:59.321941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb5eca-b4dc-4c49-8eac-57af05cfde4b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:59.373712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:59.385766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd32222-af97-4c3f-8225-e2cbaa7e7b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:59.390785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd32222-af97-4c3f-8225-e2cbaa7e7b25 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:59.390785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd32222-af97-4c3f-8225-e2cbaa7e7b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:59.390785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd32222-af97-4c3f-8225-e2cbaa7e7b25 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:59.390785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd32222-af97-4c3f-8225-e2cbaa7e7b25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:10:59.390785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd32222-af97-4c3f-8225-e2cbaa7e7b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:59.390785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd32222-af97-4c3f-8225-e2cbaa7e7b25 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:59.394733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5191498-076f-4654-9a84-2548af1d7391 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:59.396361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5191498-076f-4654-9a84-2548af1d7391 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:59.399715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 82/158] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:10:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:10:59.400858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497763ff-f47e-4368-975a-1af18a147148 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:59.401196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497763ff-f47e-4368-975a-1af18a147148 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:59.401497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497763ff-f47e-4368-975a-1af18a147148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:59.445454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-497763ff-f47e-4368-975a-1af18a147148 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:10:59.446712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-497763ff-f47e-4368-975a-1af18a147148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:10:59.504564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 77/159] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:10:59.505662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5191498-076f-4654-9a84-2548af1d7391 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:59.605670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:59.609478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 83/160] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:10:59.610320 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497763ff-f47e-4368-975a-1af18a147148 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:10:59.617820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5191498-076f-4654-9a84-2548af1d7391 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:59.666076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425a4c5-860f-4b93-9964-af6ee16987b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:59.667144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a4c5-860f-4b93-9964-af6ee16987b6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:59.667602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a4c5-860f-4b93-9964-af6ee16987b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:59.671344 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a4c5-860f-4b93-9964-af6ee16987b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:59.679981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:10:59.787458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497763ff-f47e-4368-975a-1af18a147148 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:10:59.811291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425a4c5-860f-4b93-9964-af6ee16987b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:10:59.813055 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425a4c5-860f-4b93-9964-af6ee16987b6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:10:59.845969 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c4fe6-5676-43a5-a950-727b13868c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:10:59.847083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c4fe6-5676-43a5-a950-727b13868c87 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:10:59.847486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c4fe6-5676-43a5-a950-727b13868c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:10:59.847864 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c4fe6-5676-43a5-a950-727b13868c87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:10:59.866908 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c4fe6-5676-43a5-a950-727b13868c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-955c4fe6-5676-43a5-a950-727b13868c87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:10:59.872568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:10:59.873522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:10:59.874295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:10:59.874295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:10:59.874295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:10:59.874295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:10:59.874295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:10:59.874295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:10:59.874295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:10:59.874295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:10:59.874295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:10:59.874295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:10:59.874295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:10:59.874295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:10:59.879236 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 84/161] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:10:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:10:59.880073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c4fe6-5676-43a5-a950-727b13868c87 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:00.022568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:00.028346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c4fe6-5676-43a5-a950-727b13868c87 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:00.049646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:00.063459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00161133-5496-4731-9cc7-2ec76d4def43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:00.064090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161133-5496-4731-9cc7-2ec76d4def43 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:00.064360 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161133-5496-4731-9cc7-2ec76d4def43 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:00.064626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161133-5496-4731-9cc7-2ec76d4def43 None admin] PATH_INFO: `/v3/users/809e7dc455e844f6967aa616532e4eb7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:00.065845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00161133-5496-4731-9cc7-2ec76d4def43 None admin] RBAC: Authorizing `identity:get_user(user_id=809e7dc455e844f6967aa616532e4eb7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:00.067296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00161133-5496-4731-9cc7-2ec76d4def43 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:00.069113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 85/162] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:10:59 2022] GET /identity/v3/users/809e7dc455e844f6967aa616532e4eb7 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:00.069690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00161133-5496-4731-9cc7-2ec76d4def43 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:00.087042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 78/163] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:00.087911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425a4c5-860f-4b93-9964-af6ee16987b6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:00.180684 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00161133-5496-4731-9cc7-2ec76d4def43 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:00.215870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3e1e2-ea00-499f-966a-9cd4d2ab3e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:00.216501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3e1e2-ea00-499f-966a-9cd4d2ab3e20 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:00.216805 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3e1e2-ea00-499f-966a-9cd4d2ab3e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:00.217078 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3e1e2-ea00-499f-966a-9cd4d2ab3e20 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:00.218343 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3e1e2-ea00-499f-966a-9cd4d2ab3e20 None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:00.219899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3e1e2-ea00-499f-966a-9cd4d2ab3e20 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:00.221708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 86/164] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:00 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:00.222301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3e1e2-ea00-499f-966a-9cd4d2ab3e20 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:00.261780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:00.324261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3e1e2-ea00-499f-966a-9cd4d2ab3e20 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:00.343420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425a4c5-860f-4b93-9964-af6ee16987b6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:00.361291 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39326bd8-43ed-434e-a477-77b22d3120c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:00.361291 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39326bd8-43ed-434e-a477-77b22d3120c2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:00.361291 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39326bd8-43ed-434e-a477-77b22d3120c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:00.361291 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39326bd8-43ed-434e-a477-77b22d3120c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:00.371594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39326bd8-43ed-434e-a477-77b22d3120c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-39326bd8-43ed-434e-a477-77b22d3120c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:00.376949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:00.377881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:00.378657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:00.378657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:00.378657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:00.378657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:00.378657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:00.378657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:00.378657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:00.378657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:00.378657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:00.378657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:00.378657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:00.378657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:00.378657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 87/165] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:00.379298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39326bd8-43ed-434e-a477-77b22d3120c2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:00.409940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a286452-cf7b-4dbc-8a9c-328e360fda51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:00.411133 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a286452-cf7b-4dbc-8a9c-328e360fda51 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:00.411800 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a286452-cf7b-4dbc-8a9c-328e360fda51 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:00.412618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a286452-cf7b-4dbc-8a9c-328e360fda51 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:00.413789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a286452-cf7b-4dbc-8a9c-328e360fda51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:00.414295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a286452-cf7b-4dbc-8a9c-328e360fda51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:00.416856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a286452-cf7b-4dbc-8a9c-328e360fda51 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:00.427516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 79/166] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:00.428168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a286452-cf7b-4dbc-8a9c-328e360fda51 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:00.493767 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39326bd8-43ed-434e-a477-77b22d3120c2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:00.507409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:00.513981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:00.539089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8d650-67e7-47d6-bcb6-240dfb1bec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:00.540050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8d650-67e7-47d6-bcb6-240dfb1bec0f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:00.541249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8d650-67e7-47d6-bcb6-240dfb1bec0f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:00.541744 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8d650-67e7-47d6-bcb6-240dfb1bec0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:00.635449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a286452-cf7b-4dbc-8a9c-328e360fda51 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:00.640331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8d650-67e7-47d6-bcb6-240dfb1bec0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:00.642807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8d650-67e7-47d6-bcb6-240dfb1bec0f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:00.748080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 88/167] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:00.748702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:00.750252 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8d650-67e7-47d6-bcb6-240dfb1bec0f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:00.790677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a5aaa-9374-4a76-a5fd-048cbb737aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:00.791343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a5aaa-9374-4a76-a5fd-048cbb737aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:00.791622 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a5aaa-9374-4a76-a5fd-048cbb737aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:00.791889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a5aaa-9374-4a76-a5fd-048cbb737aa2 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:00.798423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a5aaa-9374-4a76-a5fd-048cbb737aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:00.799662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a5aaa-9374-4a76-a5fd-048cbb737aa2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:00.801681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 80/168] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:00 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:00.802290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a5aaa-9374-4a76-a5fd-048cbb737aa2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:00.880442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8d650-67e7-47d6-bcb6-240dfb1bec0f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:00.954498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e40f7-a1dd-4630-9ec0-ba1568434ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:00.955034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e40f7-a1dd-4630-9ec0-ba1568434ded None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:00.955314 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e40f7-a1dd-4630-9ec0-ba1568434ded None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:00.955580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e40f7-a1dd-4630-9ec0-ba1568434ded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:00.956300 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e40f7-a1dd-4630-9ec0-ba1568434ded None admin] RBAC: Adding query filter params (role.id=367ec0d2bcdc49f09b0772bbd737e5ce, scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0, user.id=34120ea2deec47d6b705c0a9193dce4e) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:00.956602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e40f7-a1dd-4630-9ec0-ba1568434ded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:00.958056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e40f7-a1dd-4630-9ec0-ba1568434ded None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:00.964132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 89/169] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:00 2022] GET /identity/v3/role_assignments?user.id=34120ea2deec47d6b705c0a9193dce4e&scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0&role.id=367ec0d2bcdc49f09b0772bbd737e5ce => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:00.964741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e40f7-a1dd-4630-9ec0-ba1568434ded None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:01.002262 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a5aaa-9374-4a76-a5fd-048cbb737aa2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:01.021831 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:01.037106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:01.053679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a7160-a1e0-4cd6-9238-3e563fb83182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:01.055730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a7160-a1e0-4cd6-9238-3e563fb83182 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.056316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a7160-a1e0-4cd6-9238-3e563fb83182 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.056765 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a7160-a1e0-4cd6-9238-3e563fb83182 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.057724 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a7160-a1e0-4cd6-9238-3e563fb83182 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:01.058236 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a7160-a1e0-4cd6-9238-3e563fb83182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:01.059878 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a7160-a1e0-4cd6-9238-3e563fb83182 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:01.074877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 81/170] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:01.076062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a7160-a1e0-4cd6-9238-3e563fb83182 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:01.096091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e40f7-a1dd-4630-9ec0-ba1568434ded None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:01.134336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af54370-68c1-408f-9de9-819825de94ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:01.135349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af54370-68c1-408f-9de9-819825de94ff None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.135872 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af54370-68c1-408f-9de9-819825de94ff None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.136346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af54370-68c1-408f-9de9-819825de94ff None admin] PATH_INFO: `/v3/users/628ed052d3c3458d82d0904823fd1bce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.137863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af54370-68c1-408f-9de9-819825de94ff None admin] RBAC: Authorizing `identity:get_user(user_id=628ed052d3c3458d82d0904823fd1bce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:01.139923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af54370-68c1-408f-9de9-819825de94ff None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:01.141882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 90/171] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:00 2022] GET /identity/v3/users/628ed052d3c3458d82d0904823fd1bce => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:01.144068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af54370-68c1-408f-9de9-819825de94ff None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:01.208419 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a7160-a1e0-4cd6-9238-3e563fb83182 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:01.246063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8fbf7-b200-406a-b2c4-a02b45fd7d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:01.246988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8fbf7-b200-406a-b2c4-a02b45fd7d10 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.247272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8fbf7-b200-406a-b2c4-a02b45fd7d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.247549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8fbf7-b200-406a-b2c4-a02b45fd7d10 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.248686 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8fbf7-b200-406a-b2c4-a02b45fd7d10 None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:01.250335 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8fbf7-b200-406a-b2c4-a02b45fd7d10 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:01.252417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 82/172] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:01 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:01.253996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b772c3-e95a-4a1a-8e59-36147772d39b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.254286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b772c3-e95a-4a1a-8e59-36147772d39b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.254660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b772c3-e95a-4a1a-8e59-36147772d39b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.257418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 83/173] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:01.257418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543e63c-b849-416c-9275-6e0d2ceaa026 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.257418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543e63c-b849-416c-9275-6e0d2ceaa026 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.257676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543e63c-b849-416c-9275-6e0d2ceaa026 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.263421 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 84/174] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:01.263421 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543e63c-b849-416c-9275-6e0d2ceaa026 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:01.264159 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af54370-68c1-408f-9de9-819825de94ff None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:01.286830 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:01.295543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d72da-fb90-4943-9966-d59c2b723959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:01.296148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d72da-fb90-4943-9966-d59c2b723959 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.296430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d72da-fb90-4943-9966-d59c2b723959 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.296700 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d72da-fb90-4943-9966-d59c2b723959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.297450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d72da-fb90-4943-9966-d59c2b723959 None admin] RBAC: Adding query filter params (role.id=e577106295c544bfbe1944b178cb95e5, scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0, user.id=34120ea2deec47d6b705c0a9193dce4e) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:01.297840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d72da-fb90-4943-9966-d59c2b723959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:01.299337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d72da-fb90-4943-9966-d59c2b723959 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:01.305052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 91/175] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:01 2022] GET /identity/v3/role_assignments?user.id=34120ea2deec47d6b705c0a9193dce4e&scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0&role.id=e577106295c544bfbe1944b178cb95e5 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:01.305856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d72da-fb90-4943-9966-d59c2b723959 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:01.317956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:01.386739 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543e63c-b849-416c-9275-6e0d2ceaa026 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:01.422909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d72da-fb90-4943-9966-d59c2b723959 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:01.423124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395ee16-153f-41e6-9219-f99ca1d7b3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:01.423565 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395ee16-153f-41e6-9219-f99ca1d7b3dd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.423844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395ee16-153f-41e6-9219-f99ca1d7b3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.424118 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395ee16-153f-41e6-9219-f99ca1d7b3dd None admin] PATH_INFO: `/v3/users/34120ea2deec47d6b705c0a9193dce4e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.425330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395ee16-153f-41e6-9219-f99ca1d7b3dd None admin] RBAC: Authorizing `identity:get_user(user_id=34120ea2deec47d6b705c0a9193dce4e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:01.426796 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395ee16-153f-41e6-9219-f99ca1d7b3dd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:01.428611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 85/176] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:01 2022] GET /identity/v3/users/34120ea2deec47d6b705c0a9193dce4e => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:01.429856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac358a2-ba5f-4bde-b6f7-e925d3887a18 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.430138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac358a2-ba5f-4bde-b6f7-e925d3887a18 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.430407 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac358a2-ba5f-4bde-b6f7-e925d3887a18 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.432089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 86/177] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:01.432890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac358a2-ba5f-4bde-b6f7-e925d3887a18 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:01.468005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcfb6c-24d3-426f-97e2-50c52fb5f1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:01.468645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcfb6c-24d3-426f-97e2-50c52fb5f1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.468924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcfb6c-24d3-426f-97e2-50c52fb5f1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.469196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcfb6c-24d3-426f-97e2-50c52fb5f1a7 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.470364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcfb6c-24d3-426f-97e2-50c52fb5f1a7 None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:01.471853 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcfb6c-24d3-426f-97e2-50c52fb5f1a7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:01.473516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 92/178] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:01 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:01.479769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d8aa3-b96f-4f36-92b4-1d3ca63e5f45 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.480058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d8aa3-b96f-4f36-92b4-1d3ca63e5f45 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.480335 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d8aa3-b96f-4f36-92b4-1d3ca63e5f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.500296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-437d8aa3-b96f-4f36-92b4-1d3ca63e5f45 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:01.501892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-437d8aa3-b96f-4f36-92b4-1d3ca63e5f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:01.554106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac358a2-ba5f-4bde-b6f7-e925d3887a18 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:01.564648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:01.564899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:01.579182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 93/179] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:01.580415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbefd04-984d-4640-9a4b-333d0d3cd8c9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.580729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbefd04-984d-4640-9a4b-333d0d3cd8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.581004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbefd04-984d-4640-9a4b-333d0d3cd8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.592341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42763ead-39b6-4d48-8c49-585cba2d44fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:01.592948 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763ead-39b6-4d48-8c49-585cba2d44fd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.593225 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763ead-39b6-4d48-8c49-585cba2d44fd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.602169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42763ead-39b6-4d48-8c49-585cba2d44fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.602169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42763ead-39b6-4d48-8c49-585cba2d44fd None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0, user.id=809e7dc455e844f6967aa616532e4eb7) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:01.602169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42763ead-39b6-4d48-8c49-585cba2d44fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:01.602169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42763ead-39b6-4d48-8c49-585cba2d44fd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:01.602437 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cdbefd04-984d-4640-9a4b-333d0d3cd8c9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:01.602437 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cdbefd04-984d-4640-9a4b-333d0d3cd8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:01.602579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 87/180] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:01 2022] GET /identity/v3/role_assignments?user.id=809e7dc455e844f6967aa616532e4eb7&scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:01.603043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a50341-e78d-4a48-9996-107671053def None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.603308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a50341-e78d-4a48-9996-107671053def None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.603582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a50341-e78d-4a48-9996-107671053def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.629155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-93a50341-e78d-4a48-9996-107671053def None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:01.630769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-93a50341-e78d-4a48-9996-107671053def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:01.689317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 94/181] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:01.689317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbefd04-984d-4640-9a4b-333d0d3cd8c9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:01.745489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 88/182] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:01.746271 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a50341-e78d-4a48-9996-107671053def None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:01.798734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbefd04-984d-4640-9a4b-333d0d3cd8c9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:01.818212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:01.836676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64875fb-419c-4288-9059-fc503357fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:01.837337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64875fb-419c-4288-9059-fc503357fd6a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.837621 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64875fb-419c-4288-9059-fc503357fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.837895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64875fb-419c-4288-9059-fc503357fd6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.909862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a50341-e78d-4a48-9996-107671053def None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:01.912848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:01.916926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64875fb-419c-4288-9059-fc503357fd6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:01.918616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64875fb-419c-4288-9059-fc503357fd6a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:01.960559 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05feeeb2-8cc0-4bb4-ab7e-254f4a98eb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:01.961808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05feeeb2-8cc0-4bb4-ab7e-254f4a98eb2b None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:01.962303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05feeeb2-8cc0-4bb4-ab7e-254f4a98eb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:01.963653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05feeeb2-8cc0-4bb4-ab7e-254f4a98eb2b None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0/users/628ed052d3c3458d82d0904823fd1bce/roles/c924ec18040e4cc4b55053391fd47e8a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:01.965880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05feeeb2-8cc0-4bb4-ab7e-254f4a98eb2b None admin] RBAC: Authorizing `identity:create_grant(project_id=ef2673a95ec34eb9a8e8191d5e0551e0, user_id=628ed052d3c3458d82d0904823fd1bce, role_id=c924ec18040e4cc4b55053391fd47e8a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:01.968060 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05feeeb2-8cc0-4bb4-ab7e-254f4a98eb2b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:02.037866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 95/183] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:02.038523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64875fb-419c-4288-9059-fc503357fd6a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:02.051023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 89/184] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:11:01 2022] PUT /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0/users/628ed052d3c3458d82d0904823fd1bce/roles/c924ec18040e4cc4b55053391fd47e8a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:02.053095 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05feeeb2-8cc0-4bb4-ab7e-254f4a98eb2b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:02.065203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:02.176574 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64875fb-419c-4288-9059-fc503357fd6a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:02.202270 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05feeeb2-8cc0-4bb4-ab7e-254f4a98eb2b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:02.216253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4d07e-27fd-4c7b-b389-c7b22e26f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:02.216969 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4d07e-27fd-4c7b-b389-c7b22e26f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:02.217248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4d07e-27fd-4c7b-b389-c7b22e26f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:02.217571 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4d07e-27fd-4c7b-b389-c7b22e26f5b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:02.228694 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4d07e-27fd-4c7b-b389-c7b22e26f5b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-83d4d07e-27fd-4c7b-b389-c7b22e26f5b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:02.234222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:02.235107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:02.235957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:02.235957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:02.235957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:02.235957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:02.235957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:02.235957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:02.235957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:02.235957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:02.235957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:02.235957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:02.235957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:11:02.235957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:02.235957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 96/185] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:11:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:02.237183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4d07e-27fd-4c7b-b389-c7b22e26f5b1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:02.250227 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87abc9b-9a44-4951-bdc1-8455083e724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:02.250873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87abc9b-9a44-4951-bdc1-8455083e724c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:02.251150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87abc9b-9a44-4951-bdc1-8455083e724c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:02.251421 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87abc9b-9a44-4951-bdc1-8455083e724c None admin] PATH_INFO: `/v3/projects/091454ece8864cc3928010772c7e4054` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:02.252609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87abc9b-9a44-4951-bdc1-8455083e724c None admin] RBAC: Authorizing `identity:get_project(project_id=091454ece8864cc3928010772c7e4054)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:02.254298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87abc9b-9a44-4951-bdc1-8455083e724c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:02.256129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 90/186] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:02 2022] GET /identity/v3/projects/091454ece8864cc3928010772c7e4054 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:02.256699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87abc9b-9a44-4951-bdc1-8455083e724c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:02.290664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:02.325144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:02.347227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4d07e-27fd-4c7b-b389-c7b22e26f5b1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:02.368179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87abc9b-9a44-4951-bdc1-8455083e724c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:02.383632 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793736e-d27e-4047-b91d-2aaff514ecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:02.384344 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793736e-d27e-4047-b91d-2aaff514ecb0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:02.384628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793736e-d27e-4047-b91d-2aaff514ecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:02.384895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793736e-d27e-4047-b91d-2aaff514ecb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:02.386026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793736e-d27e-4047-b91d-2aaff514ecb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:02.387485 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793736e-d27e-4047-b91d-2aaff514ecb0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:02.389391 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 97/187] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:02.394450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793736e-d27e-4047-b91d-2aaff514ecb0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:02.405789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524da8c-93ca-4743-b9b2-4a5c3bf90355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:02.406425 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524da8c-93ca-4743-b9b2-4a5c3bf90355 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:02.406929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524da8c-93ca-4743-b9b2-4a5c3bf90355 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:02.406929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524da8c-93ca-4743-b9b2-4a5c3bf90355 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:02.417456 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524da8c-93ca-4743-b9b2-4a5c3bf90355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6524da8c-93ca-4743-b9b2-4a5c3bf90355 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:02.422814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:02.423787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:02.424570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:02.424570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:02.424570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:02.424570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:02.424570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:02.424570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:02.424570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:02.424570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:02.424570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:02.424570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:02.424570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:02.424570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:02.424570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 91/188] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:11:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:02.425966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524da8c-93ca-4743-b9b2-4a5c3bf90355 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:02.502035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793736e-d27e-4047-b91d-2aaff514ecb0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:02.523798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:02.533898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524da8c-93ca-4743-b9b2-4a5c3bf90355 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:02.535525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966a09-dd29-461d-8d81-34d25b1d6a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:02.536211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966a09-dd29-461d-8d81-34d25b1d6a9a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:02.536483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966a09-dd29-461d-8d81-34d25b1d6a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:02.536748 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966a09-dd29-461d-8d81-34d25b1d6a9a None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:02.537445 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4966a09-dd29-461d-8d81-34d25b1d6a9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:02.537743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4966a09-dd29-461d-8d81-34d25b1d6a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:02.539111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4966a09-dd29-461d-8d81-34d25b1d6a9a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:02.548141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 98/189] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:02.548634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966a09-dd29-461d-8d81-34d25b1d6a9a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:02.562276 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:02.577181 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb679d2-77ac-4d94-952e-d0323b44f2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:02.577868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb679d2-77ac-4d94-952e-d0323b44f2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:02.578086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb679d2-77ac-4d94-952e-d0323b44f2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:02.578355 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb679d2-77ac-4d94-952e-d0323b44f2e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:02.579072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb679d2-77ac-4d94-952e-d0323b44f2e5 None admin] RBAC: Adding query filter params (role.id=367ec0d2bcdc49f09b0772bbd737e5ce, scope.project.id=091454ece8864cc3928010772c7e4054, user.id=34120ea2deec47d6b705c0a9193dce4e) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:02.579377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb679d2-77ac-4d94-952e-d0323b44f2e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:02.580816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb679d2-77ac-4d94-952e-d0323b44f2e5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:02.587633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 92/190] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:02 2022] GET /identity/v3/role_assignments?user.id=34120ea2deec47d6b705c0a9193dce4e&scope.project.id=091454ece8864cc3928010772c7e4054&role.id=367ec0d2bcdc49f09b0772bbd737e5ce => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:02.588226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb679d2-77ac-4d94-952e-d0323b44f2e5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:02.691243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966a09-dd29-461d-8d81-34d25b1d6a9a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:02.722369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb679d2-77ac-4d94-952e-d0323b44f2e5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:02.744438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd920af9-22ab-4565-8855-d63bd7934f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:02.745476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd920af9-22ab-4565-8855-d63bd7934f23 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:02.745954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd920af9-22ab-4565-8855-d63bd7934f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:02.746462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd920af9-22ab-4565-8855-d63bd7934f23 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:02.748057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd920af9-22ab-4565-8855-d63bd7934f23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:02.750346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd920af9-22ab-4565-8855-d63bd7934f23 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:02.761934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfed16b-81f8-4dde-97ad-d5d02a1286bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:02.762529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed16b-81f8-4dde-97ad-d5d02a1286bf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:02.762806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed16b-81f8-4dde-97ad-d5d02a1286bf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:02.763075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfed16b-81f8-4dde-97ad-d5d02a1286bf None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:02.764280 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfed16b-81f8-4dde-97ad-d5d02a1286bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:02.764577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfed16b-81f8-4dde-97ad-d5d02a1286bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:02.767093 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfed16b-81f8-4dde-97ad-d5d02a1286bf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:02.776526 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 93/191] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:02.777403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfed16b-81f8-4dde-97ad-d5d02a1286bf None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:02.799978 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:02.857537 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 99/192] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:11:02 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:11:02.858447 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd920af9-22ab-4565-8855-d63bd7934f23 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:02.898637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfed16b-81f8-4dde-97ad-d5d02a1286bf None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:02.944463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcba97b-ff0a-4306-8699-ae1995b5ada6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:02.945756 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcba97b-ff0a-4306-8699-ae1995b5ada6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:02.946213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcba97b-ff0a-4306-8699-ae1995b5ada6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:02.946661 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcba97b-ff0a-4306-8699-ae1995b5ada6 None admin] PATH_INFO: `/v3/users/acf59726c26b4c1c8496481719833e30` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:02.958702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:02.966098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcba97b-ff0a-4306-8699-ae1995b5ada6 None admin] RBAC: Authorizing `identity:get_user(user_id=acf59726c26b4c1c8496481719833e30)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:02.968913 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcba97b-ff0a-4306-8699-ae1995b5ada6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:02.971534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 94/193] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:02 2022] GET /identity/v3/users/acf59726c26b4c1c8496481719833e30 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:02.977687 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcba97b-ff0a-4306-8699-ae1995b5ada6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:03.008255 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd920af9-22ab-4565-8855-d63bd7934f23 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:03.048566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e93ce7-d658-45b6-a40e-054b5941ced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:03.050138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e93ce7-d658-45b6-a40e-054b5941ced0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:03.050138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e93ce7-d658-45b6-a40e-054b5941ced0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:03.050138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e93ce7-d658-45b6-a40e-054b5941ced0 None admin] PATH_INFO: `/v3/users/acf59726c26b4c1c8496481719833e30` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:03.053011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e93ce7-d658-45b6-a40e-054b5941ced0 None admin] RBAC: Authorizing `identity:get_user(user_id=acf59726c26b4c1c8496481719833e30)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:03.053894 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e93ce7-d658-45b6-a40e-054b5941ced0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:03.055469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 100/194] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:02 2022] GET /identity/v3/users/acf59726c26b4c1c8496481719833e30 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:03.062074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e93ce7-d658-45b6-a40e-054b5941ced0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:03.080492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:03.110982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcba97b-ff0a-4306-8699-ae1995b5ada6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:03.162163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbdaee-64a9-4b41-b397-8b3fd4fcb9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:03.162801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbdaee-64a9-4b41-b397-8b3fd4fcb9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:03.163076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbdaee-64a9-4b41-b397-8b3fd4fcb9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:03.163310 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbdaee-64a9-4b41-b397-8b3fd4fcb9b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:03.200212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e93ce7-d658-45b6-a40e-054b5941ced0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:03.241678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbdaee-64a9-4b41-b397-8b3fd4fcb9b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:03.243163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbdaee-64a9-4b41-b397-8b3fd4fcb9b4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:03.246570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:03.253341 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024515d8-9155-4c80-b73e-6d2b6aba2397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:03.254198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024515d8-9155-4c80-b73e-6d2b6aba2397 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:03.254638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024515d8-9155-4c80-b73e-6d2b6aba2397 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:03.255053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024515d8-9155-4c80-b73e-6d2b6aba2397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:03.338494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:03.354321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024515d8-9155-4c80-b73e-6d2b6aba2397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:03.356409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024515d8-9155-4c80-b73e-6d2b6aba2397 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:03.363566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 95/195] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 03:11:03.369959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbdaee-64a9-4b41-b397-8b3fd4fcb9b4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:03.502486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 101/196] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 03:11:03.504400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbdaee-64a9-4b41-b397-8b3fd4fcb9b4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:03.508607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024515d8-9155-4c80-b73e-6d2b6aba2397 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:03.555262 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:03.570249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b119f7e-98b6-47db-915f-053cb19fb6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:03.572580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b119f7e-98b6-47db-915f-053cb19fb6fd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:03.572580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b119f7e-98b6-47db-915f-053cb19fb6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:03.572580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b119f7e-98b6-47db-915f-053cb19fb6fd None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:03.572580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b119f7e-98b6-47db-915f-053cb19fb6fd None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:03.577282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b119f7e-98b6-47db-915f-053cb19fb6fd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:03.580891 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 96/197] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:03 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:03.582141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b119f7e-98b6-47db-915f-053cb19fb6fd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:03.659966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:03.668924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024515d8-9155-4c80-b73e-6d2b6aba2397 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:03.708008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249b69d-f03a-41ec-a977-ce5deb336b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:03.708735 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249b69d-f03a-41ec-a977-ce5deb336b19 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:03.709085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249b69d-f03a-41ec-a977-ce5deb336b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:03.709471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249b69d-f03a-41ec-a977-ce5deb336b19 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:03.717983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249b69d-f03a-41ec-a977-ce5deb336b19 None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:03.719633 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249b69d-f03a-41ec-a977-ce5deb336b19 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:03.724144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 102/198] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:03 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:03.732553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249b69d-f03a-41ec-a977-ce5deb336b19 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:03.790167 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b119f7e-98b6-47db-915f-053cb19fb6fd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:03.866012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0469e33-a958-4253-99fe-96fb9379006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:03.866658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0469e33-a958-4253-99fe-96fb9379006a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:03.866935 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0469e33-a958-4253-99fe-96fb9379006a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:03.867207 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0469e33-a958-4253-99fe-96fb9379006a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:03.867946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0469e33-a958-4253-99fe-96fb9379006a None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=f0b8022912c4451aa812e06166168cfa, user.id=acf59726c26b4c1c8496481719833e30) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:03.868253 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0469e33-a958-4253-99fe-96fb9379006a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:03.869968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0469e33-a958-4253-99fe-96fb9379006a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:03.871306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249b69d-f03a-41ec-a977-ce5deb336b19 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:03.880804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:03.883151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 97/199] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:03 2022] GET /identity/v3/role_assignments?user.id=acf59726c26b4c1c8496481719833e30&scope.project.id=f0b8022912c4451aa812e06166168cfa&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:03.937059 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1332a-68fb-48c8-accf-c53242f5368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:03.937630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1332a-68fb-48c8-accf-c53242f5368a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:03.937913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1332a-68fb-48c8-accf-c53242f5368a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:03.938364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1332a-68fb-48c8-accf-c53242f5368a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:03.939105 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1332a-68fb-48c8-accf-c53242f5368a None admin] RBAC: Adding query filter params (role.id=e577106295c544bfbe1944b178cb95e5, scope.project.id=f0b8022912c4451aa812e06166168cfa, user.id=acf59726c26b4c1c8496481719833e30) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:03.939415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1332a-68fb-48c8-accf-c53242f5368a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:03.941053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1332a-68fb-48c8-accf-c53242f5368a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:03.950400 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 103/200] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:03 2022] GET /identity/v3/role_assignments?user.id=acf59726c26b4c1c8496481719833e30&scope.project.id=f0b8022912c4451aa812e06166168cfa&role.id=e577106295c544bfbe1944b178cb95e5 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:04.361420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b514a42-e3f0-4033-ad94-3e5113aa0dde None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:04.361812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b514a42-e3f0-4033-ad94-3e5113aa0dde None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:04.361984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b514a42-e3f0-4033-ad94-3e5113aa0dde None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:04.363308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 98/201] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:04.369074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802b12-0cc9-48ad-9fa1-e6e48f1fe017 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:04.369557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802b12-0cc9-48ad-9fa1-e6e48f1fe017 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:04.369630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802b12-0cc9-48ad-9fa1-e6e48f1fe017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:04.398261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-29802b12-0cc9-48ad-9fa1-e6e48f1fe017 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:04.399481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-29802b12-0cc9-48ad-9fa1-e6e48f1fe017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:04.489074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 104/202] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:04.816904 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b514a42-e3f0-4033-ad94-3e5113aa0dde None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:04.950254 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b514a42-e3f0-4033-ad94-3e5113aa0dde None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:04.962098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:04.995520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc8d17-e50a-4824-8c43-dfcf0180a3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:04.996164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc8d17-e50a-4824-8c43-dfcf0180a3bc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:04.996435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc8d17-e50a-4824-8c43-dfcf0180a3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:04.996702 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc8d17-e50a-4824-8c43-dfcf0180a3bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:05.011149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc8d17-e50a-4824-8c43-dfcf0180a3bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-78cc8d17-e50a-4824-8c43-dfcf0180a3bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:05.016649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:05.017679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:05.018968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:05.018968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:05.018968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:05.018968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:05.018968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:05.018968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:05.018968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:05.018968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:05.018968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:05.018968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:05.018968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:05.018968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:05.020674 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 99/203] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:05.024098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29802b12-0cc9-48ad-9fa1-e6e48f1fe017 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:05.141105 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:05.147461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29802b12-0cc9-48ad-9fa1-e6e48f1fe017 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:05.203070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d474599-b1ea-4765-a848-ef4a049eb310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:05.203706 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d474599-b1ea-4765-a848-ef4a049eb310 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:05.203985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d474599-b1ea-4765-a848-ef4a049eb310 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:05.204252 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d474599-b1ea-4765-a848-ef4a049eb310 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:05.204933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d474599-b1ea-4765-a848-ef4a049eb310 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:05.205234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d474599-b1ea-4765-a848-ef4a049eb310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:05.206657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d474599-b1ea-4765-a848-ef4a049eb310 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:05.220771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 105/204] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:05.226467 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc8d17-e50a-4824-8c43-dfcf0180a3bc None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:05.365301 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc8d17-e50a-4824-8c43-dfcf0180a3bc None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:05.408305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31dd98-1fd6-4c4d-82e3-9d4655b08237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:05.408868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31dd98-1fd6-4c4d-82e3-9d4655b08237 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:05.409145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31dd98-1fd6-4c4d-82e3-9d4655b08237 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:05.409443 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31dd98-1fd6-4c4d-82e3-9d4655b08237 None admin] PATH_INFO: `/v3/users/628ed052d3c3458d82d0904823fd1bce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:05.410579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31dd98-1fd6-4c4d-82e3-9d4655b08237 None admin] RBAC: Authorizing `identity:get_user(user_id=628ed052d3c3458d82d0904823fd1bce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:05.412015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31dd98-1fd6-4c4d-82e3-9d4655b08237 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:05.413961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 100/205] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:05 2022] GET /identity/v3/users/628ed052d3c3458d82d0904823fd1bce => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:05.419189 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d474599-b1ea-4765-a848-ef4a049eb310 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:05.546822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d474599-b1ea-4765-a848-ef4a049eb310 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:05.590360 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55c9f9-54c3-4442-a38f-e73c755d633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:05.590974 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c9f9-54c3-4442-a38f-e73c755d633f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:05.591249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c9f9-54c3-4442-a38f-e73c755d633f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:05.591557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c9f9-54c3-4442-a38f-e73c755d633f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:05.636190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:05.666855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25eccd1-844b-41fc-815a-d52a8d8243a4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:05.667042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25eccd1-844b-41fc-815a-d52a8d8243a4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:05.667322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25eccd1-844b-41fc-815a-d52a8d8243a4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:05.668658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 101/206] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:05.678582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b6fdf-9935-45ac-a82d-dcbbc70d75b2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:05.678863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b6fdf-9935-45ac-a82d-dcbbc70d75b2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:05.679134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b6fdf-9935-45ac-a82d-dcbbc70d75b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:05.690365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55c9f9-54c3-4442-a38f-e73c755d633f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:05.692278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55c9f9-54c3-4442-a38f-e73c755d633f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:05.713327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1d4b6fdf-9935-45ac-a82d-dcbbc70d75b2 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:05.714534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1d4b6fdf-9935-45ac-a82d-dcbbc70d75b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:05.788767 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:05.812931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 106/207] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 03:11:05.818261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55c9f9-54c3-4442-a38f-e73c755d633f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:05.863423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 102/208] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:05.908244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:05.971952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55c9f9-54c3-4442-a38f-e73c755d633f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:06.019297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543c262-d004-4190-ae00-8b8a75a3e49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:06.019929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543c262-d004-4190-ae00-8b8a75a3e49a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:06.020203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543c262-d004-4190-ae00-8b8a75a3e49a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:06.020469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543c262-d004-4190-ae00-8b8a75a3e49a None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:06.021632 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543c262-d004-4190-ae00-8b8a75a3e49a None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:06.023072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543c262-d004-4190-ae00-8b8a75a3e49a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:06.024690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 107/209] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:05 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:06.030630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b6fdf-9935-45ac-a82d-dcbbc70d75b2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:06.179088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b6fdf-9935-45ac-a82d-dcbbc70d75b2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:06.214085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5259a-1dfa-4f8a-a073-056d5854dd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:06.215103 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5259a-1dfa-4f8a-a073-056d5854dd1b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:06.215634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5259a-1dfa-4f8a-a073-056d5854dd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:06.216110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5259a-1dfa-4f8a-a073-056d5854dd1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:06.217648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5259a-1dfa-4f8a-a073-056d5854dd1b None admin] RBAC: Adding query filter params (role.id=c924ec18040e4cc4b55053391fd47e8a, scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0, user.id=628ed052d3c3458d82d0904823fd1bce) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:06.218178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5259a-1dfa-4f8a-a073-056d5854dd1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:06.219816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5259a-1dfa-4f8a-a073-056d5854dd1b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:06.226092 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 103/210] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:06 2022] GET /identity/v3/role_assignments?user.id=628ed052d3c3458d82d0904823fd1bce&scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0&role.id=c924ec18040e4cc4b55053391fd47e8a => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:06.257698 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41fe7-806b-40a3-936b-16742867c279 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:06.258071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41fe7-806b-40a3-936b-16742867c279 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:06.258270 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41fe7-806b-40a3-936b-16742867c279 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:06.259975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 108/211] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:06.266226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bc3cf-c43c-4cd2-adc6-cfb1b00c71b6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:06.266982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bc3cf-c43c-4cd2-adc6-cfb1b00c71b6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:06.267543 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bc3cf-c43c-4cd2-adc6-cfb1b00c71b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:06.270520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b41fe7-806b-40a3-936b-16742867c279 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:06.294549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-744bc3cf-c43c-4cd2-adc6-cfb1b00c71b6 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:06.296282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-744bc3cf-c43c-4cd2-adc6-cfb1b00c71b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:06.344579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:06.436044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 104/212] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:06.468581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b41fe7-806b-40a3-936b-16742867c279 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:06.501570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:06.514419 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65749b3-5cf9-408b-8cb5-7854fe4863b5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:06.515054 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65749b3-5cf9-408b-8cb5-7854fe4863b5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:06.515574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65749b3-5cf9-408b-8cb5-7854fe4863b5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:06.517172 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2437b9-1826-468f-9730-a837bffa0207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:06.517698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 105/213] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:11:06.518981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2437b9-1826-468f-9730-a837bffa0207 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:06.518981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2437b9-1826-468f-9730-a837bffa0207 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:06.518981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2437b9-1826-468f-9730-a837bffa0207 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:06.524349 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d0ba3-7aa1-42c4-8669-128454db150c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:06.524593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d0ba3-7aa1-42c4-8669-128454db150c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:06.524897 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d0ba3-7aa1-42c4-8669-128454db150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:06.539118 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2437b9-1826-468f-9730-a837bffa0207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ce2437b9-1826-468f-9730-a837bffa0207 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:06.545221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:06.546170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:06.546951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:06.546951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:06.546951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:06.546951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:06.546951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:06.546951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:06.546951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:06.546951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:06.546951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:06.546951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:06.546951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:06.546951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:06.547560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-289d0ba3-7aa1-42c4-8669-128454db150c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:06.547560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-289d0ba3-7aa1-42c4-8669-128454db150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:06.550279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 109/214] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:06.555820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2437b9-1826-468f-9730-a837bffa0207 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:06.642923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 106/215] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:06.689153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af328e75-a31b-4c21-a003-32605bf69eb4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:06.689858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af328e75-a31b-4c21-a003-32605bf69eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:06.690410 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af328e75-a31b-4c21-a003-32605bf69eb4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:06.692908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 107/216] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:11:06.699472 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1ce12-6ac1-437b-9d20-5aa7be36d65a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:06.699990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1ce12-6ac1-437b-9d20-5aa7be36d65a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:06.700537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1ce12-6ac1-437b-9d20-5aa7be36d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:06.708131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2437b9-1826-468f-9730-a837bffa0207 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:06.722475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-72b1ce12-6ac1-437b-9d20-5aa7be36d65a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:06.724073 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-72b1ce12-6ac1-437b-9d20-5aa7be36d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:06.752724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fde11-094d-4b9d-a00b-45f67f9a49b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:06.753273 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fde11-094d-4b9d-a00b-45f67f9a49b6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:06.753560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fde11-094d-4b9d-a00b-45f67f9a49b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:06.753831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fde11-094d-4b9d-a00b-45f67f9a49b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:06.754491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fde11-094d-4b9d-a00b-45f67f9a49b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:06.754790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fde11-094d-4b9d-a00b-45f67f9a49b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:06.756167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fde11-094d-4b9d-a00b-45f67f9a49b6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:06.764802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 110/217] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:06.768732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fde11-094d-4b9d-a00b-45f67f9a49b6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:06.798806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 108/218] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:06.799566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1ce12-6ac1-437b-9d20-5aa7be36d65a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:06.822584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:06.829464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:06.880843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fde11-094d-4b9d-a00b-45f67f9a49b6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:06.924227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454503cc-1338-4504-a854-93ec4e94dd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:06.924867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454503cc-1338-4504-a854-93ec4e94dd8d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:06.925147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454503cc-1338-4504-a854-93ec4e94dd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:06.925586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454503cc-1338-4504-a854-93ec4e94dd8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:06.926580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454503cc-1338-4504-a854-93ec4e94dd8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:06.928042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454503cc-1338-4504-a854-93ec4e94dd8d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:06.928218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1ce12-6ac1-437b-9d20-5aa7be36d65a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:06.929644 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 111/219] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:06.934220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454503cc-1338-4504-a854-93ec4e94dd8d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:06.966759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed1103-6487-4311-a575-e704d57adabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:06.967385 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1103-6487-4311-a575-e704d57adabf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:06.967659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1103-6487-4311-a575-e704d57adabf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:06.967924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed1103-6487-4311-a575-e704d57adabf None admin] PATH_INFO: `/v3/users/c9f1316931824400abfd5b43d60d275d` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:06.981520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed1103-6487-4311-a575-e704d57adabf None admin] RBAC: Authorizing `identity:get_user(user_id=c9f1316931824400abfd5b43d60d275d)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:06.982979 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed1103-6487-4311-a575-e704d57adabf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:06.984581 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 109/220] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:06 2022] GET /identity/v3/users/c9f1316931824400abfd5b43d60d275d => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:06.985328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed1103-6487-4311-a575-e704d57adabf None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:07.042783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454503cc-1338-4504-a854-93ec4e94dd8d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:07.056023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:07.068485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:07.077831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81df73-e368-4f91-b588-1aff5dd1fc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:07.078469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81df73-e368-4f91-b588-1aff5dd1fc7e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:07.078750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81df73-e368-4f91-b588-1aff5dd1fc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:07.079020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81df73-e368-4f91-b588-1aff5dd1fc7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:07.089010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81df73-e368-4f91-b588-1aff5dd1fc7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:07.089788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed1103-6487-4311-a575-e704d57adabf None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-3d81df73-e368-4f91-b588-1aff5dd1fc7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:07.094367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:07.095471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 112/221] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:11:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:07.096246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81df73-e368-4f91-b588-1aff5dd1fc7e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:07.124094 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85a70-269f-45e3-a5d6-d35fd6469cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:07.124690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85a70-269f-45e3-a5d6-d35fd6469cb5 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:07.124964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85a70-269f-45e3-a5d6-d35fd6469cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:07.125227 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85a70-269f-45e3-a5d6-d35fd6469cb5 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:07.125893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca85a70-269f-45e3-a5d6-d35fd6469cb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:07.127325 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca85a70-269f-45e3-a5d6-d35fd6469cb5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:07.194944 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81df73-e368-4f91-b588-1aff5dd1fc7e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:07.227057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd9d03-e5ec-4b98-8a01-652146d727fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:07.227657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd9d03-e5ec-4b98-8a01-652146d727fd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:07.227921 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 110/222] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:11:06 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:11:07.228029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd9d03-e5ec-4b98-8a01-652146d727fd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:07.228204 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd9d03-e5ec-4b98-8a01-652146d727fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:07.228799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85a70-269f-45e3-a5d6-d35fd6469cb5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:07.295665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:07.321852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd9d03-e5ec-4b98-8a01-652146d727fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:07.323372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd9d03-e5ec-4b98-8a01-652146d727fd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:07.349463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85a70-269f-45e3-a5d6-d35fd6469cb5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:07.386106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fc103-80ce-4a25-b307-a3042181b051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:07.386757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fc103-80ce-4a25-b307-a3042181b051 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:07.387036 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fc103-80ce-4a25-b307-a3042181b051 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:07.387306 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fc103-80ce-4a25-b307-a3042181b051 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:07.390199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:07.399575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fc103-80ce-4a25-b307-a3042181b051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-e97fc103-80ce-4a25-b307-a3042181b051 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:07.405115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:07.406360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 111/223] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:11:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:07.408276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fc103-80ce-4a25-b307-a3042181b051 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:07.441965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 113/224] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:07.442878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd9d03-e5ec-4b98-8a01-652146d727fd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:07.528134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:07.530743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fc103-80ce-4a25-b307-a3042181b051 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:07.562742 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd9d03-e5ec-4b98-8a01-652146d727fd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:07.572880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984eeea-7ea6-4e44-a4f6-aa74658237c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:07.573892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984eeea-7ea6-4e44-a4f6-aa74658237c1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:07.574383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984eeea-7ea6-4e44-a4f6-aa74658237c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:07.574852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984eeea-7ea6-4e44-a4f6-aa74658237c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:07.576235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984eeea-7ea6-4e44-a4f6-aa74658237c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:07.576723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984eeea-7ea6-4e44-a4f6-aa74658237c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:07.578147 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984eeea-7ea6-4e44-a4f6-aa74658237c1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:07.586633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 112/225] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:07.587444 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984eeea-7ea6-4e44-a4f6-aa74658237c1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:07.604529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35f8ac-74e8-4510-b1c4-20ad0b1c2b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:07.606149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35f8ac-74e8-4510-b1c4-20ad0b1c2b4d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:07.606149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35f8ac-74e8-4510-b1c4-20ad0b1c2b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:07.606344 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35f8ac-74e8-4510-b1c4-20ad0b1c2b4d None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:07.607132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35f8ac-74e8-4510-b1c4-20ad0b1c2b4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:07.607440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35f8ac-74e8-4510-b1c4-20ad0b1c2b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:07.609087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35f8ac-74e8-4510-b1c4-20ad0b1c2b4d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:07.622096 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 114/226] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:07.624482 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35f8ac-74e8-4510-b1c4-20ad0b1c2b4d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:07.659856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:07.708893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984eeea-7ea6-4e44-a4f6-aa74658237c1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:07.744820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f23b3-f8e2-48da-b890-f60df7b26029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:07.745503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f23b3-f8e2-48da-b890-f60df7b26029 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:07.745778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f23b3-f8e2-48da-b890-f60df7b26029 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:07.746045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f23b3-f8e2-48da-b890-f60df7b26029 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:07.747239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f23b3-f8e2-48da-b890-f60df7b26029 None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:07.749480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f23b3-f8e2-48da-b890-f60df7b26029 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:07.751468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 113/227] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:07 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:07.752307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f23b3-f8e2-48da-b890-f60df7b26029 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:07.760793 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35f8ac-74e8-4510-b1c4-20ad0b1c2b4d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:07.798754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910c381-577c-49e1-a8c3-1ca421cdf585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:07.799383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c381-577c-49e1-a8c3-1ca421cdf585 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:07.799660 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c381-577c-49e1-a8c3-1ca421cdf585 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:07.799933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c381-577c-49e1-a8c3-1ca421cdf585 None admin] PATH_INFO: `/v3/users/acf59726c26b4c1c8496481719833e30` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:07.801058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910c381-577c-49e1-a8c3-1ca421cdf585 None admin] RBAC: Authorizing `identity:get_user(user_id=acf59726c26b4c1c8496481719833e30)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:07.802542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910c381-577c-49e1-a8c3-1ca421cdf585 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:07.804301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 115/228] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:07 2022] GET /identity/v3/users/acf59726c26b4c1c8496481719833e30 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:07.804911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910c381-577c-49e1-a8c3-1ca421cdf585 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:07.809460 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:07.877091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f23b3-f8e2-48da-b890-f60df7b26029 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:07.907509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:07.918371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781046b-db5c-43ea-86ab-0877ba1ad93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:07.919118 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781046b-db5c-43ea-86ab-0877ba1ad93c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:07.919491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781046b-db5c-43ea-86ab-0877ba1ad93c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:07.919927 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781046b-db5c-43ea-86ab-0877ba1ad93c None admin] PATH_INFO: `/v3/users/acf59726c26b4c1c8496481719833e30` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:07.921016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781046b-db5c-43ea-86ab-0877ba1ad93c None admin] RBAC: Authorizing `identity:get_user(user_id=acf59726c26b4c1c8496481719833e30)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:07.922563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781046b-db5c-43ea-86ab-0877ba1ad93c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:07.924535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 114/229] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:07 2022] GET /identity/v3/users/acf59726c26b4c1c8496481719833e30 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:07.925449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781046b-db5c-43ea-86ab-0877ba1ad93c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:07.939538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910c381-577c-49e1-a8c3-1ca421cdf585 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:08.003772 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa47d87-1e1b-4115-8add-92e47bfd46b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:08.004382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa47d87-1e1b-4115-8add-92e47bfd46b4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:08.004656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa47d87-1e1b-4115-8add-92e47bfd46b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:08.004925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa47d87-1e1b-4115-8add-92e47bfd46b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:08.005721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa47d87-1e1b-4115-8add-92e47bfd46b4 None admin] RBAC: Adding query filter params (role.id=367ec0d2bcdc49f09b0772bbd737e5ce, scope.project.id=f0b8022912c4451aa812e06166168cfa, user.id=c9f1316931824400abfd5b43d60d275d) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:08.006074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa47d87-1e1b-4115-8add-92e47bfd46b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:08.007512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa47d87-1e1b-4115-8add-92e47bfd46b4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:08.015152 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 116/230] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:07 2022] GET /identity/v3/role_assignments?user.id=c9f1316931824400abfd5b43d60d275d&scope.project.id=f0b8022912c4451aa812e06166168cfa&role.id=367ec0d2bcdc49f09b0772bbd737e5ce => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:08.015951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa47d87-1e1b-4115-8add-92e47bfd46b4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:08.144169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781046b-db5c-43ea-86ab-0877ba1ad93c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:08.147721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:08.195138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa47d87-1e1b-4115-8add-92e47bfd46b4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:08.222530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78167e0f-e66a-4fdb-bbb5-b420e4738fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:08.223554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78167e0f-e66a-4fdb-bbb5-b420e4738fed None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:08.224031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78167e0f-e66a-4fdb-bbb5-b420e4738fed None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:08.224507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78167e0f-e66a-4fdb-bbb5-b420e4738fed None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:08.226771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78167e0f-e66a-4fdb-bbb5-b420e4738fed None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:08.228435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78167e0f-e66a-4fdb-bbb5-b420e4738fed None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:08.232471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 115/231] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:07 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:08.238380 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78167e0f-e66a-4fdb-bbb5-b420e4738fed None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:08.266316 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a3081-a673-4a7c-bdad-0bed93a8a610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:08.267373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a3081-a673-4a7c-bdad-0bed93a8a610 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:08.267851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a3081-a673-4a7c-bdad-0bed93a8a610 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:08.268343 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a3081-a673-4a7c-bdad-0bed93a8a610 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:08.271570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a3081-a673-4a7c-bdad-0bed93a8a610 None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:08.273503 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a3081-a673-4a7c-bdad-0bed93a8a610 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:08.275772 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 117/232] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:08 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:08.293883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a3081-a673-4a7c-bdad-0bed93a8a610 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:08.319226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:08.389302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78167e0f-e66a-4fdb-bbb5-b420e4738fed None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:08.433964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a25b6-9b74-448b-868c-752458496ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:08.434554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a25b6-9b74-448b-868c-752458496ada None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:08.434834 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a25b6-9b74-448b-868c-752458496ada None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:08.435140 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a25b6-9b74-448b-868c-752458496ada None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa/users/acf59726c26b4c1c8496481719833e30/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:08.439425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a3081-a673-4a7c-bdad-0bed93a8a610 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:08.442541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a25b6-9b74-448b-868c-752458496ada None admin] RBAC: Authorizing `identity:create_grant(project_id=f0b8022912c4451aa812e06166168cfa, user_id=acf59726c26b4c1c8496481719833e30, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:08.443996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a25b6-9b74-448b-868c-752458496ada None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:08.475214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fd242-06e0-4633-ae3b-330cedbd9419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:08.475984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fd242-06e0-4633-ae3b-330cedbd9419 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:08.476334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fd242-06e0-4633-ae3b-330cedbd9419 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:08.476728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fd242-06e0-4633-ae3b-330cedbd9419 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa/users/acf59726c26b4c1c8496481719833e30/roles/e577106295c544bfbe1944b178cb95e5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:08.479195 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fd242-06e0-4633-ae3b-330cedbd9419 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0b8022912c4451aa812e06166168cfa, user_id=acf59726c26b4c1c8496481719833e30, role_id=e577106295c544bfbe1944b178cb95e5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:08.480807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fd242-06e0-4633-ae3b-330cedbd9419 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:08.485205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:08.529414 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 116/233] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:11:08 2022] PUT /identity/v3/projects/f0b8022912c4451aa812e06166168cfa/users/acf59726c26b4c1c8496481719833e30/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:08.546858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 118/234] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:11:08 2022] PUT /identity/v3/projects/f0b8022912c4451aa812e06166168cfa/users/acf59726c26b4c1c8496481719833e30/roles/e577106295c544bfbe1944b178cb95e5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:11:09.749798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b24d-0c10-41f9-8c91-a3659b42af78 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:09.750336 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b24d-0c10-41f9-8c91-a3659b42af78 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:09.750336 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629b24d-0c10-41f9-8c91-a3659b42af78 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:09.752112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 117/235] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:09.757472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643d9d1-078a-4c64-b38b-eb29253d6673 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:09.758264 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643d9d1-078a-4c64-b38b-eb29253d6673 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:09.758743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643d9d1-078a-4c64-b38b-eb29253d6673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:09.783601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5643d9d1-078a-4c64-b38b-eb29253d6673 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:09.785058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5643d9d1-078a-4c64-b38b-eb29253d6673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:09.868414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 119/236] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:10.009393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53770950-bc1d-48a6-920f-4ef37ec65717 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:10.010007 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53770950-bc1d-48a6-920f-4ef37ec65717 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:10.010475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53770950-bc1d-48a6-920f-4ef37ec65717 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:10.012309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 118/237] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:10.017822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f964e-8e91-4037-86b9-4e9312b59d56 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:10.018314 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f964e-8e91-4037-86b9-4e9312b59d56 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:10.018788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f964e-8e91-4037-86b9-4e9312b59d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:10.046174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ff1f964e-8e91-4037-86b9-4e9312b59d56 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:10.047649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ff1f964e-8e91-4037-86b9-4e9312b59d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:10.135227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 120/238] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:10.199905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53770950-bc1d-48a6-920f-4ef37ec65717 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:10.304780 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53770950-bc1d-48a6-920f-4ef37ec65717 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:10.324783 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:10.338909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d5a2e-35b8-4307-aa47-e8834db11487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:10.339533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d5a2e-35b8-4307-aa47-e8834db11487 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:10.339804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d5a2e-35b8-4307-aa47-e8834db11487 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:10.340068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d5a2e-35b8-4307-aa47-e8834db11487 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:10.341789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d5a2e-35b8-4307-aa47-e8834db11487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:10.343257 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d5a2e-35b8-4307-aa47-e8834db11487 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:10.345194 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 119/239] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:10.350620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f964e-8e91-4037-86b9-4e9312b59d56 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:10.423647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:10.478217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f964e-8e91-4037-86b9-4e9312b59d56 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:10.509439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d5a2e-35b8-4307-aa47-e8834db11487 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:10.531154 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f751ee0-d921-4637-84e2-02258e640b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:10.532092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f751ee0-d921-4637-84e2-02258e640b83 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:10.532610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f751ee0-d921-4637-84e2-02258e640b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:10.533090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f751ee0-d921-4637-84e2-02258e640b83 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:10.534061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f751ee0-d921-4637-84e2-02258e640b83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:10.535723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f751ee0-d921-4637-84e2-02258e640b83 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:10.616011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d5a2e-35b8-4307-aa47-e8834db11487 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:10.636170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 121/240] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:11:10 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:11:10.652948 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8080f-9e29-4957-a5d2-3d2c17577cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:10.653750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8080f-9e29-4957-a5d2-3d2c17577cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:10.654041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8080f-9e29-4957-a5d2-3d2c17577cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:10.654314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8080f-9e29-4957-a5d2-3d2c17577cd8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:10.667062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8080f-9e29-4957-a5d2-3d2c17577cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-aae8080f-9e29-4957-a5d2-3d2c17577cd8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:10.672738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:10.673712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:10.674501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:10.674501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:10.674501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:10.674501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:10.674501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:10.674501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:10.674501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:10.674501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:10.674501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:10.674501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:10.674501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:10.674501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:10.674501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 120/241] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:10.680447 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f751ee0-d921-4637-84e2-02258e640b83 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:10.811754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f751ee0-d921-4637-84e2-02258e640b83 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:10.826824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:10.853412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d1a6b-4975-4cbb-a0a8-a162a57e6fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:10.854396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d1a6b-4975-4cbb-a0a8-a162a57e6fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:10.854870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d1a6b-4975-4cbb-a0a8-a162a57e6fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:10.855353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d1a6b-4975-4cbb-a0a8-a162a57e6fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:10.856229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d1a6b-4975-4cbb-a0a8-a162a57e6fd6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:10.856752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d1a6b-4975-4cbb-a0a8-a162a57e6fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:10.858352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d1a6b-4975-4cbb-a0a8-a162a57e6fd6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:10.870021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 122/242] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:10.876124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8080f-9e29-4957-a5d2-3d2c17577cd8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:10.888775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc0c65-6876-47f1-af9e-61bc968d53c4 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:10.889064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc0c65-6876-47f1-af9e-61bc968d53c4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:10.889519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc0c65-6876-47f1-af9e-61bc968d53c4 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:10.890683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 123/243] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:11:10.895935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf0eb0-48a7-435e-98c6-bf90972f9915 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:10.896205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf0eb0-48a7-435e-98c6-bf90972f9915 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:10.896484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf0eb0-48a7-435e-98c6-bf90972f9915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:10.918500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dcdf0eb0-48a7-435e-98c6-bf90972f9915 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:10.919835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dcdf0eb0-48a7-435e-98c6-bf90972f9915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:10.953078 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:10.997136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 124/244] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:11.001304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8080f-9e29-4957-a5d2-3d2c17577cd8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:11.035893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e3031-71d6-40e9-b653-b70f92d2e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:11.036650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e3031-71d6-40e9-b653-b70f92d2e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:11.037007 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e3031-71d6-40e9-b653-b70f92d2e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:11.037391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e3031-71d6-40e9-b653-b70f92d2e8f3 None admin] PATH_INFO: `/v3/users/373a5d7503a546a3aa5dfe41e79182ee` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:11.052866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e3031-71d6-40e9-b653-b70f92d2e8f3 None admin] RBAC: Authorizing `identity:get_user(user_id=373a5d7503a546a3aa5dfe41e79182ee)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:11.054477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e3031-71d6-40e9-b653-b70f92d2e8f3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:11.056434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 121/245] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:10 2022] GET /identity/v3/users/373a5d7503a546a3aa5dfe41e79182ee => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:11.062872 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf0eb0-48a7-435e-98c6-bf90972f9915 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:11.176724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf0eb0-48a7-435e-98c6-bf90972f9915 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:11.179495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:11.219563 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31280a1-13a9-406d-9343-3db8251c43f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:11.220170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31280a1-13a9-406d-9343-3db8251c43f1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:11.220485 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31280a1-13a9-406d-9343-3db8251c43f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:11.220755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31280a1-13a9-406d-9343-3db8251c43f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:11.295078 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31280a1-13a9-406d-9343-3db8251c43f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:11.296566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31280a1-13a9-406d-9343-3db8251c43f1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:11.307600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e3031-71d6-40e9-b653-b70f92d2e8f3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:11.417231 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 125/246] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:11.418859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4185c69-3b3a-4a4f-ac16-fed6bcef1c27 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:11.420026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4185c69-3b3a-4a4f-ac16-fed6bcef1c27 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:11.420504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4185c69-3b3a-4a4f-ac16-fed6bcef1c27 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:11.422044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 126/247] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:11.427771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4185c69-3b3a-4a4f-ac16-fed6bcef1c27 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:11.431586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:11.444582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e3031-71d6-40e9-b653-b70f92d2e8f3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:11.459468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:11.489090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c172f-bb3b-424b-827a-5b6d176259e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:11.489777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c172f-bb3b-424b-827a-5b6d176259e6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:11.490059 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c172f-bb3b-424b-827a-5b6d176259e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:11.490716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c172f-bb3b-424b-827a-5b6d176259e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:11.504980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c172f-bb3b-424b-827a-5b6d176259e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-2c9c172f-bb3b-424b-827a-5b6d176259e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:11.509876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:11.510833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:11.511630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:11.511630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:11.511630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:11.511630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:11.511630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:11.511630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:11.511630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:11.511630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:11.511630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:11.511630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:11.511630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:11.511630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:11.511630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 122/248] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:11.512642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63e37d-76cd-4e90-b80e-ec53d9ec7738 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:11.512888 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63e37d-76cd-4e90-b80e-ec53d9ec7738 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:11.513191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63e37d-76cd-4e90-b80e-ec53d9ec7738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:11.531308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0d63e37d-76cd-4e90-b80e-ec53d9ec7738 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:11.532484 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0d63e37d-76cd-4e90-b80e-ec53d9ec7738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:11.553646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4185c69-3b3a-4a4f-ac16-fed6bcef1c27 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:11.591914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5d990-c8cc-482a-87a7-d5f28414a5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:11.592867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5d990-c8cc-482a-87a7-d5f28414a5aa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:11.593353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5d990-c8cc-482a-87a7-d5f28414a5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:11.593909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5d990-c8cc-482a-87a7-d5f28414a5aa None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:11.595343 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5d990-c8cc-482a-87a7-d5f28414a5aa None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:11.597086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5d990-c8cc-482a-87a7-d5f28414a5aa None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:11.599011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 127/249] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:11 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:11.600381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b618ef1-a26e-4955-a4c0-6b6aaa839129 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:11.600865 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b618ef1-a26e-4955-a4c0-6b6aaa839129 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:11.601401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b618ef1-a26e-4955-a4c0-6b6aaa839129 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:11.602795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 128/250] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:11.603683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b618ef1-a26e-4955-a4c0-6b6aaa839129 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:11.611791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 123/251] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:11.613686 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63e37d-76cd-4e90-b80e-ec53d9ec7738 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:11.728634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:11.736307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63e37d-76cd-4e90-b80e-ec53d9ec7738 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:11.765091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:11.783220 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862c0f0-72c8-4161-8104-f8f7c372cfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:11.784138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862c0f0-72c8-4161-8104-f8f7c372cfdb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:11.784423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862c0f0-72c8-4161-8104-f8f7c372cfdb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:11.784702 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862c0f0-72c8-4161-8104-f8f7c372cfdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:11.785468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862c0f0-72c8-4161-8104-f8f7c372cfdb None admin] RBAC: Adding query filter params (role.id=c924ec18040e4cc4b55053391fd47e8a, scope.project.id=f0b8022912c4451aa812e06166168cfa, user.id=373a5d7503a546a3aa5dfe41e79182ee) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:11.785782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862c0f0-72c8-4161-8104-f8f7c372cfdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:11.787698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862c0f0-72c8-4161-8104-f8f7c372cfdb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:11.806449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 124/252] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:11 2022] GET /identity/v3/role_assignments?user.id=373a5d7503a546a3aa5dfe41e79182ee&scope.project.id=f0b8022912c4451aa812e06166168cfa&role.id=c924ec18040e4cc4b55053391fd47e8a => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:11.808134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bef12-8b60-4d99-be35-700879477293 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:11.808415 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bef12-8b60-4d99-be35-700879477293 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:11.808684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bef12-8b60-4d99-be35-700879477293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:11.817598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b618ef1-a26e-4955-a4c0-6b6aaa839129 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:11.850312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c98bef12-8b60-4d99-be35-700879477293 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:11.851555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c98bef12-8b60-4d99-be35-700879477293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:11.899036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa511b7-9767-4a0c-9813-a2e3ad7d944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:11.899486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa511b7-9767-4a0c-9813-a2e3ad7d944f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:11.899761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa511b7-9767-4a0c-9813-a2e3ad7d944f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:11.900073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa511b7-9767-4a0c-9813-a2e3ad7d944f None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:11.900827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa511b7-9767-4a0c-9813-a2e3ad7d944f None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:11.905094 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa511b7-9767-4a0c-9813-a2e3ad7d944f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:11.906560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa511b7-9767-4a0c-9813-a2e3ad7d944f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:11.919546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 129/253] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:11.920496 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa511b7-9767-4a0c-9813-a2e3ad7d944f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:12.026065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 125/254] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:12.037285 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bef12-8b60-4d99-be35-700879477293 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:12.193082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa511b7-9767-4a0c-9813-a2e3ad7d944f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:12.212020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:12.231906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bef12-8b60-4d99-be35-700879477293 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:12.265601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a3680-4dda-43f5-88bf-ebaf27e79beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:12.266241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a3680-4dda-43f5-88bf-ebaf27e79beb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:12.266523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a3680-4dda-43f5-88bf-ebaf27e79beb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:12.266795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a3680-4dda-43f5-88bf-ebaf27e79beb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:12.272849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:12.294296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a3680-4dda-43f5-88bf-ebaf27e79beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-554a3680-4dda-43f5-88bf-ebaf27e79beb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:12.299183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:12.300034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:12.300817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:12.300817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:12.300817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:12.300817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:12.300817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:12.300817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:12.300817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:12.300817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:12.300817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:12.300817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:12.300817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:12.300817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:12.302642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc44229-d53b-475b-9dc7-3e2cac220931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:12.304388 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc44229-d53b-475b-9dc7-3e2cac220931 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:12.304388 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc44229-d53b-475b-9dc7-3e2cac220931 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:12.304388 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc44229-d53b-475b-9dc7-3e2cac220931 None admin] PATH_INFO: `/v3/users/c9f1316931824400abfd5b43d60d275d` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:12.304934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 130/255] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:11:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:12.310546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc44229-d53b-475b-9dc7-3e2cac220931 None admin] RBAC: Authorizing `identity:get_user(user_id=c9f1316931824400abfd5b43d60d275d)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:12.311035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a3680-4dda-43f5-88bf-ebaf27e79beb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:12.312110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc44229-d53b-475b-9dc7-3e2cac220931 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:12.314152 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 126/256] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:12 2022] GET /identity/v3/users/c9f1316931824400abfd5b43d60d275d => generated 297 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:12.333892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc44229-d53b-475b-9dc7-3e2cac220931 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:12.506213 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a3680-4dda-43f5-88bf-ebaf27e79beb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:12.565566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc44229-d53b-475b-9dc7-3e2cac220931 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:12.571126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6f24e-6685-4456-b464-cff0c5f9dfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:12.572649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6f24e-6685-4456-b464-cff0c5f9dfd5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:12.577309 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6f24e-6685-4456-b464-cff0c5f9dfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:12.577812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6f24e-6685-4456-b464-cff0c5f9dfd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:12.578742 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6f24e-6685-4456-b464-cff0c5f9dfd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:12.579258 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6f24e-6685-4456-b464-cff0c5f9dfd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:12.580888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6f24e-6685-4456-b464-cff0c5f9dfd5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:12.597663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 131/257] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:12.600283 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6f24e-6685-4456-b464-cff0c5f9dfd5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:12.638910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7799ee-6d02-4301-a3f1-dfb29e60635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:12.640105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7799ee-6d02-4301-a3f1-dfb29e60635f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:12.643132 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7799ee-6d02-4301-a3f1-dfb29e60635f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:12.643610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7799ee-6d02-4301-a3f1-dfb29e60635f None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:12.645018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7799ee-6d02-4301-a3f1-dfb29e60635f None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:12.646905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7799ee-6d02-4301-a3f1-dfb29e60635f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:12.651441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 127/258] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:12 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:12.653287 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7799ee-6d02-4301-a3f1-dfb29e60635f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:12.691694 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:12.730261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:12.771063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7799ee-6d02-4301-a3f1-dfb29e60635f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:12.813175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a52a5-7aa3-4146-9b4e-1063735b2e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:12.813845 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a52a5-7aa3-4146-9b4e-1063735b2e8e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:12.814124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a52a5-7aa3-4146-9b4e-1063735b2e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:12.814396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a52a5-7aa3-4146-9b4e-1063735b2e8e None admin] PATH_INFO: `/v3/users/acf59726c26b4c1c8496481719833e30` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:12.816784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a52a5-7aa3-4146-9b4e-1063735b2e8e None admin] RBAC: Authorizing `identity:get_user(user_id=acf59726c26b4c1c8496481719833e30)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:12.818202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a52a5-7aa3-4146-9b4e-1063735b2e8e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:12.823411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 128/259] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:12 2022] GET /identity/v3/users/acf59726c26b4c1c8496481719833e30 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:12.824975 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a52a5-7aa3-4146-9b4e-1063735b2e8e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:12.851184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6f24e-6685-4456-b464-cff0c5f9dfd5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:12.926309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:12.933110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a52a5-7aa3-4146-9b4e-1063735b2e8e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:12.935859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a31965-88cd-4966-9b0a-90c4be51c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:12.936509 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a31965-88cd-4966-9b0a-90c4be51c968 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:12.936788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a31965-88cd-4966-9b0a-90c4be51c968 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:12.937057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a31965-88cd-4966-9b0a-90c4be51c968 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:12.967988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a31965-88cd-4966-9b0a-90c4be51c968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:12.970518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16681355-c353-4e58-9782-7ed2c98835a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:12.971381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16681355-c353-4e58-9782-7ed2c98835a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:12.971924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16681355-c353-4e58-9782-7ed2c98835a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:12.972214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16681355-c353-4e58-9782-7ed2c98835a4 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa/users/c9f1316931824400abfd5b43d60d275d/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:12.974228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16681355-c353-4e58-9782-7ed2c98835a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0b8022912c4451aa812e06166168cfa, user_id=c9f1316931824400abfd5b43d60d275d, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:12.975693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16681355-c353-4e58-9782-7ed2c98835a4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-80a31965-88cd-4966-9b0a-90c4be51c968 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:12.977491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:12.978361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:12.979227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:12.979227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:12.979227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:12.979227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:12.979227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:12.979227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:12.979227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:12.979227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:12.979227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:12.979227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:12.979227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:11:12.979227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:12.979227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 132/260] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:11:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:12.979866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a31965-88cd-4966-9b0a-90c4be51c968 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:13.057536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 129/261] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:11:12 2022] PUT /identity/v3/projects/f0b8022912c4451aa812e06166168cfa/users/c9f1316931824400abfd5b43d60d275d/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:13.058464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16681355-c353-4e58-9782-7ed2c98835a4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:13.115595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a31965-88cd-4966-9b0a-90c4be51c968 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:13.145670 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:13.183036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b5a99-7498-48f6-b665-47d8489063ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:13.183683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b5a99-7498-48f6-b665-47d8489063ec None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:13.184016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b5a99-7498-48f6-b665-47d8489063ec None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:13.184298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b5a99-7498-48f6-b665-47d8489063ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:13.270144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16681355-c353-4e58-9782-7ed2c98835a4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:13.318241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b5a99-7498-48f6-b665-47d8489063ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:13.320642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b5a99-7498-48f6-b665-47d8489063ec None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:13.328087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b89e51-8691-4e5d-bf41-a1a6a97a97f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:13.335048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b89e51-8691-4e5d-bf41-a1a6a97a97f1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:13.335650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b89e51-8691-4e5d-bf41-a1a6a97a97f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:13.336135 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b89e51-8691-4e5d-bf41-a1a6a97a97f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:13.337072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b89e51-8691-4e5d-bf41-a1a6a97a97f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:13.337620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b89e51-8691-4e5d-bf41-a1a6a97a97f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:13.339242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b89e51-8691-4e5d-bf41-a1a6a97a97f1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:13.363055 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 130/262] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:13.371104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b89e51-8691-4e5d-bf41-a1a6a97a97f1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:13.417058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:13.481083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 133/263] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:13.486644 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b5a99-7498-48f6-b665-47d8489063ec None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:13.504916 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:13.518664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b89e51-8691-4e5d-bf41-a1a6a97a97f1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:13.561171 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1280e2-83e5-4c17-b81b-fc9ac6e02b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:13.561844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1280e2-83e5-4c17-b81b-fc9ac6e02b6d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:13.562123 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1280e2-83e5-4c17-b81b-fc9ac6e02b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:13.562395 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1280e2-83e5-4c17-b81b-fc9ac6e02b6d None admin] PATH_INFO: `/v3/users/acf59726c26b4c1c8496481719833e30` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:13.564734 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1280e2-83e5-4c17-b81b-fc9ac6e02b6d None admin] RBAC: Authorizing `identity:get_user(user_id=acf59726c26b4c1c8496481719833e30)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:13.566234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1280e2-83e5-4c17-b81b-fc9ac6e02b6d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:13.568903 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 131/264] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:13 2022] GET /identity/v3/users/acf59726c26b4c1c8496481719833e30 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:13.574677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1280e2-83e5-4c17-b81b-fc9ac6e02b6d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:13.626498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b5a99-7498-48f6-b665-47d8489063ec None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:13.682886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa133-2dd1-4c43-a113-c693d5ff7a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:13.683538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa133-2dd1-4c43-a113-c693d5ff7a76 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:13.683820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa133-2dd1-4c43-a113-c693d5ff7a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:13.684092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa133-2dd1-4c43-a113-c693d5ff7a76 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:13.685786 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaa133-2dd1-4c43-a113-c693d5ff7a76 None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:13.687264 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaa133-2dd1-4c43-a113-c693d5ff7a76 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:13.689200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 134/265] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:13 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:13.698254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa133-2dd1-4c43-a113-c693d5ff7a76 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:13.784751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:13.839430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1280e2-83e5-4c17-b81b-fc9ac6e02b6d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:13.846459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:13.865894 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa133-2dd1-4c43-a113-c693d5ff7a76 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:13.916810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ee016-6942-48c2-97a5-a79660ebf0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:13.917368 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ee016-6942-48c2-97a5-a79660ebf0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:13.917649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ee016-6942-48c2-97a5-a79660ebf0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:13.917923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ee016-6942-48c2-97a5-a79660ebf0b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:13.918658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ee016-6942-48c2-97a5-a79660ebf0b7 None admin] RBAC: Adding query filter params (role.id=e577106295c544bfbe1944b178cb95e5, scope.project.id=f0b8022912c4451aa812e06166168cfa, user.id=acf59726c26b4c1c8496481719833e30) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:13.918963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ee016-6942-48c2-97a5-a79660ebf0b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:13.920958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ee016-6942-48c2-97a5-a79660ebf0b7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:13.932852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 135/266] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:13 2022] GET /identity/v3/role_assignments?user.id=acf59726c26b4c1c8496481719833e30&scope.project.id=f0b8022912c4451aa812e06166168cfa&role.id=e577106295c544bfbe1944b178cb95e5 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:13.939124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645486b-ea57-448f-9d6b-a69f576a76ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:13.939773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645486b-ea57-448f-9d6b-a69f576a76ef None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:13.940050 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645486b-ea57-448f-9d6b-a69f576a76ef None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:13.940320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645486b-ea57-448f-9d6b-a69f576a76ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:13.987183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9e342-6a81-46f9-9fda-5bc22da133f3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:13.987508 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9e342-6a81-46f9-9fda-5bc22da133f3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:13.987737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9e342-6a81-46f9-9fda-5bc22da133f3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:13.989484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 136/267] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:14.008763 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0e8b6-4fc3-4260-9d67-c790fc4c33ca None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:14.009060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0e8b6-4fc3-4260-9d67-c790fc4c33ca None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:14.009339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0e8b6-4fc3-4260-9d67-c790fc4c33ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:14.038991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7db0e8b6-4fc3-4260-9d67-c790fc4c33ca None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:14.040218 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7db0e8b6-4fc3-4260-9d67-c790fc4c33ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:14.095671 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645486b-ea57-448f-9d6b-a69f576a76ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:14.097159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645486b-ea57-448f-9d6b-a69f576a76ef None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:14.175416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 137/268] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:14.176525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf6497-68ec-4cc2-8dcf-bf0aa04fbd91 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:14.176812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf6497-68ec-4cc2-8dcf-bf0aa04fbd91 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:14.177086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf6497-68ec-4cc2-8dcf-bf0aa04fbd91 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:14.178386 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 138/269] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:14.185651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea3542-9f7b-4294-9fb1-0f55063cc51e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:14.185933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea3542-9f7b-4294-9fb1-0f55063cc51e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:14.186205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea3542-9f7b-4294-9fb1-0f55063cc51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:14.210585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:14.212057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-49ea3542-9f7b-4294-9fb1-0f55063cc51e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:14.213357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-49ea3542-9f7b-4294-9fb1-0f55063cc51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:14.234518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 132/270] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 03:11:14.237665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645486b-ea57-448f-9d6b-a69f576a76ef None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:14.293444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 139/271] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:14.356157 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645486b-ea57-448f-9d6b-a69f576a76ef None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:14.400429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5c121-2ccb-44d3-a714-8fe7ffe1b924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:14.401072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5c121-2ccb-44d3-a714-8fe7ffe1b924 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:14.401380 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5c121-2ccb-44d3-a714-8fe7ffe1b924 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:14.401656 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5c121-2ccb-44d3-a714-8fe7ffe1b924 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:14.402792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5c121-2ccb-44d3-a714-8fe7ffe1b924 None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:14.404290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5c121-2ccb-44d3-a714-8fe7ffe1b924 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:14.406297 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 133/272] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:14 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:14.412278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea3542-9f7b-4294-9fb1-0f55063cc51e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:14.427354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:14.549086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea3542-9f7b-4294-9fb1-0f55063cc51e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:14.590280 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5c121-2ccb-44d3-a714-8fe7ffe1b924 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:14.595716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962ed5-ab98-46d3-b979-05f6c7be5fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:14.596681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962ed5-ab98-46d3-b979-05f6c7be5fcf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:14.597179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962ed5-ab98-46d3-b979-05f6c7be5fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:14.597675 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77962ed5-ab98-46d3-b979-05f6c7be5fcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:14.598606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77962ed5-ab98-46d3-b979-05f6c7be5fcf None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=f0b8022912c4451aa812e06166168cfa, user.id=acf59726c26b4c1c8496481719833e30) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:14.599109 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77962ed5-ab98-46d3-b979-05f6c7be5fcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:14.600787 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77962ed5-ab98-46d3-b979-05f6c7be5fcf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:14.608268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 140/273] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:14 2022] GET /identity/v3/role_assignments?user.id=acf59726c26b4c1c8496481719833e30&scope.project.id=f0b8022912c4451aa812e06166168cfa&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:14.686741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:14.694504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962ed5-ab98-46d3-b979-05f6c7be5fcf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:14.756652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5c121-2ccb-44d3-a714-8fe7ffe1b924 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:14.790781 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:14.799474 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5528f-bca3-4dd0-8c25-5ecf649521da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:14.809946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5528f-bca3-4dd0-8c25-5ecf649521da None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:14.809946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5528f-bca3-4dd0-8c25-5ecf649521da None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:14.809946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5528f-bca3-4dd0-8c25-5ecf649521da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:14.815023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5528f-bca3-4dd0-8c25-5ecf649521da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-0ee5528f-bca3-4dd0-8c25-5ecf649521da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:14.820926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:14.821942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 134/274] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:14.826757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c678710-c1bf-46fd-b32f-3863711635a2 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:14.827458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c678710-c1bf-46fd-b32f-3863711635a2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:14.827458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c678710-c1bf-46fd-b32f-3863711635a2 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:14.827458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 135/275] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:14.830694 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c678710-c1bf-46fd-b32f-3863711635a2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:14.834152 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77962ed5-ab98-46d3-b979-05f6c7be5fcf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:14.886256 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18765204-a0da-449d-8d8c-ce44a71ad9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:14.890260 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765204-a0da-449d-8d8c-ce44a71ad9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:14.890260 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765204-a0da-449d-8d8c-ce44a71ad9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:14.890260 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765204-a0da-449d-8d8c-ce44a71ad9c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:14.890260 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18765204-a0da-449d-8d8c-ce44a71ad9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:14.891757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18765204-a0da-449d-8d8c-ce44a71ad9c7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:14.893434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 141/276] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:14.897885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e8e74-cf18-441f-b651-ceb9449c4491 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:14.898289 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e8e74-cf18-441f-b651-ceb9449c4491 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:14.898876 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e8e74-cf18-441f-b651-ceb9449c4491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:14.919763 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-553e8e74-cf18-441f-b651-ceb9449c4491 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:14.921401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-553e8e74-cf18-441f-b651-ceb9449c4491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:14.970165 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c678710-c1bf-46fd-b32f-3863711635a2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:14.985758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:14.998253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 142/277] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:14.999340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e8e74-cf18-441f-b651-ceb9449c4491 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:15.021081 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03a727-948f-4e7e-9c04-0ca1ee7cd3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:15.021744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03a727-948f-4e7e-9c04-0ca1ee7cd3bb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:15.022023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03a727-948f-4e7e-9c04-0ca1ee7cd3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:15.022294 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03a727-948f-4e7e-9c04-0ca1ee7cd3bb None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:15.023211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03a727-948f-4e7e-9c04-0ca1ee7cd3bb None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:15.023522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03a727-948f-4e7e-9c04-0ca1ee7cd3bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:15.025329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03a727-948f-4e7e-9c04-0ca1ee7cd3bb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:15.041420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 136/278] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:15.043862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03a727-948f-4e7e-9c04-0ca1ee7cd3bb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:15.082735 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:15.113878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e8e74-cf18-441f-b651-ceb9449c4491 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:15.150586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae907270-4ae0-4e98-98d6-ccd7bb411591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:15.151549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae907270-4ae0-4e98-98d6-ccd7bb411591 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:15.152077 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae907270-4ae0-4e98-98d6-ccd7bb411591 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:15.152536 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae907270-4ae0-4e98-98d6-ccd7bb411591 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:15.153751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae907270-4ae0-4e98-98d6-ccd7bb411591 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:15.155415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae907270-4ae0-4e98-98d6-ccd7bb411591 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:15.175396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03a727-948f-4e7e-9c04-0ca1ee7cd3bb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:15.211847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d966976-7c87-40d9-b7e1-5d25907d0b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:15.212496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d966976-7c87-40d9-b7e1-5d25907d0b4b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:15.212774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d966976-7c87-40d9-b7e1-5d25907d0b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:15.213044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d966976-7c87-40d9-b7e1-5d25907d0b4b None admin] PATH_INFO: `/v3/users/8eba086975f04013962d3c1a2f5313ad` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:15.226401 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d966976-7c87-40d9-b7e1-5d25907d0b4b None admin] RBAC: Authorizing `identity:get_user(user_id=8eba086975f04013962d3c1a2f5313ad)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:15.227800 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d966976-7c87-40d9-b7e1-5d25907d0b4b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:15.229600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 137/279] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:15 2022] GET /identity/v3/users/8eba086975f04013962d3c1a2f5313ad => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:15.234983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d966976-7c87-40d9-b7e1-5d25907d0b4b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:15.257777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 143/280] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:11:14 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:11:15.270640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae907270-4ae0-4e98-98d6-ccd7bb411591 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:15.275602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:15.353646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d966976-7c87-40d9-b7e1-5d25907d0b4b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:15.392715 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c2a5f-24d0-4769-a31a-e97f6cc6510b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:15.393377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c2a5f-24d0-4769-a31a-e97f6cc6510b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:15.393663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c2a5f-24d0-4769-a31a-e97f6cc6510b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:15.393933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c2a5f-24d0-4769-a31a-e97f6cc6510b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:15.394661 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c2a5f-24d0-4769-a31a-e97f6cc6510b None admin] RBAC: Adding query filter params (role.id=367ec0d2bcdc49f09b0772bbd737e5ce, user.id=8eba086975f04013962d3c1a2f5313ad, scope.system=all) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:15.394968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c2a5f-24d0-4769-a31a-e97f6cc6510b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:15.396436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c2a5f-24d0-4769-a31a-e97f6cc6510b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:15.402525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 138/281] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Sep 13 03:11:15 2022] GET /identity/v3/role_assignments?user.id=8eba086975f04013962d3c1a2f5313ad&scope.system=all&role.id=367ec0d2bcdc49f09b0772bbd737e5ce => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:15.428810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae907270-4ae0-4e98-98d6-ccd7bb411591 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:15.464399 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:15.473169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9a281-4a78-40cf-bfdd-131880a10089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:15.476824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9a281-4a78-40cf-bfdd-131880a10089 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:15.476824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9a281-4a78-40cf-bfdd-131880a10089 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:15.476824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9a281-4a78-40cf-bfdd-131880a10089 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:15.488653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9a281-4a78-40cf-bfdd-131880a10089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-00d9a281-4a78-40cf-bfdd-131880a10089 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:15.493886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:15.495182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:15.496143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:15.496143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:15.496143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:15.496143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:15.496143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:15.496143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:15.496143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:15.496143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:15.496143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:15.496143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:15.496143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:15.496143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:15.498611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 144/282] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:15.503790 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c2a5f-24d0-4769-a31a-e97f6cc6510b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:15.615830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:15.622821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c2a5f-24d0-4769-a31a-e97f6cc6510b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:15.664194 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0becc55-ace3-45df-9b69-8fcbc21c9699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:15.664968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0becc55-ace3-45df-9b69-8fcbc21c9699 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:15.665411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0becc55-ace3-45df-9b69-8fcbc21c9699 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:15.665803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0becc55-ace3-45df-9b69-8fcbc21c9699 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:15.666469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0becc55-ace3-45df-9b69-8fcbc21c9699 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:15.666768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0becc55-ace3-45df-9b69-8fcbc21c9699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:15.668144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0becc55-ace3-45df-9b69-8fcbc21c9699 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:15.678115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 139/283] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:15.683783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9a281-4a78-40cf-bfdd-131880a10089 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:15.809042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9a281-4a78-40cf-bfdd-131880a10089 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:15.845376 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4b3d6-cf9b-4871-bc92-31831adc150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:15.846067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4b3d6-cf9b-4871-bc92-31831adc150f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:15.846349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4b3d6-cf9b-4871-bc92-31831adc150f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:15.846623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4b3d6-cf9b-4871-bc92-31831adc150f None admin] PATH_INFO: `/v3/users/373a5d7503a546a3aa5dfe41e79182ee` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:15.847829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4b3d6-cf9b-4871-bc92-31831adc150f None admin] RBAC: Authorizing `identity:get_user(user_id=373a5d7503a546a3aa5dfe41e79182ee)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:15.849426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4b3d6-cf9b-4871-bc92-31831adc150f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:15.851429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 145/284] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:15 2022] GET /identity/v3/users/373a5d7503a546a3aa5dfe41e79182ee => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:15.857688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0becc55-ace3-45df-9b69-8fcbc21c9699 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:15.978737 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0becc55-ace3-45df-9b69-8fcbc21c9699 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:15.992233 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a28024-8dae-4a82-9803-523bfbbfdd2f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:15.993092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a28024-8dae-4a82-9803-523bfbbfdd2f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:15.993547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a28024-8dae-4a82-9803-523bfbbfdd2f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:15.995243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 146/285] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:16.000919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d4b2-e63d-41ac-ba80-84769e703261 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:16.001482 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d4b2-e63d-41ac-ba80-84769e703261 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:16.001958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d4b2-e63d-41ac-ba80-84769e703261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:16.022116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1631d4b2-e63d-41ac-ba80-84769e703261 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:16.023287 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1631d4b2-e63d-41ac-ba80-84769e703261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:16.032682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d31223-d93c-4d9e-92b6-94ea6f4ba679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:16.033359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d31223-d93c-4d9e-92b6-94ea6f4ba679 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:16.034187 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d31223-d93c-4d9e-92b6-94ea6f4ba679 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:16.034483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d31223-d93c-4d9e-92b6-94ea6f4ba679 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:16.035734 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d31223-d93c-4d9e-92b6-94ea6f4ba679 None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:16.038180 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d31223-d93c-4d9e-92b6-94ea6f4ba679 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:16.045638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 140/286] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:15 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:16.046507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d31223-d93c-4d9e-92b6-94ea6f4ba679 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:16.084294 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:16.144413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:16.168784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d31223-d93c-4d9e-92b6-94ea6f4ba679 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:16.199156 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 147/287] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:16.212769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f36a9d-c515-4ca2-9e76-6d094fce2e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:16.213517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f36a9d-c515-4ca2-9e76-6d094fce2e28 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:16.213792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f36a9d-c515-4ca2-9e76-6d094fce2e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:16.214060 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f36a9d-c515-4ca2-9e76-6d094fce2e28 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa/users/373a5d7503a546a3aa5dfe41e79182ee/roles/c924ec18040e4cc4b55053391fd47e8a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:16.216493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f36a9d-c515-4ca2-9e76-6d094fce2e28 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0b8022912c4451aa812e06166168cfa, user_id=373a5d7503a546a3aa5dfe41e79182ee, role_id=c924ec18040e4cc4b55053391fd47e8a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:16.217976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f36a9d-c515-4ca2-9e76-6d094fce2e28 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:16.296117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 141/288] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:11:16 2022] PUT /identity/v3/projects/f0b8022912c4451aa812e06166168cfa/users/373a5d7503a546a3aa5dfe41e79182ee/roles/c924ec18040e4cc4b55053391fd47e8a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:16.532949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d4b2-e63d-41ac-ba80-84769e703261 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:16.640116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d4b2-e63d-41ac-ba80-84769e703261 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:16.682838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b6c96-8f14-41c5-b652-9c670e89b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:16.683469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b6c96-8f14-41c5-b652-9c670e89b01e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:16.683743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b6c96-8f14-41c5-b652-9c670e89b01e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:16.684010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b6c96-8f14-41c5-b652-9c670e89b01e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:16.699092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b6c96-8f14-41c5-b652-9c670e89b01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-532b6c96-8f14-41c5-b652-9c670e89b01e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:16.704506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:16.705406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:16.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:16.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:16.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:16.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:16.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:16.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:16.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:16.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:16.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:16.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:16.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:16.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:16.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 148/289] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:16.711491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f36a9d-c515-4ca2-9e76-6d094fce2e28 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:16.847809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:16.865528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f36a9d-c515-4ca2-9e76-6d094fce2e28 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:16.905193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d236c-a0ed-48f7-aca4-3fb2650d3ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:16.905827 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d236c-a0ed-48f7-aca4-3fb2650d3ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:16.906101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d236c-a0ed-48f7-aca4-3fb2650d3ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:16.906377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d236c-a0ed-48f7-aca4-3fb2650d3ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:16.907103 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d236c-a0ed-48f7-aca4-3fb2650d3ef6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:16.907408 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d236c-a0ed-48f7-aca4-3fb2650d3ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:16.908801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d236c-a0ed-48f7-aca4-3fb2650d3ef6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:16.918077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 142/290] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:16.924027 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b6c96-8f14-41c5-b652-9c670e89b01e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:16.985944 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:17.053931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b6c96-8f14-41c5-b652-9c670e89b01e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:17.100242 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1e0a7-7576-4a7d-b6eb-712ca772c188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:17.100804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1e0a7-7576-4a7d-b6eb-712ca772c188 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:17.101081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1e0a7-7576-4a7d-b6eb-712ca772c188 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:17.101378 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1e0a7-7576-4a7d-b6eb-712ca772c188 None admin] PATH_INFO: `/v3/users/c9f1316931824400abfd5b43d60d275d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:17.102526 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1e0a7-7576-4a7d-b6eb-712ca772c188 None admin] RBAC: Authorizing `identity:get_user(user_id=c9f1316931824400abfd5b43d60d275d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:17.104064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1e0a7-7576-4a7d-b6eb-712ca772c188 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:17.105851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 149/291] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:16 2022] GET /identity/v3/users/c9f1316931824400abfd5b43d60d275d => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:17.111799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d236c-a0ed-48f7-aca4-3fb2650d3ef6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:17.232797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d236c-a0ed-48f7-aca4-3fb2650d3ef6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:17.272763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa7792-db26-4980-a515-b6b67a997f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:17.273413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa7792-db26-4980-a515-b6b67a997f27 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:17.273694 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa7792-db26-4980-a515-b6b67a997f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:17.273966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa7792-db26-4980-a515-b6b67a997f27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:17.297045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:17.353406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa7792-db26-4980-a515-b6b67a997f27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:17.355234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa7792-db26-4980-a515-b6b67a997f27 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:17.456928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 143/292] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:17.462089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1e0a7-7576-4a7d-b6eb-712ca772c188 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:17.600489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1e0a7-7576-4a7d-b6eb-712ca772c188 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:17.614718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:17.635976 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ac639-2461-457f-8e15-ef3132a48ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:17.636615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ac639-2461-457f-8e15-ef3132a48ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:17.636958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ac639-2461-457f-8e15-ef3132a48ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:17.637167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ac639-2461-457f-8e15-ef3132a48ae5 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:17.638613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ac639-2461-457f-8e15-ef3132a48ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:17.640053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ac639-2461-457f-8e15-ef3132a48ae5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:17.642074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 150/293] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:17 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:17.647628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa7792-db26-4980-a515-b6b67a997f27 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:17.713695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:17.769041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa7792-db26-4980-a515-b6b67a997f27 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:17.808174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51642aba-8ba8-4f18-9af8-33b88825177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:17.808780 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51642aba-8ba8-4f18-9af8-33b88825177c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:17.809057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51642aba-8ba8-4f18-9af8-33b88825177c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:17.809472 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51642aba-8ba8-4f18-9af8-33b88825177c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:17.810209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51642aba-8ba8-4f18-9af8-33b88825177c None admin] RBAC: Adding query filter params (role.id=367ec0d2bcdc49f09b0772bbd737e5ce, scope.project.id=f0b8022912c4451aa812e06166168cfa, user.id=c9f1316931824400abfd5b43d60d275d) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:17.810515 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51642aba-8ba8-4f18-9af8-33b88825177c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:17.811958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51642aba-8ba8-4f18-9af8-33b88825177c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:17.818345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 144/294] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:17 2022] GET /identity/v3/role_assignments?user.id=c9f1316931824400abfd5b43d60d275d&scope.project.id=f0b8022912c4451aa812e06166168cfa&role.id=367ec0d2bcdc49f09b0772bbd737e5ce => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:17.934001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572e398-4537-4b8b-b9fd-ae0c258baad6 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:17.934681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572e398-4537-4b8b-b9fd-ae0c258baad6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:17.935185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572e398-4537-4b8b-b9fd-ae0c258baad6 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:17.937304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 151/295] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:17.943615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98878b7f-0c4e-4f8a-994a-7a39c0511b1a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:17.943898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98878b7f-0c4e-4f8a-994a-7a39c0511b1a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:17.944176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98878b7f-0c4e-4f8a-994a-7a39c0511b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:17.990439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-98878b7f-0c4e-4f8a-994a-7a39c0511b1a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:17.991680 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-98878b7f-0c4e-4f8a-994a-7a39c0511b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:18.073798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 145/296] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:18.332294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03350d7-0f9d-4a2e-a536-96e3e47b71ba None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:18.333279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03350d7-0f9d-4a2e-a536-96e3e47b71ba None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:18.333784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03350d7-0f9d-4a2e-a536-96e3e47b71ba None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:18.335593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 152/297] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:18.341136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5469-d946-474e-847e-a4dea25f3bff None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:18.341590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5469-d946-474e-847e-a4dea25f3bff None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:18.341772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5469-d946-474e-847e-a4dea25f3bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:18.362195 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03350d7-0f9d-4a2e-a536-96e3e47b71ba None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:18.364249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f01b5469-d946-474e-847e-a4dea25f3bff None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:18.365478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f01b5469-d946-474e-847e-a4dea25f3bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:18.412536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:18.443603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 146/298] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:18.444746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac21d5e-5619-484f-b4f4-978426436d20 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:18.445030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac21d5e-5619-484f-b4f4-978426436d20 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:18.445326 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac21d5e-5619-484f-b4f4-978426436d20 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:18.446567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 147/299] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:18.452527 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e9462-b6a0-4d35-84a2-f255678e4a12 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:18.452810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e9462-b6a0-4d35-84a2-f255678e4a12 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:18.453082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e9462-b6a0-4d35-84a2-f255678e4a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:18.476005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03350d7-0f9d-4a2e-a536-96e3e47b71ba None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:18.479907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bb5e9462-b6a0-4d35-84a2-f255678e4a12 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:18.481189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bb5e9462-b6a0-4d35-84a2-f255678e4a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:18.512759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21930fb1-08dd-4180-8eac-2d6edbdb0647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:18.513748 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21930fb1-08dd-4180-8eac-2d6edbdb0647 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:18.514072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21930fb1-08dd-4180-8eac-2d6edbdb0647 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:18.514352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21930fb1-08dd-4180-8eac-2d6edbdb0647 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:18.525162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21930fb1-08dd-4180-8eac-2d6edbdb0647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-21930fb1-08dd-4180-8eac-2d6edbdb0647 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:18.530486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:18.531375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:18.532173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:18.532173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:18.532173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:18.532173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:18.532173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:18.532173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:18.532173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:18.532173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:18.532173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:18.532173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:18.532173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:18.532173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:18.532173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 153/300] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:18.537590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21930fb1-08dd-4180-8eac-2d6edbdb0647 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:18.565419 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 148/301] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:18.593779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:18.649517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21930fb1-08dd-4180-8eac-2d6edbdb0647 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:18.685155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ceaf3-5b86-416a-8c76-f8c4f59ecd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:18.685800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ceaf3-5b86-416a-8c76-f8c4f59ecd84 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:18.686133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ceaf3-5b86-416a-8c76-f8c4f59ecd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:18.686404 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ceaf3-5b86-416a-8c76-f8c4f59ecd84 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:18.687128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ceaf3-5b86-416a-8c76-f8c4f59ecd84 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:18.687431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ceaf3-5b86-416a-8c76-f8c4f59ecd84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:18.688811 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ceaf3-5b86-416a-8c76-f8c4f59ecd84 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:18.702385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 154/302] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:18.703894 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e9462-b6a0-4d35-84a2-f255678e4a12 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:18.725612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ceaf3-5b86-416a-8c76-f8c4f59ecd84 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:18.825548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e9462-b6a0-4d35-84a2-f255678e4a12 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:18.828025 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:18.836236 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ceaf3-5b86-416a-8c76-f8c4f59ecd84 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:18.838022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:18.871089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49826e64-ce29-40f0-bacf-2f342c40112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:18.871602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49826e64-ce29-40f0-bacf-2f342c40112c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:18.871914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49826e64-ce29-40f0-bacf-2f342c40112c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:18.872200 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49826e64-ce29-40f0-bacf-2f342c40112c None admin] PATH_INFO: `/v3/users/9601d0c659554b46b875285a97df94c1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:18.872913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df412d0-3e79-4efa-a627-a9590bb509e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:18.873584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df412d0-3e79-4efa-a627-a9590bb509e6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:18.873866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df412d0-3e79-4efa-a627-a9590bb509e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:18.874141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df412d0-3e79-4efa-a627-a9590bb509e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:18.887495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49826e64-ce29-40f0-bacf-2f342c40112c None admin] RBAC: Authorizing `identity:get_user(user_id=9601d0c659554b46b875285a97df94c1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:18.889576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df412d0-3e79-4efa-a627-a9590bb509e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:18.889713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49826e64-ce29-40f0-bacf-2f342c40112c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-1df412d0-3e79-4efa-a627-a9590bb509e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:18.894593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:18.895464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:18.896257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:18.896257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:18.896257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:18.896257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:18.896257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:18.896257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:18.896257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:18.896257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:18.896257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:18.896257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:18.896257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:18.896257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:18.896854 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 149/304] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:18 2022] GET /identity/v3/users/9601d0c659554b46b875285a97df94c1 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:18.897847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49826e64-ce29-40f0-bacf-2f342c40112c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:18.900506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 155/304] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:18.901541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df412d0-3e79-4efa-a627-a9590bb509e6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:19.011970 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49826e64-ce29-40f0-bacf-2f342c40112c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:19.012169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df412d0-3e79-4efa-a627-a9590bb509e6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:19.049127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef308590-30c8-45b9-913b-924f0c47c908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:19.049770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef308590-30c8-45b9-913b-924f0c47c908 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:19.050048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef308590-30c8-45b9-913b-924f0c47c908 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:19.050149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd4009-5588-4463-b2c8-8f2aed1c85f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:19.050321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef308590-30c8-45b9-913b-924f0c47c908 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:19.050721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd4009-5588-4463-b2c8-8f2aed1c85f2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:19.050971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef308590-30c8-45b9-913b-924f0c47c908 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:19.051065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd4009-5588-4463-b2c8-8f2aed1c85f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:19.051259 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd4009-5588-4463-b2c8-8f2aed1c85f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:19.051361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef308590-30c8-45b9-913b-924f0c47c908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:19.051982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd4009-5588-4463-b2c8-8f2aed1c85f2 None admin] RBAC: Adding query filter params (role.id=c924ec18040e4cc4b55053391fd47e8a, user.id=9601d0c659554b46b875285a97df94c1, scope.system=all) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:19.052290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd4009-5588-4463-b2c8-8f2aed1c85f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:19.052633 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef308590-30c8-45b9-913b-924f0c47c908 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:19.053754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd4009-5588-4463-b2c8-8f2aed1c85f2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:19.060091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 150/305] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Sep 13 03:11:18 2022] GET /identity/v3/role_assignments?user.id=9601d0c659554b46b875285a97df94c1&scope.system=all&role.id=c924ec18040e4cc4b55053391fd47e8a => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:19.060938 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd4009-5588-4463-b2c8-8f2aed1c85f2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:19.066190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 156/306] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:19.066190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1246d-3d1b-46b6-b022-3acf1173ce5e None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:19.066190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1246d-3d1b-46b6-b022-3acf1173ce5e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:19.066190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1246d-3d1b-46b6-b022-3acf1173ce5e None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:19.066190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 157/307] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:19.067114 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1246d-3d1b-46b6-b022-3acf1173ce5e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:19.096935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:19.103237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:19.185511 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1246d-3d1b-46b6-b022-3acf1173ce5e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:19.191611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd4009-5588-4463-b2c8-8f2aed1c85f2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:19.223332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881ce12-5b8f-4772-999c-144ee51cdf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:19.223975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881ce12-5b8f-4772-999c-144ee51cdf23 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:19.224255 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881ce12-5b8f-4772-999c-144ee51cdf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:19.224531 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881ce12-5b8f-4772-999c-144ee51cdf23 None admin] PATH_INFO: `/v3/users/8eba086975f04013962d3c1a2f5313ad` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:19.225722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881ce12-5b8f-4772-999c-144ee51cdf23 None admin] RBAC: Authorizing `identity:get_user(user_id=8eba086975f04013962d3c1a2f5313ad)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:19.227173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881ce12-5b8f-4772-999c-144ee51cdf23 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:19.228770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 158/308] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:19 2022] GET /identity/v3/users/8eba086975f04013962d3c1a2f5313ad => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:19.229143 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e320f-b0e9-487d-9dd4-af6aff331d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:19.229950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e320f-b0e9-487d-9dd4-af6aff331d0b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:19.230063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4eed2-90fb-4dbd-98b6-dbccef4f75ed None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:19.230260 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4eed2-90fb-4dbd-98b6-dbccef4f75ed None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:19.230530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4eed2-90fb-4dbd-98b6-dbccef4f75ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:19.230750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e320f-b0e9-487d-9dd4-af6aff331d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:19.231141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e320f-b0e9-487d-9dd4-af6aff331d0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:19.232944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e320f-b0e9-487d-9dd4-af6aff331d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:19.235417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e320f-b0e9-487d-9dd4-af6aff331d0b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:19.237284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 151/309] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:19.238273 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e320f-b0e9-487d-9dd4-af6aff331d0b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:19.253701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-17b4eed2-90fb-4dbd-98b6-dbccef4f75ed None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:19.254883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-17b4eed2-90fb-4dbd-98b6-dbccef4f75ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:19.328229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 159/310] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:19.329051 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4eed2-90fb-4dbd-98b6-dbccef4f75ed None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:19.351406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:19.355823 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e320f-b0e9-487d-9dd4-af6aff331d0b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:19.360450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:19.407568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512e2ad-5bc9-404e-899b-650a9828da46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:19.408322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512e2ad-5bc9-404e-899b-650a9828da46 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:19.408669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512e2ad-5bc9-404e-899b-650a9828da46 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:19.409032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512e2ad-5bc9-404e-899b-650a9828da46 None admin] PATH_INFO: `/v3/system/users/8eba086975f04013962d3c1a2f5313ad/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:19.410524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512e2ad-5bc9-404e-899b-650a9828da46 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8eba086975f04013962d3c1a2f5313ad, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:19.411996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512e2ad-5bc9-404e-899b-650a9828da46 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:19.447486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4eed2-90fb-4dbd-98b6-dbccef4f75ed None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:19.485954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c555c9-5c8c-4dff-afdf-d7af2c663f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:19.486896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c555c9-5c8c-4dff-afdf-d7af2c663f9b None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:19.487352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c555c9-5c8c-4dff-afdf-d7af2c663f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:19.487909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c555c9-5c8c-4dff-afdf-d7af2c663f9b None admin] PATH_INFO: `/v3/groups` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:19.488785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c555c9-5c8c-4dff-afdf-d7af2c663f9b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:19.490434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c555c9-5c8c-4dff-afdf-d7af2c663f9b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:19.513317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 152/311] 10.222.0.48 () {58 vars in 1334 bytes} [Tue Sep 13 03:11:19 2022] PUT /identity/v3/system/users/8eba086975f04013962d3c1a2f5313ad/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:19.567561 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 160/312] 10.222.0.48 () {60 vars in 1134 bytes} [Tue Sep 13 03:11:19 2022] POST /identity/v3/groups => generated 229 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:11:19.610944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512e2ad-5bc9-404e-899b-650a9828da46 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:19.732847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512e2ad-5bc9-404e-899b-650a9828da46 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:19.771036 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a4ef2-efa6-42ee-aff7-22d7fc906a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:19.771681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a4ef2-efa6-42ee-aff7-22d7fc906a06 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:19.771959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a4ef2-efa6-42ee-aff7-22d7fc906a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:19.772230 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a4ef2-efa6-42ee-aff7-22d7fc906a06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:19.783641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a4ef2-efa6-42ee-aff7-22d7fc906a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a05a4ef2-efa6-42ee-aff7-22d7fc906a06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:19.789003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:19.789953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:19.791056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:19.791056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:19.791056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:19.791056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:19.791056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:19.791056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:19.791056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:19.791056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:19.791056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:19.791056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:19.791056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:19.791056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:19.791056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 153/313] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:19.798963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c555c9-5c8c-4dff-afdf-d7af2c663f9b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:19.891674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:19.910505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c555c9-5c8c-4dff-afdf-d7af2c663f9b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:19.946534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344c20c-e330-4858-9294-9cbff3e7a063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:19.947175 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344c20c-e330-4858-9294-9cbff3e7a063 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:19.947839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344c20c-e330-4858-9294-9cbff3e7a063 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:19.948479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344c20c-e330-4858-9294-9cbff3e7a063 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:19.949433 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344c20c-e330-4858-9294-9cbff3e7a063 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:19.950323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344c20c-e330-4858-9294-9cbff3e7a063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:19.952105 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344c20c-e330-4858-9294-9cbff3e7a063 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:19.965373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 161/314] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:19.968235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a4ef2-efa6-42ee-aff7-22d7fc906a06 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:19.992429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:20.072517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a4ef2-efa6-42ee-aff7-22d7fc906a06 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:20.107932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957d227-bdf6-4a2e-b9e7-e318dec48c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:20.108562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957d227-bdf6-4a2e-b9e7-e318dec48c0f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:20.108840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957d227-bdf6-4a2e-b9e7-e318dec48c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:20.109113 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957d227-bdf6-4a2e-b9e7-e318dec48c0f None admin] PATH_INFO: `/v3/users/373a5d7503a546a3aa5dfe41e79182ee` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:20.110292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957d227-bdf6-4a2e-b9e7-e318dec48c0f None admin] RBAC: Authorizing `identity:get_user(user_id=373a5d7503a546a3aa5dfe41e79182ee)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:20.111739 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957d227-bdf6-4a2e-b9e7-e318dec48c0f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:20.113510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 154/315] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:19 2022] GET /identity/v3/users/373a5d7503a546a3aa5dfe41e79182ee => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:20.119021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344c20c-e330-4858-9294-9cbff3e7a063 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:20.225553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344c20c-e330-4858-9294-9cbff3e7a063 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:20.265700 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60131e-4a82-4257-9d63-2d8d596a39e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:20.266229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60131e-4a82-4257-9d63-2d8d596a39e9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:20.266504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60131e-4a82-4257-9d63-2d8d596a39e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:20.266775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60131e-4a82-4257-9d63-2d8d596a39e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:20.282240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:20.339112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60131e-4a82-4257-9d63-2d8d596a39e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:20.341243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60131e-4a82-4257-9d63-2d8d596a39e9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:20.443580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 162/316] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:20.449078 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957d227-bdf6-4a2e-b9e7-e318dec48c0f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:20.539456 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:20.554940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957d227-bdf6-4a2e-b9e7-e318dec48c0f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:20.589727 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b599d72-04b6-44d1-a5f3-d47c87b88cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:20.591108 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b599d72-04b6-44d1-a5f3-d47c87b88cbd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:20.591387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b599d72-04b6-44d1-a5f3-d47c87b88cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:20.591668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b599d72-04b6-44d1-a5f3-d47c87b88cbd None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:20.592841 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b599d72-04b6-44d1-a5f3-d47c87b88cbd None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:20.594312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b599d72-04b6-44d1-a5f3-d47c87b88cbd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:20.600818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 155/317] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:20 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:20.602205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60131e-4a82-4257-9d63-2d8d596a39e9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:20.652159 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:20.707854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60131e-4a82-4257-9d63-2d8d596a39e9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:20.743584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048a043-0c38-40a6-8a13-330566eee569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:20.744196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048a043-0c38-40a6-8a13-330566eee569 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:20.744473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048a043-0c38-40a6-8a13-330566eee569 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:20.744746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048a043-0c38-40a6-8a13-330566eee569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:20.745543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048a043-0c38-40a6-8a13-330566eee569 None admin] RBAC: Adding query filter params (role.id=c924ec18040e4cc4b55053391fd47e8a, scope.project.id=f0b8022912c4451aa812e06166168cfa, user.id=373a5d7503a546a3aa5dfe41e79182ee) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:20.745852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048a043-0c38-40a6-8a13-330566eee569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:20.747933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048a043-0c38-40a6-8a13-330566eee569 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:20.761415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 163/318] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:20 2022] GET /identity/v3/role_assignments?user.id=373a5d7503a546a3aa5dfe41e79182ee&scope.project.id=f0b8022912c4451aa812e06166168cfa&role.id=c924ec18040e4cc4b55053391fd47e8a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:21.235310 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ef7ff-e56e-4dae-8f08-8bdb562a1e24 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:21.235632 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ef7ff-e56e-4dae-8f08-8bdb562a1e24 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:21.235862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ef7ff-e56e-4dae-8f08-8bdb562a1e24 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:21.237374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 156/319] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:21.242306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d4565-2b3e-4bc7-9d1b-8f407be2585c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:21.242593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d4565-2b3e-4bc7-9d1b-8f407be2585c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:21.242873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d4565-2b3e-4bc7-9d1b-8f407be2585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:21.260514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f23d4565-2b3e-4bc7-9d1b-8f407be2585c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:21.261711 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f23d4565-2b3e-4bc7-9d1b-8f407be2585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:21.330022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 164/320] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:21.595666 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ef7ff-e56e-4dae-8f08-8bdb562a1e24 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:21.701641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ef7ff-e56e-4dae-8f08-8bdb562a1e24 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:21.734958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a225c-9b8f-4b66-a8f9-a4061a3a0227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:21.735588 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a225c-9b8f-4b66-a8f9-a4061a3a0227 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:21.735865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a225c-9b8f-4b66-a8f9-a4061a3a0227 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:21.736134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a225c-9b8f-4b66-a8f9-a4061a3a0227 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:21.746196 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a225c-9b8f-4b66-a8f9-a4061a3a0227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-1c1a225c-9b8f-4b66-a8f9-a4061a3a0227 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:21.751495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:21.752354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:21.753164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:21.753164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:21.753164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:21.753164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:21.753164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:21.753164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:21.753164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:21.753164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:21.753164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:21.753164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:21.753164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:21.753164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:21.754537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 157/321] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:21.758346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d4565-2b3e-4bc7-9d1b-8f407be2585c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:21.773028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75649f71-4ded-4d8a-832f-2c36dc813af6 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:21.773446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75649f71-4ded-4d8a-832f-2c36dc813af6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:21.773636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75649f71-4ded-4d8a-832f-2c36dc813af6 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:21.775228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 158/322] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:11:21.780810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ac97f-4ef1-47fa-ba8d-52dd39eea930 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:21.781091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ac97f-4ef1-47fa-ba8d-52dd39eea930 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:21.781402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ac97f-4ef1-47fa-ba8d-52dd39eea930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:21.800793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4e5ac97f-4ef1-47fa-ba8d-52dd39eea930 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:21.802063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4e5ac97f-4ef1-47fa-ba8d-52dd39eea930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:21.802207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:21.810697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:21.869742 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d4565-2b3e-4bc7-9d1b-8f407be2585c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:21.879599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 159/323] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:21.906515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4e840-a97c-4e60-bd72-b54ff5883ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:21.907134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4e840-a97c-4e60-bd72-b54ff5883ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:21.907412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4e840-a97c-4e60-bd72-b54ff5883ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:21.907683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4e840-a97c-4e60-bd72-b54ff5883ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:21.908389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4e840-a97c-4e60-bd72-b54ff5883ff9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:21.908637 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4e840-a97c-4e60-bd72-b54ff5883ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:21.910096 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4e840-a97c-4e60-bd72-b54ff5883ff9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:21.917557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c54d9-dcfa-45e6-a835-705bfa346396 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:21.917839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c54d9-dcfa-45e6-a835-705bfa346396 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:21.918105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c54d9-dcfa-45e6-a835-705bfa346396 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:21.923161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 165/324] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:21.923278 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 160/325] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:11:21.924501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8f8d6-090d-4d72-872b-a8b81761665b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:21.924787 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8f8d6-090d-4d72-872b-a8b81761665b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:21.924897 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c54d9-dcfa-45e6-a835-705bfa346396 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:21.925052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8f8d6-090d-4d72-872b-a8b81761665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:21.944599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b5c8f8d6-090d-4d72-872b-a8b81761665b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:21.945792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b5c8f8d6-090d-4d72-872b-a8b81761665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:22.018017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 166/326] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:22.040180 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c54d9-dcfa-45e6-a835-705bfa346396 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:22.074300 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115470c-025d-4297-8366-bb1ef548f4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:22.075453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115470c-025d-4297-8366-bb1ef548f4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:22.075782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115470c-025d-4297-8366-bb1ef548f4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:22.076051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115470c-025d-4297-8366-bb1ef548f4e4 None admin] PATH_INFO: `/v3/users/9601d0c659554b46b875285a97df94c1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:22.077205 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115470c-025d-4297-8366-bb1ef548f4e4 None admin] RBAC: Authorizing `identity:get_user(user_id=9601d0c659554b46b875285a97df94c1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:22.078716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115470c-025d-4297-8366-bb1ef548f4e4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:22.080421 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 161/327] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:21 2022] GET /identity/v3/users/9601d0c659554b46b875285a97df94c1 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:22.086004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8f8d6-090d-4d72-872b-a8b81761665b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:22.116351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:22.146239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115470c-025d-4297-8366-bb1ef548f4e4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:22.163325 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:22.192579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8f8d6-090d-4d72-872b-a8b81761665b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:22.227311 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b19e0-8d96-45df-87e6-ee228dc0095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:22.227960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b19e0-8d96-45df-87e6-ee228dc0095e None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:22.228240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b19e0-8d96-45df-87e6-ee228dc0095e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:22.228514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b19e0-8d96-45df-87e6-ee228dc0095e None admin] PATH_INFO: `/v3/system/users/9601d0c659554b46b875285a97df94c1/roles/c924ec18040e4cc4b55053391fd47e8a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:22.229940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b19e0-8d96-45df-87e6-ee228dc0095e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9601d0c659554b46b875285a97df94c1, role_id=c924ec18040e4cc4b55053391fd47e8a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:22.231854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b19e0-8d96-45df-87e6-ee228dc0095e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:22.256413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115470c-025d-4297-8366-bb1ef548f4e4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:22.289914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7701259-c24e-484d-9e90-5d0a39183721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:22.290529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7701259-c24e-484d-9e90-5d0a39183721 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:22.290800 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7701259-c24e-484d-9e90-5d0a39183721 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:22.291063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7701259-c24e-484d-9e90-5d0a39183721 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:22.296454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 167/328] 10.222.0.48 () {58 vars in 1334 bytes} [Tue Sep 13 03:11:22 2022] PUT /identity/v3/system/users/9601d0c659554b46b875285a97df94c1/roles/c924ec18040e4cc4b55053391fd47e8a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:22.297347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b19e0-8d96-45df-87e6-ee228dc0095e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:22.303619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7701259-c24e-484d-9e90-5d0a39183721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-c7701259-c24e-484d-9e90-5d0a39183721 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:22.308641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:22.310663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:22.311457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:22.311457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:22.311457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:22.311457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:22.311457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:22.311457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:22.311457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:22.311457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:22.311457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:22.311457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:22.311457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:22.311457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:22.311457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 162/329] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:22.318389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7701259-c24e-484d-9e90-5d0a39183721 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:22.396661 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:22.425017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:22.434783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b19e0-8d96-45df-87e6-ee228dc0095e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:22.435238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7701259-c24e-484d-9e90-5d0a39183721 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:22.475427 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6105e-4664-4322-ad25-1e3647569ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:22.476062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6105e-4664-4322-ad25-1e3647569ebf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:22.476337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6105e-4664-4322-ad25-1e3647569ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:22.476670 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6105e-4664-4322-ad25-1e3647569ebf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:22.477829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6105e-4664-4322-ad25-1e3647569ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:22.478329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36449f8-7d95-43f9-a7c2-7283aa60f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:22.479178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36449f8-7d95-43f9-a7c2-7283aa60f4bd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:22.479178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36449f8-7d95-43f9-a7c2-7283aa60f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:22.479351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6105e-4664-4322-ad25-1e3647569ebf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:22.479514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36449f8-7d95-43f9-a7c2-7283aa60f4bd None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:22.480115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36449f8-7d95-43f9-a7c2-7283aa60f4bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:22.480417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36449f8-7d95-43f9-a7c2-7283aa60f4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:22.481992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 168/330] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:22.482419 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36449f8-7d95-43f9-a7c2-7283aa60f4bd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:22.486869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6105e-4664-4322-ad25-1e3647569ebf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:22.491925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 163/331] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:22.498332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36449f8-7d95-43f9-a7c2-7283aa60f4bd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:22.594090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6105e-4664-4322-ad25-1e3647569ebf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:22.613782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36449f8-7d95-43f9-a7c2-7283aa60f4bd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:22.628208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249012fb-49e7-4bb5-adef-39ea8693832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:22.628808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249012fb-49e7-4bb5-adef-39ea8693832f None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:22.629081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249012fb-49e7-4bb5-adef-39ea8693832f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:22.629380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249012fb-49e7-4bb5-adef-39ea8693832f None admin] PATH_INFO: `/v3/groups` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:22.630005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249012fb-49e7-4bb5-adef-39ea8693832f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:22.631448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249012fb-49e7-4bb5-adef-39ea8693832f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:22.645106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:22.650051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c613d-2be9-4220-8822-abd61be22f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:22.650626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c613d-2be9-4220-8822-abd61be22f04 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:22.650900 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c613d-2be9-4220-8822-abd61be22f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:22.651170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c613d-2be9-4220-8822-abd61be22f04 None admin] PATH_INFO: `/v3/users/8eba086975f04013962d3c1a2f5313ad` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:22.652277 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c613d-2be9-4220-8822-abd61be22f04 None admin] RBAC: Authorizing `identity:get_user(user_id=8eba086975f04013962d3c1a2f5313ad)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:22.654282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c613d-2be9-4220-8822-abd61be22f04 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:22.656006 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 164/332] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:22 2022] GET /identity/v3/users/8eba086975f04013962d3c1a2f5313ad => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:22.661481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c613d-2be9-4220-8822-abd61be22f04 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:22.723853 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 169/333] 10.222.0.48 () {60 vars in 1134 bytes} [Tue Sep 13 03:11:22 2022] POST /identity/v3/groups => generated 226 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:11:22.764363 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c613d-2be9-4220-8822-abd61be22f04 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:22.803056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8736b-8303-4bd7-92ff-8c38d61f1fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:22.803678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8736b-8303-4bd7-92ff-8c38d61f1fac None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:22.804046 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8736b-8303-4bd7-92ff-8c38d61f1fac None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:22.804319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8736b-8303-4bd7-92ff-8c38d61f1fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:22.805064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8736b-8303-4bd7-92ff-8c38d61f1fac None admin] RBAC: Adding query filter params (role.id=367ec0d2bcdc49f09b0772bbd737e5ce, user.id=8eba086975f04013962d3c1a2f5313ad, scope.system=all) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:22.805404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8736b-8303-4bd7-92ff-8c38d61f1fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:22.806887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8736b-8303-4bd7-92ff-8c38d61f1fac None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:22.820051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 165/334] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Sep 13 03:11:22 2022] GET /identity/v3/role_assignments?user.id=8eba086975f04013962d3c1a2f5313ad&scope.system=all&role.id=367ec0d2bcdc49f09b0772bbd737e5ce => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:24.914497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c5d5f-553d-4bca-9e2a-5e47ce3a138e None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:24.914998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c5d5f-553d-4bca-9e2a-5e47ce3a138e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:24.915071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c5d5f-553d-4bca-9e2a-5e47ce3a138e None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:24.916595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 170/335] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:24.926492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d058-6359-40a9-8875-ed03d07b0864 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:24.926921 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d058-6359-40a9-8875-ed03d07b0864 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:24.927020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d058-6359-40a9-8875-ed03d07b0864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:24.951551 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2b47d058-6359-40a9-8875-ed03d07b0864 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:24.952755 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2b47d058-6359-40a9-8875-ed03d07b0864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:25.019805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:25.034502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 166/336] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:25.286601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f2d1e-cfb6-4e1c-99be-ed9467f8c70c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:25.286601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f2d1e-cfb6-4e1c-99be-ed9467f8c70c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:25.286601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f2d1e-cfb6-4e1c-99be-ed9467f8c70c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:25.287326 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 171/337] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:25.294574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a789c20-1f99-4d61-b79f-30f5d4bf2f69 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:25.295103 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a789c20-1f99-4d61-b79f-30f5d4bf2f69 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:25.295582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a789c20-1f99-4d61-b79f-30f5d4bf2f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:25.315559 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6a789c20-1f99-4d61-b79f-30f5d4bf2f69 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:25.317233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6a789c20-1f99-4d61-b79f-30f5d4bf2f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:25.390572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 167/338] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:25.616537 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f2d1e-cfb6-4e1c-99be-ed9467f8c70c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:25.644434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:25.754656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f2d1e-cfb6-4e1c-99be-ed9467f8c70c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:25.817985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb97b6-7e51-40ed-a24b-974a3332b023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:25.818627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb97b6-7e51-40ed-a24b-974a3332b023 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:25.818912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb97b6-7e51-40ed-a24b-974a3332b023 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:25.819184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb97b6-7e51-40ed-a24b-974a3332b023 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:25.821115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3e02-242b-459b-87d7-97afa1461b30 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:25.821426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3e02-242b-459b-87d7-97afa1461b30 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:25.821695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3e02-242b-459b-87d7-97afa1461b30 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:25.823163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 168/339] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:25.830402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee267cb1-169c-43bd-b8ef-cb52e39de88a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:25.830972 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee267cb1-169c-43bd-b8ef-cb52e39de88a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:25.831434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee267cb1-169c-43bd-b8ef-cb52e39de88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:25.842525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb97b6-7e51-40ed-a24b-974a3332b023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5afb97b6-7e51-40ed-a24b-974a3332b023 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:25.853756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:25.854674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:25.855463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:25.855463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:25.855463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:25.855463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:25.855463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:25.855463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:25.855463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:25.855463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:25.855463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:25.855463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:25.855463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 03:11:25.855463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:25.858101 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 172/340] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:25.859162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb97b6-7e51-40ed-a24b-974a3332b023 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:25.867132 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ee267cb1-169c-43bd-b8ef-cb52e39de88a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:25.868316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ee267cb1-169c-43bd-b8ef-cb52e39de88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:25.966557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 169/341] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:25.967313 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee267cb1-169c-43bd-b8ef-cb52e39de88a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:25.995063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:26.032963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb97b6-7e51-40ed-a24b-974a3332b023 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:26.071677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:26.098003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713ef9f-89cd-41e6-8637-99a6e9cd503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:26.098657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713ef9f-89cd-41e6-8637-99a6e9cd503f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:26.098941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713ef9f-89cd-41e6-8637-99a6e9cd503f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:26.099218 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713ef9f-89cd-41e6-8637-99a6e9cd503f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:26.123206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713ef9f-89cd-41e6-8637-99a6e9cd503f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b713ef9f-89cd-41e6-8637-99a6e9cd503f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:26.128557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:26.129470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:26.130271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:26.130271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:26.130271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:26.130271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:26.130271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:26.130271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:26.130271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:26.130271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:26.130271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:26.130271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:26.130271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:26.130271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:26.130271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 173/342] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:26.131481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481548e-08e6-494c-b7d3-04747dca34f6 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:26.131481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481548e-08e6-494c-b7d3-04747dca34f6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:26.131630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481548e-08e6-494c-b7d3-04747dca34f6 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:26.132907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 174/343] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:26.135980 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481548e-08e6-494c-b7d3-04747dca34f6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:26.142154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee267cb1-169c-43bd-b8ef-cb52e39de88a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:26.211232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e38696-ad04-41c5-b4e8-4dd81c8a4084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:26.212192 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e38696-ad04-41c5-b4e8-4dd81c8a4084 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:26.212701 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e38696-ad04-41c5-b4e8-4dd81c8a4084 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:26.213163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e38696-ad04-41c5-b4e8-4dd81c8a4084 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:26.214041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e38696-ad04-41c5-b4e8-4dd81c8a4084 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:26.214552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e38696-ad04-41c5-b4e8-4dd81c8a4084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:26.216327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e38696-ad04-41c5-b4e8-4dd81c8a4084 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:26.235564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 170/344] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:26.236658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0400516-0117-4779-84c1-0511824c64ee None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:26.236937 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0400516-0117-4779-84c1-0511824c64ee None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:26.237207 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0400516-0117-4779-84c1-0511824c64ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:26.266912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e0400516-0117-4779-84c1-0511824c64ee None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:26.266912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e0400516-0117-4779-84c1-0511824c64ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:26.300862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481548e-08e6-494c-b7d3-04747dca34f6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:26.344298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f554ff-7cd8-4581-81e9-136306c554f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:26.345285 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f554ff-7cd8-4581-81e9-136306c554f2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:26.345755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f554ff-7cd8-4581-81e9-136306c554f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:26.346259 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f554ff-7cd8-4581-81e9-136306c554f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:26.347136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f554ff-7cd8-4581-81e9-136306c554f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:26.347608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f554ff-7cd8-4581-81e9-136306c554f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:26.349275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f554ff-7cd8-4581-81e9-136306c554f2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:26.359737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 175/345] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:26.360872 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f554ff-7cd8-4581-81e9-136306c554f2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:26.364732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:26.383569 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 171/346] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:26.383569 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0400516-0117-4779-84c1-0511824c64ee None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:26.422376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:26.507718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0400516-0117-4779-84c1-0511824c64ee None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:26.556125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f554ff-7cd8-4581-81e9-136306c554f2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:26.575425 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ebad3-ecb7-4c79-bc0b-ceb99cfd6313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:26.576060 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ebad3-ecb7-4c79-bc0b-ceb99cfd6313 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:26.576333 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ebad3-ecb7-4c79-bc0b-ceb99cfd6313 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:26.576601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ebad3-ecb7-4c79-bc0b-ceb99cfd6313 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:26.599480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ebad3-ecb7-4c79-bc0b-ceb99cfd6313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-961ebad3-ecb7-4c79-bc0b-ceb99cfd6313 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:26.604523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:26.605623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:26.607010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:26.607010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:26.607010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:26.607010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:26.607010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:26.607010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:26.607010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:26.607010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:26.607010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:26.607010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:26.607010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:26.607010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:26.607010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 172/347] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:11:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:26.607720 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ebad3-ecb7-4c79-bc0b-ceb99cfd6313 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:26.623931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0e648-4d7e-4073-b9ec-b17633396e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:26.624584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0e648-4d7e-4073-b9ec-b17633396e79 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:26.624860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0e648-4d7e-4073-b9ec-b17633396e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:26.625129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0e648-4d7e-4073-b9ec-b17633396e79 None admin] PATH_INFO: `/v3/users/9601d0c659554b46b875285a97df94c1` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:26.628318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0e648-4d7e-4073-b9ec-b17633396e79 None admin] RBAC: Authorizing `identity:get_user(user_id=9601d0c659554b46b875285a97df94c1)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:26.629850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0e648-4d7e-4073-b9ec-b17633396e79 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:26.631482 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 176/348] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:11:26 2022] GET /identity/v3/users/9601d0c659554b46b875285a97df94c1 => generated 293 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:26.632238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0e648-4d7e-4073-b9ec-b17633396e79 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:26.765245 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:26.768475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ebad3-ecb7-4c79-bc0b-ceb99cfd6313 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:26.779391 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:26.810368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9df78c-469e-46f2-9303-672f7997af5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:26.811264 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9df78c-469e-46f2-9303-672f7997af5f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:26.811687 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9df78c-469e-46f2-9303-672f7997af5f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:26.812290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9df78c-469e-46f2-9303-672f7997af5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:26.816010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0e648-4d7e-4073-b9ec-b17633396e79 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:26.861910 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bf46d-4057-48cf-8d3a-b69f1f7ba2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:26.862526 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bf46d-4057-48cf-8d3a-b69f1f7ba2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:26.862802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bf46d-4057-48cf-8d3a-b69f1f7ba2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:26.863072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bf46d-4057-48cf-8d3a-b69f1f7ba2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:26.863740 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251bf46d-4057-48cf-8d3a-b69f1f7ba2b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:26.864042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251bf46d-4057-48cf-8d3a-b69f1f7ba2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:26.866124 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251bf46d-4057-48cf-8d3a-b69f1f7ba2b3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:26.875209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 177/349] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:26.878113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bf46d-4057-48cf-8d3a-b69f1f7ba2b3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:26.900788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9df78c-469e-46f2-9303-672f7997af5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:26.902320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9df78c-469e-46f2-9303-672f7997af5f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:26.999066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bf46d-4057-48cf-8d3a-b69f1f7ba2b3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:27.030877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:27.039371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 173/350] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:27.039371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9df78c-469e-46f2-9303-672f7997af5f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:27.045223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23afde7-9232-459c-83c4-0258c839cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:27.045909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23afde7-9232-459c-83c4-0258c839cb12 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:27.046203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23afde7-9232-459c-83c4-0258c839cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:27.052906 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23afde7-9232-459c-83c4-0258c839cb12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:27.052906 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23afde7-9232-459c-83c4-0258c839cb12 None admin] RBAC: Adding query filter params (role.id=c924ec18040e4cc4b55053391fd47e8a, user.id=9601d0c659554b46b875285a97df94c1, scope.system=all) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:27.052906 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23afde7-9232-459c-83c4-0258c839cb12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:27.052906 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23afde7-9232-459c-83c4-0258c839cb12 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:27.052906 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:27.071192 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 178/351] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Sep 13 03:11:26 2022] GET /identity/v3/role_assignments?user.id=9601d0c659554b46b875285a97df94c1&scope.system=all&role.id=c924ec18040e4cc4b55053391fd47e8a => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:27.072372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4c618-f3d0-4fe6-98ea-7846f51c8bf4 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:27.072659 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4c618-f3d0-4fe6-98ea-7846f51c8bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:27.072943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4c618-f3d0-4fe6-98ea-7846f51c8bf4 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:27.077467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 179/352] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:27.078302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4c618-f3d0-4fe6-98ea-7846f51c8bf4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:27.178669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9df78c-469e-46f2-9303-672f7997af5f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:27.225701 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31e388-092a-414b-9ba0-4b75a618bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:27.226621 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e388-092a-414b-9ba0-4b75a618bb55 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:27.227340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e388-092a-414b-9ba0-4b75a618bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:27.227615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e388-092a-414b-9ba0-4b75a618bb55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:27.238069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4c618-f3d0-4fe6-98ea-7846f51c8bf4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:27.251352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31e388-092a-414b-9ba0-4b75a618bb55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-4a31e388-092a-414b-9ba0-4b75a618bb55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:27.257070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:27.258012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:27.258793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:27.258793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:27.258793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:27.258793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:27.258793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:27.258793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:27.258793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:27.258793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:27.258793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:27.258793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:27.258793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:27.258793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:27.259395 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 174/353] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:27.261155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31e388-092a-414b-9ba0-4b75a618bb55 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:27.292680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7b7d9-6705-426d-bc9c-2a395c3f238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:27.293673 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7b7d9-6705-426d-bc9c-2a395c3f238e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:27.294086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7b7d9-6705-426d-bc9c-2a395c3f238e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:27.294526 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7b7d9-6705-426d-bc9c-2a395c3f238e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:27.337416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:27.375106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:27.390136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7b7d9-6705-426d-bc9c-2a395c3f238e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:27.392002 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7b7d9-6705-426d-bc9c-2a395c3f238e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:27.400652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31e388-092a-414b-9ba0-4b75a618bb55 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:27.442908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a0a10-dc04-4a30-acac-6e9cef0da3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:27.442908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0a10-dc04-4a30-acac-6e9cef0da3cf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:27.442908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0a10-dc04-4a30-acac-6e9cef0da3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:27.442908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0a10-dc04-4a30-acac-6e9cef0da3cf None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:27.444151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a0a10-dc04-4a30-acac-6e9cef0da3cf None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:27.445756 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a0a10-dc04-4a30-acac-6e9cef0da3cf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:27.448277 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 175/354] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:27 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:27.450207 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b12dad-8dbf-429b-a623-8b3c21a630d7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:27.450488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b12dad-8dbf-429b-a623-8b3c21a630d7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:27.450754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b12dad-8dbf-429b-a623-8b3c21a630d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:27.473239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-34b12dad-8dbf-429b-a623-8b3c21a630d7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:27.474458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-34b12dad-8dbf-429b-a623-8b3c21a630d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:27.514841 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 180/355] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:27.516111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7b7d9-6705-426d-bc9c-2a395c3f238e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:27.551864 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 176/356] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:27.552562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b12dad-8dbf-429b-a623-8b3c21a630d7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:27.617238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:27.629642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:27.631808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7b7d9-6705-426d-bc9c-2a395c3f238e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:27.677418 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762660a-736e-4620-84a6-0d66c67c4672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:27.678127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762660a-736e-4620-84a6-0d66c67c4672 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:27.678406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762660a-736e-4620-84a6-0d66c67c4672 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:27.678676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762660a-736e-4620-84a6-0d66c67c4672 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:27.679341 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762660a-736e-4620-84a6-0d66c67c4672 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:27.679640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762660a-736e-4620-84a6-0d66c67c4672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:27.681052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762660a-736e-4620-84a6-0d66c67c4672 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:27.682498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b12dad-8dbf-429b-a623-8b3c21a630d7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:27.690622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 181/357] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:27.691935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33470855-ad58-4f6e-9220-ff6b2701cd0a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:27.692217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33470855-ad58-4f6e-9220-ff6b2701cd0a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:27.692489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33470855-ad58-4f6e-9220-ff6b2701cd0a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:27.693709 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 182/358] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:27.694385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33470855-ad58-4f6e-9220-ff6b2701cd0a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:27.732396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d8b7a-ef33-4b52-b05b-ddd1b5a4adcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:27.733034 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8b7a-ef33-4b52-b05b-ddd1b5a4adcd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:27.734139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8b7a-ef33-4b52-b05b-ddd1b5a4adcd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:27.734139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8b7a-ef33-4b52-b05b-ddd1b5a4adcd None admin] PATH_INFO: `/v3/groups/690fc59160104eccad90fa08234f37e9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:27.744705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d8b7a-ef33-4b52-b05b-ddd1b5a4adcd None admin] RBAC: Authorizing `identity:get_group(group_id=690fc59160104eccad90fa08234f37e9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:27.746412 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d8b7a-ef33-4b52-b05b-ddd1b5a4adcd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:27.748727 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 177/359] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:27 2022] GET /identity/v3/groups/690fc59160104eccad90fa08234f37e9 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:27.749317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d8b7a-ef33-4b52-b05b-ddd1b5a4adcd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:27.832510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33470855-ad58-4f6e-9220-ff6b2701cd0a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:27.872472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a6b8d-e3a9-46c6-96c3-c6beec1b23ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:27.873210 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a6b8d-e3a9-46c6-96c3-c6beec1b23ef None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:27.873534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a6b8d-e3a9-46c6-96c3-c6beec1b23ef None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:27.873800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a6b8d-e3a9-46c6-96c3-c6beec1b23ef None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:27.874806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d8b7a-ef33-4b52-b05b-ddd1b5a4adcd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:27.874910 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a6b8d-e3a9-46c6-96c3-c6beec1b23ef None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:27.876359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a6b8d-e3a9-46c6-96c3-c6beec1b23ef None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:27.878202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 183/360] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:27 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:27.882771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea942d1-8202-4766-987c-90bf166bdd5e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:27.882771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea942d1-8202-4766-987c-90bf166bdd5e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:27.882771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea942d1-8202-4766-987c-90bf166bdd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:27.900863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-aea942d1-8202-4766-987c-90bf166bdd5e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:27.901062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:27.902117 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-aea942d1-8202-4766-987c-90bf166bdd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:27.915698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916f4dd-9d97-4f2e-ab28-0a174c89015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:27.916635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916f4dd-9d97-4f2e-ab28-0a174c89015b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:27.916912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916f4dd-9d97-4f2e-ab28-0a174c89015b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:27.917183 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916f4dd-9d97-4f2e-ab28-0a174c89015b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:27.921562 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:27.979014 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 184/361] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:27.981427 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea942d1-8202-4766-987c-90bf166bdd5e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:27.999829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916f4dd-9d97-4f2e-ab28-0a174c89015b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:28.001540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916f4dd-9d97-4f2e-ab28-0a174c89015b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:28.110097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea942d1-8202-4766-987c-90bf166bdd5e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:28.123110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 178/362] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:28.123872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916f4dd-9d97-4f2e-ab28-0a174c89015b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:28.154739 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:28.157736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda50a3-9cf2-4f11-b2dd-6d9dfbdc07d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:28.157736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda50a3-9cf2-4f11-b2dd-6d9dfbdc07d3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:28.157949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda50a3-9cf2-4f11-b2dd-6d9dfbdc07d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:28.158279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda50a3-9cf2-4f11-b2dd-6d9dfbdc07d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:28.159198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda50a3-9cf2-4f11-b2dd-6d9dfbdc07d3 None admin] RBAC: Adding query filter params (group.id=690fc59160104eccad90fa08234f37e9, role.id=367ec0d2bcdc49f09b0772bbd737e5ce, scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:28.159198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda50a3-9cf2-4f11-b2dd-6d9dfbdc07d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:28.160639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda50a3-9cf2-4f11-b2dd-6d9dfbdc07d3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:28.169312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 185/363] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 03:11:27 2022] GET /identity/v3/role_assignments?group.id=690fc59160104eccad90fa08234f37e9&scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0&role.id=367ec0d2bcdc49f09b0772bbd737e5ce => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:28.169312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda50a3-9cf2-4f11-b2dd-6d9dfbdc07d3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:28.213652 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:28.258594 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916f4dd-9d97-4f2e-ab28-0a174c89015b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:28.308881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649706f-a6ac-470a-9ed2-9f871e089c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:28.309579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649706f-a6ac-470a-9ed2-9f871e089c56 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:28.309858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649706f-a6ac-470a-9ed2-9f871e089c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:28.310130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649706f-a6ac-470a-9ed2-9f871e089c56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:28.315829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda50a3-9cf2-4f11-b2dd-6d9dfbdc07d3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:28.326170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649706f-a6ac-470a-9ed2-9f871e089c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-2649706f-a6ac-470a-9ed2-9f871e089c56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:28.331341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:28.332275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:28.333069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:28.333069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:28.333069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:28.333069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:28.333069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:28.333069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:28.333069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:28.333069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:28.333069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:28.333069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:28.333069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:28.333069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:28.333069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 179/364] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:11:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:28.333761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649706f-a6ac-470a-9ed2-9f871e089c56 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:28.357686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddfb8b-2de5-4b21-a58c-1cb4f0668753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:28.358370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddfb8b-2de5-4b21-a58c-1cb4f0668753 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:28.358982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddfb8b-2de5-4b21-a58c-1cb4f0668753 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:28.359253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddfb8b-2de5-4b21-a58c-1cb4f0668753 None admin] PATH_INFO: `/v3/groups/690fc59160104eccad90fa08234f37e9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:28.360810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddfb8b-2de5-4b21-a58c-1cb4f0668753 None admin] RBAC: Authorizing `identity:get_group(group_id=690fc59160104eccad90fa08234f37e9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:28.362880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddfb8b-2de5-4b21-a58c-1cb4f0668753 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:28.365120 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 186/365] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:28 2022] GET /identity/v3/groups/690fc59160104eccad90fa08234f37e9 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:28.366041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddfb8b-2de5-4b21-a58c-1cb4f0668753 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:28.452317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:28.475195 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649706f-a6ac-470a-9ed2-9f871e089c56 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:28.484064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:28.502749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddfb8b-2de5-4b21-a58c-1cb4f0668753 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:28.522507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c5fe3-7cf9-4519-8b06-fa17e3c6e7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:28.523652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c5fe3-7cf9-4519-8b06-fa17e3c6e7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:28.523652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c5fe3-7cf9-4519-8b06-fa17e3c6e7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:28.523652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c5fe3-7cf9-4519-8b06-fa17e3c6e7b9 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:28.526228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c5fe3-7cf9-4519-8b06-fa17e3c6e7b9 None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:28.528671 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c5fe3-7cf9-4519-8b06-fa17e3c6e7b9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:28.530519 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 180/366] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:28 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:28.531113 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c5fe3-7cf9-4519-8b06-fa17e3c6e7b9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:28.540774 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7beb81-5820-4246-9762-aeafbbbdef24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:28.541446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7beb81-5820-4246-9762-aeafbbbdef24 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:28.541725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7beb81-5820-4246-9762-aeafbbbdef24 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:28.541998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7beb81-5820-4246-9762-aeafbbbdef24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:28.558278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7beb81-5820-4246-9762-aeafbbbdef24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-cf7beb81-5820-4246-9762-aeafbbbdef24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:28.562850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:28.563753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:28.564551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:28.564551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:28.564551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:28.564551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:28.564551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:28.564551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:28.564551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:28.564551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:28.564551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:28.564551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:28.564551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:11:28.564551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:28.564551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 187/367] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:11:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:28.565197 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7beb81-5820-4246-9762-aeafbbbdef24 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:28.683378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c5fe3-7cf9-4519-8b06-fa17e3c6e7b9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:28.702054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7beb81-5820-4246-9762-aeafbbbdef24 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:28.723372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9356007-17c6-4f76-8d10-84b6731d02b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:28.724407 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9356007-17c6-4f76-8d10-84b6731d02b6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:28.724889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9356007-17c6-4f76-8d10-84b6731d02b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:28.725634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9356007-17c6-4f76-8d10-84b6731d02b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:28.727045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9356007-17c6-4f76-8d10-84b6731d02b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:28.727623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9356007-17c6-4f76-8d10-84b6731d02b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:28.729410 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9356007-17c6-4f76-8d10-84b6731d02b6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:28.739404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 181/368] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:28.740445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9356007-17c6-4f76-8d10-84b6731d02b6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:28.745294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f291f82-17e7-4b89-b605-959946b70ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:28.745294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f291f82-17e7-4b89-b605-959946b70ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:28.745294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f291f82-17e7-4b89-b605-959946b70ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:28.745294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f291f82-17e7-4b89-b605-959946b70ec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:28.746137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f291f82-17e7-4b89-b605-959946b70ec1 None admin] RBAC: Adding query filter params (group.id=690fc59160104eccad90fa08234f37e9, role.id=e577106295c544bfbe1944b178cb95e5, scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:28.746992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f291f82-17e7-4b89-b605-959946b70ec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:28.748630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f291f82-17e7-4b89-b605-959946b70ec1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:28.755919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 188/369] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 03:11:28 2022] GET /identity/v3/role_assignments?group.id=690fc59160104eccad90fa08234f37e9&scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0&role.id=e577106295c544bfbe1944b178cb95e5 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:28.756722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f291f82-17e7-4b89-b605-959946b70ec1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:28.771173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:28.772977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:28.915944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9356007-17c6-4f76-8d10-84b6731d02b6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:28.919318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f291f82-17e7-4b89-b605-959946b70ec1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:28.957422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286c370-0ae0-4c74-9218-cf8f50cedd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:28.958047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c370-0ae0-4c74-9218-cf8f50cedd9e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:28.958388 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c370-0ae0-4c74-9218-cf8f50cedd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:28.958744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c370-0ae0-4c74-9218-cf8f50cedd9e None admin] PATH_INFO: `/v3/groups/690fc59160104eccad90fa08234f37e9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:28.959975 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286c370-0ae0-4c74-9218-cf8f50cedd9e None admin] RBAC: Authorizing `identity:get_group(group_id=690fc59160104eccad90fa08234f37e9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:28.961728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286c370-0ae0-4c74-9218-cf8f50cedd9e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:28.962534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb6eab-55ed-4b1c-9f2e-b903b539c4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:28.963171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb6eab-55ed-4b1c-9f2e-b903b539c4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:28.963452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb6eab-55ed-4b1c-9f2e-b903b539c4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:28.963650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 182/370] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:28 2022] GET /identity/v3/groups/690fc59160104eccad90fa08234f37e9 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:28.963745 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb6eab-55ed-4b1c-9f2e-b903b539c4c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:28.964377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb6eab-55ed-4b1c-9f2e-b903b539c4c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:28.964471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286c370-0ae0-4c74-9218-cf8f50cedd9e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:28.964727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb6eab-55ed-4b1c-9f2e-b903b539c4c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:28.966695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb6eab-55ed-4b1c-9f2e-b903b539c4c0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:28.976249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 189/371] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:28.977407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb6eab-55ed-4b1c-9f2e-b903b539c4c0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:29.072623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:29.082193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:29.108448 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286c370-0ae0-4c74-9218-cf8f50cedd9e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:29.123521 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb6eab-55ed-4b1c-9f2e-b903b539c4c0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:29.150879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6f548-489b-4493-af74-580bbc2c857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:29.151558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6f548-489b-4493-af74-580bbc2c857b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:29.151846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6f548-489b-4493-af74-580bbc2c857b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:29.152116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6f548-489b-4493-af74-580bbc2c857b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:29.174975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8eabc-2d38-4f1b-82e6-aa4d406b95e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:29.175593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8eabc-2d38-4f1b-82e6-aa4d406b95e6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:29.175870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8eabc-2d38-4f1b-82e6-aa4d406b95e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:29.176144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8eabc-2d38-4f1b-82e6-aa4d406b95e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:29.176910 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8eabc-2d38-4f1b-82e6-aa4d406b95e6 None admin] RBAC: Adding query filter params (group.id=690fc59160104eccad90fa08234f37e9, role.id=367ec0d2bcdc49f09b0772bbd737e5ce, scope.project.id=f0b8022912c4451aa812e06166168cfa) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:29.177245 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8eabc-2d38-4f1b-82e6-aa4d406b95e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:29.178711 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8eabc-2d38-4f1b-82e6-aa4d406b95e6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:29.185961 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 190/372] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 03:11:28 2022] GET /identity/v3/role_assignments?group.id=690fc59160104eccad90fa08234f37e9&scope.project.id=f0b8022912c4451aa812e06166168cfa&role.id=367ec0d2bcdc49f09b0772bbd737e5ce => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:29.186769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8eabc-2d38-4f1b-82e6-aa4d406b95e6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:29.256284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6f548-489b-4493-af74-580bbc2c857b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:29.257944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6f548-489b-4493-af74-580bbc2c857b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:29.369678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:29.381958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 183/373] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:29.385016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6f548-489b-4493-af74-580bbc2c857b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:29.442710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8eabc-2d38-4f1b-82e6-aa4d406b95e6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:29.505128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6f548-489b-4493-af74-580bbc2c857b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:29.513588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7d2ca-76a4-4f50-88dd-85e7d05a20b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:29.514133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7d2ca-76a4-4f50-88dd-85e7d05a20b7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:29.514411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7d2ca-76a4-4f50-88dd-85e7d05a20b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:29.514683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7d2ca-76a4-4f50-88dd-85e7d05a20b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:29.525640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:29.547424 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f140e4-bf6a-400a-85a3-d5cf3a68321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:29.548067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f140e4-bf6a-400a-85a3-d5cf3a68321e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:29.548377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f140e4-bf6a-400a-85a3-d5cf3a68321e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:29.548653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f140e4-bf6a-400a-85a3-d5cf3a68321e None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:29.549962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f140e4-bf6a-400a-85a3-d5cf3a68321e None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:29.552023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f140e4-bf6a-400a-85a3-d5cf3a68321e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:29.554134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 184/374] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:29 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:29.560789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f140e4-bf6a-400a-85a3-d5cf3a68321e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:29.627119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7d2ca-76a4-4f50-88dd-85e7d05a20b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:29.628596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7d2ca-76a4-4f50-88dd-85e7d05a20b7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:29.669657 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:29.779312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f140e4-bf6a-400a-85a3-d5cf3a68321e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:29.828876 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 191/375] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:29.834352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7d2ca-76a4-4f50-88dd-85e7d05a20b7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:29.857935 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38545a14-72cd-4e37-a9a0-fecf7c95b19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:29.858576 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38545a14-72cd-4e37-a9a0-fecf7c95b19b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:29.858850 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38545a14-72cd-4e37-a9a0-fecf7c95b19b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:29.859122 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38545a14-72cd-4e37-a9a0-fecf7c95b19b None admin] PATH_INFO: `/v3/groups/690fc59160104eccad90fa08234f37e9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:29.861453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38545a14-72cd-4e37-a9a0-fecf7c95b19b None admin] RBAC: Authorizing `identity:get_group(group_id=690fc59160104eccad90fa08234f37e9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:29.862907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38545a14-72cd-4e37-a9a0-fecf7c95b19b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:29.864668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 185/376] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:29 2022] GET /identity/v3/groups/690fc59160104eccad90fa08234f37e9 => generated 226 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:29.872232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38545a14-72cd-4e37-a9a0-fecf7c95b19b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:29.891620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:30.007989 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38545a14-72cd-4e37-a9a0-fecf7c95b19b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:30.010747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7d2ca-76a4-4f50-88dd-85e7d05a20b7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:30.025940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:30.044964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86b032-3730-4ef8-b185-463ae3b13ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:30.045660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86b032-3730-4ef8-b185-463ae3b13ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:30.045942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86b032-3730-4ef8-b185-463ae3b13ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:30.046212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86b032-3730-4ef8-b185-463ae3b13ab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:30.046937 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86b032-3730-4ef8-b185-463ae3b13ab4 None admin] RBAC: Adding query filter params (group.id=690fc59160104eccad90fa08234f37e9, role.id=e577106295c544bfbe1944b178cb95e5, scope.project.id=f0b8022912c4451aa812e06166168cfa) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:30.047241 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86b032-3730-4ef8-b185-463ae3b13ab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:30.048663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86b032-3730-4ef8-b185-463ae3b13ab4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:30.057234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 186/377] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 03:11:29 2022] GET /identity/v3/role_assignments?group.id=690fc59160104eccad90fa08234f37e9&scope.project.id=f0b8022912c4451aa812e06166168cfa&role.id=e577106295c544bfbe1944b178cb95e5 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:30.071854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cad61-d63d-4898-9e2f-810d3cd9986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:30.072490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cad61-d63d-4898-9e2f-810d3cd9986a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:30.072770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cad61-d63d-4898-9e2f-810d3cd9986a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:30.073048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cad61-d63d-4898-9e2f-810d3cd9986a None admin] PATH_INFO: `/v3/projects/579008ca5633416b90d9e0cc4088e0c7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:30.074212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cad61-d63d-4898-9e2f-810d3cd9986a None admin] RBAC: Authorizing `identity:get_project(project_id=579008ca5633416b90d9e0cc4088e0c7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:30.076429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cad61-d63d-4898-9e2f-810d3cd9986a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:30.078538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 192/378] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:29 2022] GET /identity/v3/projects/579008ca5633416b90d9e0cc4088e0c7 => generated 344 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:30.084175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86b032-3730-4ef8-b185-463ae3b13ab4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:30.191645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86b032-3730-4ef8-b185-463ae3b13ab4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:30.228007 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9304b-88c0-4927-88d0-02c33d812a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:30.228642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9304b-88c0-4927-88d0-02c33d812a5b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:30.228919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9304b-88c0-4927-88d0-02c33d812a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:30.229192 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9304b-88c0-4927-88d0-02c33d812a5b None admin] PATH_INFO: `/v3/groups/af24e6270a1941e1bb9a8bc22da6235b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:30.235058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9304b-88c0-4927-88d0-02c33d812a5b None admin] RBAC: Authorizing `identity:get_group(group_id=af24e6270a1941e1bb9a8bc22da6235b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:30.236595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9304b-88c0-4927-88d0-02c33d812a5b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:30.238861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 187/379] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:30 2022] GET /identity/v3/groups/af24e6270a1941e1bb9a8bc22da6235b => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:30.244991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cad61-d63d-4898-9e2f-810d3cd9986a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:30.377013 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cad61-d63d-4898-9e2f-810d3cd9986a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:30.378513 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:30.417977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cbf0c-d810-4f4d-a5b9-d77aac90fb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:30.417977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbf0c-d810-4f4d-a5b9-d77aac90fb0f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:30.418256 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbf0c-d810-4f4d-a5b9-d77aac90fb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:30.418472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbf0c-d810-4f4d-a5b9-d77aac90fb0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:30.420168 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cbf0c-d810-4f4d-a5b9-d77aac90fb0f None admin] RBAC: Adding query filter params (group.id=af24e6270a1941e1bb9a8bc22da6235b, role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=579008ca5633416b90d9e0cc4088e0c7) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:30.420504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cbf0c-d810-4f4d-a5b9-d77aac90fb0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:30.421989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cbf0c-d810-4f4d-a5b9-d77aac90fb0f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:30.432955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 193/380] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 03:11:30 2022] GET /identity/v3/role_assignments?group.id=af24e6270a1941e1bb9a8bc22da6235b&scope.project.id=579008ca5633416b90d9e0cc4088e0c7&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:30.748008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f05d6-4200-4257-a1de-05ae9fb3e251 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:30.748355 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f05d6-4200-4257-a1de-05ae9fb3e251 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:30.748559 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f05d6-4200-4257-a1de-05ae9fb3e251 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:30.750058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 188/381] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:30.755521 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ceef-2012-429f-8a1d-0693f7d067db None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:30.756040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ceef-2012-429f-8a1d-0693f7d067db None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:30.756516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ceef-2012-429f-8a1d-0693f7d067db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:30.776820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-00f2ceef-2012-429f-8a1d-0693f7d067db None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:30.779146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-00f2ceef-2012-429f-8a1d-0693f7d067db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:30.850417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 194/382] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:31.129017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f05d6-4200-4257-a1de-05ae9fb3e251 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:31.211391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:31.277326 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f05d6-4200-4257-a1de-05ae9fb3e251 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:31.313186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654edf0-b851-4cae-9e9c-68797c744687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:31.313900 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654edf0-b851-4cae-9e9c-68797c744687 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:31.314178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654edf0-b851-4cae-9e9c-68797c744687 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:31.314452 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654edf0-b851-4cae-9e9c-68797c744687 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:31.325553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654edf0-b851-4cae-9e9c-68797c744687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-8654edf0-b851-4cae-9e9c-68797c744687 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:31.331250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:31.332144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:31.332926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:31.332926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:31.332926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:31.332926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:31.332926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:31.332926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:31.332926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:31.332926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:31.332926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:31.332926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:31.332926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:31.332926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:31.333560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cffae1-b10c-4697-9194-066be3727b1f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:31.333560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cffae1-b10c-4697-9194-066be3727b1f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:31.333560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cffae1-b10c-4697-9194-066be3727b1f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:31.334064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 189/383] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:31.335828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 195/384] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:31.338351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654edf0-b851-4cae-9e9c-68797c744687 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:31.351993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e667a20-1933-4ca3-b28c-3a33ffa3f05e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:31.352277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e667a20-1933-4ca3-b28c-3a33ffa3f05e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:31.352608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e667a20-1933-4ca3-b28c-3a33ffa3f05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:31.390491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1e667a20-1933-4ca3-b28c-3a33ffa3f05e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:31.392075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1e667a20-1933-4ca3-b28c-3a33ffa3f05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:31.480197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654edf0-b851-4cae-9e9c-68797c744687 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:31.510597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:31.516958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fb0cc-7b2a-4130-bff3-2907579fa6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:31.517595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fb0cc-7b2a-4130-bff3-2907579fa6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:31.517877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fb0cc-7b2a-4130-bff3-2907579fa6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:31.518260 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fb0cc-7b2a-4130-bff3-2907579fa6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:31.518934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fb0cc-7b2a-4130-bff3-2907579fa6a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:31.519237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fb0cc-7b2a-4130-bff3-2907579fa6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:31.520939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fb0cc-7b2a-4130-bff3-2907579fa6a3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:31.530926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 190/385] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:31.536744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fb0cc-7b2a-4130-bff3-2907579fa6a3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:31.541464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 196/386] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:31.682988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fb0cc-7b2a-4130-bff3-2907579fa6a3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:31.734598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5daa51-71f0-4aaa-bee9-039e0774419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:31.735236 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5daa51-71f0-4aaa-bee9-039e0774419b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:31.735510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5daa51-71f0-4aaa-bee9-039e0774419b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:31.735832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5daa51-71f0-4aaa-bee9-039e0774419b None admin] PATH_INFO: `/v3/groups/690fc59160104eccad90fa08234f37e9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:31.736960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5daa51-71f0-4aaa-bee9-039e0774419b None admin] RBAC: Authorizing `identity:get_group(group_id=690fc59160104eccad90fa08234f37e9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:31.738444 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5daa51-71f0-4aaa-bee9-039e0774419b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:31.740368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 191/387] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:31 2022] GET /identity/v3/groups/690fc59160104eccad90fa08234f37e9 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:31.746302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e667a20-1933-4ca3-b28c-3a33ffa3f05e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:31.795565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:31.867427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5daa51-71f0-4aaa-bee9-039e0774419b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:31.900745 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e667a20-1933-4ca3-b28c-3a33ffa3f05e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:31.910226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:31.959757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adef656-eb8a-4bd9-b0e8-8b967f25a103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:31.960417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adef656-eb8a-4bd9-b0e8-8b967f25a103 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:31.960762 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adef656-eb8a-4bd9-b0e8-8b967f25a103 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:31.961138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adef656-eb8a-4bd9-b0e8-8b967f25a103 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:31.962427 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adef656-eb8a-4bd9-b0e8-8b967f25a103 None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:31.964077 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adef656-eb8a-4bd9-b0e8-8b967f25a103 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:31.971217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 197/388] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:31 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:31.972523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adef656-eb8a-4bd9-b0e8-8b967f25a103 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:32.004806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5daa51-71f0-4aaa-bee9-039e0774419b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:32.042004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e7bdf-cb3c-44ea-9848-3fb139a29a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:32.042775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e7bdf-cb3c-44ea-9848-3fb139a29a73 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:32.043088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e7bdf-cb3c-44ea-9848-3fb139a29a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:32.043361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e7bdf-cb3c-44ea-9848-3fb139a29a73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:32.058363 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e7bdf-cb3c-44ea-9848-3fb139a29a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-196e7bdf-cb3c-44ea-9848-3fb139a29a73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:32.064660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:32.065562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:32.066433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:32.066433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:32.066433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:32.066433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:32.066433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:32.066433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:32.066433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:32.066433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:32.066433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:32.066433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:32.066433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:32.066433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:32.066433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 192/389] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:11:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:32.070417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5555f6-f641-44d0-85b5-f2d555885049 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:32.070697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5555f6-f641-44d0-85b5-f2d555885049 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:32.071725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5555f6-f641-44d0-85b5-f2d555885049 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:32.072993 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 193/390] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:32.073845 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5555f6-f641-44d0-85b5-f2d555885049 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:32.076292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:32.084208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adef656-eb8a-4bd9-b0e8-8b967f25a103 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:32.122062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36a4c4-a08e-4015-b143-6954a8fd284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:32.123000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36a4c4-a08e-4015-b143-6954a8fd284f None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:32.123557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36a4c4-a08e-4015-b143-6954a8fd284f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:32.124009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36a4c4-a08e-4015-b143-6954a8fd284f None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0/groups/690fc59160104eccad90fa08234f37e9/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:32.126370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36a4c4-a08e-4015-b143-6954a8fd284f None admin] RBAC: Authorizing `identity:create_grant(project_id=ef2673a95ec34eb9a8e8191d5e0551e0, group_id=690fc59160104eccad90fa08234f37e9, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:32.128147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36a4c4-a08e-4015-b143-6954a8fd284f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:32.184033 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:32.197294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 198/391] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 13 03:11:31 2022] PUT /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0/groups/690fc59160104eccad90fa08234f37e9/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:32.197294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebf3ea-ee03-466a-bbcd-a7ea0353c305 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:32.197294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebf3ea-ee03-466a-bbcd-a7ea0353c305 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:32.197294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebf3ea-ee03-466a-bbcd-a7ea0353c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:32.207643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5555f6-f641-44d0-85b5-f2d555885049 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:32.232389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-85ebf3ea-ee03-466a-bbcd-a7ea0353c305 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:32.234410 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-85ebf3ea-ee03-466a-bbcd-a7ea0353c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:32.279970 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc55a1-552f-4cf7-bc02-c84fa18681ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:32.280638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc55a1-552f-4cf7-bc02-c84fa18681ff None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:32.280913 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc55a1-552f-4cf7-bc02-c84fa18681ff None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:32.281826 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc55a1-552f-4cf7-bc02-c84fa18681ff None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:32.282652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc55a1-552f-4cf7-bc02-c84fa18681ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:32.282973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc55a1-552f-4cf7-bc02-c84fa18681ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:32.284381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc55a1-552f-4cf7-bc02-c84fa18681ff None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:32.304524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 194/392] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:32.307536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc55a1-552f-4cf7-bc02-c84fa18681ff None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:32.348690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 199/393] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:32.467960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc55a1-552f-4cf7-bc02-c84fa18681ff None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:32.503578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5b247-16ee-4c8d-96eb-97cb4899bd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:32.504416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5b247-16ee-4c8d-96eb-97cb4899bd10 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:32.504841 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5b247-16ee-4c8d-96eb-97cb4899bd10 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:32.505279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5b247-16ee-4c8d-96eb-97cb4899bd10 None admin] PATH_INFO: `/v3/groups/690fc59160104eccad90fa08234f37e9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:32.506559 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5b247-16ee-4c8d-96eb-97cb4899bd10 None admin] RBAC: Authorizing `identity:get_group(group_id=690fc59160104eccad90fa08234f37e9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:32.508133 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5b247-16ee-4c8d-96eb-97cb4899bd10 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:32.510188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 195/394] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:32 2022] GET /identity/v3/groups/690fc59160104eccad90fa08234f37e9 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:32.516545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebf3ea-ee03-466a-bbcd-a7ea0353c305 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:32.609544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:32.622480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5b247-16ee-4c8d-96eb-97cb4899bd10 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:32.626575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebf3ea-ee03-466a-bbcd-a7ea0353c305 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:32.666429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebae9e9-95b5-4336-acf2-fd1c56712406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:32.668147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebae9e9-95b5-4336-acf2-fd1c56712406 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:32.668805 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebae9e9-95b5-4336-acf2-fd1c56712406 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:32.670490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebae9e9-95b5-4336-acf2-fd1c56712406 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:32.672701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebae9e9-95b5-4336-acf2-fd1c56712406 None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:32.674551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebae9e9-95b5-4336-acf2-fd1c56712406 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:32.679856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 200/395] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:32 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:32.684223 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:32.687256 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebae9e9-95b5-4336-acf2-fd1c56712406 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:32.850122 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5b247-16ee-4c8d-96eb-97cb4899bd10 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:32.892805 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebae9e9-95b5-4336-acf2-fd1c56712406 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:32.915429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6268e-1107-40ea-b1ba-34b936842579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:32.916906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6268e-1107-40ea-b1ba-34b936842579 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:32.916906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6268e-1107-40ea-b1ba-34b936842579 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:32.916906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6268e-1107-40ea-b1ba-34b936842579 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:32.932772 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ce4a0-9de3-491f-bfc9-71017b47689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:32.934148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ce4a0-9de3-491f-bfc9-71017b47689c None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:32.934379 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ce4a0-9de3-491f-bfc9-71017b47689c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:32.937415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ce4a0-9de3-491f-bfc9-71017b47689c None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0/groups/690fc59160104eccad90fa08234f37e9/roles/e577106295c544bfbe1944b178cb95e5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:32.937415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ce4a0-9de3-491f-bfc9-71017b47689c None admin] RBAC: Authorizing `identity:create_grant(project_id=ef2673a95ec34eb9a8e8191d5e0551e0, group_id=690fc59160104eccad90fa08234f37e9, role_id=e577106295c544bfbe1944b178cb95e5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:32.938716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ce4a0-9de3-491f-bfc9-71017b47689c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:32.941521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6268e-1107-40ea-b1ba-34b936842579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ebb6268e-1107-40ea-b1ba-34b936842579 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:32.947345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:32.948298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:32.949128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:32.949128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:32.949128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:32.949128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:32.949128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:32.949128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:32.949128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:32.949128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:32.949128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:32.949128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:32.949128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:32.949128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:32.949128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 196/396] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:32.950716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9e186-bd7a-4f48-9d33-a144c3223f3d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:32.951059 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9e186-bd7a-4f48-9d33-a144c3223f3d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:32.951394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9e186-bd7a-4f48-9d33-a144c3223f3d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:32.953565 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 197/397] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:32.954812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9e186-bd7a-4f48-9d33-a144c3223f3d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:33.048075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:33.063115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 201/398] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 13 03:11:32 2022] PUT /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0/groups/690fc59160104eccad90fa08234f37e9/roles/e577106295c544bfbe1944b178cb95e5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:11:33.065608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca99a9a-ac9c-46e9-89f9-821eb07d1b6a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:33.066163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca99a9a-ac9c-46e9-89f9-821eb07d1b6a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:33.066918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca99a9a-ac9c-46e9-89f9-821eb07d1b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:33.079709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9e186-bd7a-4f48-9d33-a144c3223f3d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:33.109375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1ca99a9a-ac9c-46e9-89f9-821eb07d1b6a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:33.113296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1ca99a9a-ac9c-46e9-89f9-821eb07d1b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:33.127730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:33.160906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23556e1b-d153-4fa6-89af-c5158830b4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:33.161583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23556e1b-d153-4fa6-89af-c5158830b4be None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:33.161860 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23556e1b-d153-4fa6-89af-c5158830b4be None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:33.162129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23556e1b-d153-4fa6-89af-c5158830b4be None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:33.164298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23556e1b-d153-4fa6-89af-c5158830b4be None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:33.164676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23556e1b-d153-4fa6-89af-c5158830b4be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:33.167723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23556e1b-d153-4fa6-89af-c5158830b4be None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:33.184980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 198/399] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:33.195168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23556e1b-d153-4fa6-89af-c5158830b4be None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:33.280682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 202/400] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:33.305597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081eb5f-57c5-43da-9129-165e78a598eb None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:33.306238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081eb5f-57c5-43da-9129-165e78a598eb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:33.306517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081eb5f-57c5-43da-9129-165e78a598eb None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:33.307987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 203/401] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:11:33.314536 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46850-e104-41a9-ad35-0df146f534ae None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:33.315246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46850-e104-41a9-ad35-0df146f534ae None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:33.315723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46850-e104-41a9-ad35-0df146f534ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:33.337675 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-29f46850-e104-41a9-ad35-0df146f534ae None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:33.340281 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-29f46850-e104-41a9-ad35-0df146f534ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:33.365319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23556e1b-d153-4fa6-89af-c5158830b4be None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:33.413690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c40dfb-9a85-4587-b25c-0234b533a94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:33.414609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40dfb-9a85-4587-b25c-0234b533a94c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:33.415177 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40dfb-9a85-4587-b25c-0234b533a94c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:33.415617 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c40dfb-9a85-4587-b25c-0234b533a94c None admin] PATH_INFO: `/v3/groups/690fc59160104eccad90fa08234f37e9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:33.419059 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c40dfb-9a85-4587-b25c-0234b533a94c None admin] RBAC: Authorizing `identity:get_group(group_id=690fc59160104eccad90fa08234f37e9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:33.421986 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c40dfb-9a85-4587-b25c-0234b533a94c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:33.424698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 199/402] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:33 2022] GET /identity/v3/groups/690fc59160104eccad90fa08234f37e9 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:33.430265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c40dfb-9a85-4587-b25c-0234b533a94c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:33.456957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 204/403] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:33.459028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:33.570061 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c40dfb-9a85-4587-b25c-0234b533a94c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:33.598397 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f46850-e104-41a9-ad35-0df146f534ae None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:33.610814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8008a-fa05-4559-b65c-8434c8b30ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:33.611448 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8008a-fa05-4559-b65c-8434c8b30ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:33.611728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8008a-fa05-4559-b65c-8434c8b30ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:33.612004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8008a-fa05-4559-b65c-8434c8b30ed0 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:33.613126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8008a-fa05-4559-b65c-8434c8b30ed0 None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:33.614619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8008a-fa05-4559-b65c-8434c8b30ed0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:33.616660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 200/404] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:33 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:33.626169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8008a-fa05-4559-b65c-8434c8b30ed0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:33.712963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:33.764755 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:33.777214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f46850-e104-41a9-ad35-0df146f534ae None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:33.807714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8008a-fa05-4559-b65c-8434c8b30ed0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:33.831387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1accb-800a-4e17-9604-d8d533875158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:33.832125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1accb-800a-4e17-9604-d8d533875158 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:33.832397 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1accb-800a-4e17-9604-d8d533875158 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:33.832667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1accb-800a-4e17-9604-d8d533875158 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:33.844302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1accb-800a-4e17-9604-d8d533875158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-62b1accb-800a-4e17-9604-d8d533875158 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:33.849736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:33.850815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:33.851682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:33.851682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:33.851682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:33.851682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:33.851682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:33.851682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:33.851682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:33.851682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:33.851682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:33.851682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:33.851682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:33.851682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:33.851682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 205/405] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:11:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:33.852342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1accb-800a-4e17-9604-d8d533875158 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:33.853653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c1f93-9c8e-40eb-b627-a62a6571c3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:33.854531 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c1f93-9c8e-40eb-b627-a62a6571c3a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:33.854950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c1f93-9c8e-40eb-b627-a62a6571c3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:33.855930 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c1f93-9c8e-40eb-b627-a62a6571c3a7 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa/groups/690fc59160104eccad90fa08234f37e9/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:33.858319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c1f93-9c8e-40eb-b627-a62a6571c3a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0b8022912c4451aa812e06166168cfa, group_id=690fc59160104eccad90fa08234f37e9, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:33.859963 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c1f93-9c8e-40eb-b627-a62a6571c3a7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:33.953635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1accb-800a-4e17-9604-d8d533875158 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:33.976446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 201/406] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 13 03:11:33 2022] PUT /identity/v3/projects/f0b8022912c4451aa812e06166168cfa/groups/690fc59160104eccad90fa08234f37e9/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:33.976446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c1f93-9c8e-40eb-b627-a62a6571c3a7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:34.009786 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:34.019261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78e31c-008c-4932-b803-24fed12fedfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:34.020130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78e31c-008c-4932-b803-24fed12fedfc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:34.020452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78e31c-008c-4932-b803-24fed12fedfc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:34.020718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78e31c-008c-4932-b803-24fed12fedfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:34.044043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78e31c-008c-4932-b803-24fed12fedfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-dc78e31c-008c-4932-b803-24fed12fedfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:34.056235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:34.065001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:34.065001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:34.065001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:34.065001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:34.065001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:34.065001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:34.065001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:34.065001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:34.065001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:34.065001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:34.065001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:11:34.065001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:34.065001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 206/407] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:11:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:34.068358 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78e31c-008c-4932-b803-24fed12fedfc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:34.203877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78e31c-008c-4932-b803-24fed12fedfc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:34.222824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c1f93-9c8e-40eb-b627-a62a6571c3a7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:34.244467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af294fc-2181-4059-862c-3212fd3a17e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:34.245140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af294fc-2181-4059-862c-3212fd3a17e8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:34.245448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af294fc-2181-4059-862c-3212fd3a17e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:34.245714 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af294fc-2181-4059-862c-3212fd3a17e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:34.246427 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af294fc-2181-4059-862c-3212fd3a17e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:34.247176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af294fc-2181-4059-862c-3212fd3a17e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:34.248125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af294fc-2181-4059-862c-3212fd3a17e8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:34.258254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 207/408] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:34.264490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af294fc-2181-4059-862c-3212fd3a17e8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:34.279786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab5384-8b9a-4220-80cd-5cbfc27ff949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:34.281008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5384-8b9a-4220-80cd-5cbfc27ff949 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:34.281537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5384-8b9a-4220-80cd-5cbfc27ff949 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:34.282228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5384-8b9a-4220-80cd-5cbfc27ff949 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:34.283636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab5384-8b9a-4220-80cd-5cbfc27ff949 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:34.284373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab5384-8b9a-4220-80cd-5cbfc27ff949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:34.286616 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab5384-8b9a-4220-80cd-5cbfc27ff949 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:34.297484 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 202/409] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:34.303730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab5384-8b9a-4220-80cd-5cbfc27ff949 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:34.308900 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:34.349529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:34.429983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af294fc-2181-4059-862c-3212fd3a17e8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:34.483553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab5384-8b9a-4220-80cd-5cbfc27ff949 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:34.485119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fbf46-691b-4a4b-a361-da0e42a15164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:34.485797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fbf46-691b-4a4b-a361-da0e42a15164 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:34.486076 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fbf46-691b-4a4b-a361-da0e42a15164 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:34.486349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fbf46-691b-4a4b-a361-da0e42a15164 None admin] PATH_INFO: `/v3/groups/af24e6270a1941e1bb9a8bc22da6235b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:34.487481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fbf46-691b-4a4b-a361-da0e42a15164 None admin] RBAC: Authorizing `identity:get_group(group_id=af24e6270a1941e1bb9a8bc22da6235b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:34.488933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fbf46-691b-4a4b-a361-da0e42a15164 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:34.490540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 208/410] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:34 2022] GET /identity/v3/groups/af24e6270a1941e1bb9a8bc22da6235b => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:34.498390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fbf46-691b-4a4b-a361-da0e42a15164 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:34.535701 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6cd54-4cbc-4392-ad94-e67160f804e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:34.536351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6cd54-4cbc-4392-ad94-e67160f804e8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:34.536629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6cd54-4cbc-4392-ad94-e67160f804e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:34.536902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6cd54-4cbc-4392-ad94-e67160f804e8 None admin] PATH_INFO: `/v3/groups/690fc59160104eccad90fa08234f37e9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:34.538036 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6cd54-4cbc-4392-ad94-e67160f804e8 None admin] RBAC: Authorizing `identity:get_group(group_id=690fc59160104eccad90fa08234f37e9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:34.539554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6cd54-4cbc-4392-ad94-e67160f804e8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:34.541540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 203/411] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:34 2022] GET /identity/v3/groups/690fc59160104eccad90fa08234f37e9 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:34.550297 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6cd54-4cbc-4392-ad94-e67160f804e8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:34.653545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fbf46-691b-4a4b-a361-da0e42a15164 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:34.669466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:34.694094 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:34.703175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6cd54-4cbc-4392-ad94-e67160f804e8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:34.731409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728051df-97e5-4a00-86af-547fc4d16414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:34.732060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728051df-97e5-4a00-86af-547fc4d16414 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:34.732342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728051df-97e5-4a00-86af-547fc4d16414 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:34.732617 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728051df-97e5-4a00-86af-547fc4d16414 None admin] PATH_INFO: `/v3/projects/579008ca5633416b90d9e0cc4088e0c7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:34.737145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728051df-97e5-4a00-86af-547fc4d16414 None admin] RBAC: Authorizing `identity:get_project(project_id=579008ca5633416b90d9e0cc4088e0c7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:34.738589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728051df-97e5-4a00-86af-547fc4d16414 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:34.740357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 209/412] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:34 2022] GET /identity/v3/projects/579008ca5633416b90d9e0cc4088e0c7 => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:34.740480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd0bec-221f-46d2-b4dc-381a5acab156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:34.740959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd0bec-221f-46d2-b4dc-381a5acab156 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:34.741238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd0bec-221f-46d2-b4dc-381a5acab156 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:34.741545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd0bec-221f-46d2-b4dc-381a5acab156 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:34.742726 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd0bec-221f-46d2-b4dc-381a5acab156 None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:34.744168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd0bec-221f-46d2-b4dc-381a5acab156 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:34.744919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968402-09e6-4e61-b63e-ca44e252f19f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:34.745198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968402-09e6-4e61-b63e-ca44e252f19f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:34.745508 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a968402-09e6-4e61-b63e-ca44e252f19f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:34.746651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 204/413] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:34 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:34.747395 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd0bec-221f-46d2-b4dc-381a5acab156 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:34.750262 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 210/414] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:34.753062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968402-09e6-4e61-b63e-ca44e252f19f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:34.864851 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd0bec-221f-46d2-b4dc-381a5acab156 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:34.905600 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a968402-09e6-4e61-b63e-ca44e252f19f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:34.907499 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e527107-dcd2-4885-ae6c-228cc5810e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:34.908211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e527107-dcd2-4885-ae6c-228cc5810e52 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:34.908496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e527107-dcd2-4885-ae6c-228cc5810e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:34.908770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e527107-dcd2-4885-ae6c-228cc5810e52 None admin] PATH_INFO: `/v3/projects/579008ca5633416b90d9e0cc4088e0c7/groups/af24e6270a1941e1bb9a8bc22da6235b/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:34.911150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e527107-dcd2-4885-ae6c-228cc5810e52 None admin] RBAC: Authorizing `identity:create_grant(project_id=579008ca5633416b90d9e0cc4088e0c7, group_id=af24e6270a1941e1bb9a8bc22da6235b, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:34.912669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e527107-dcd2-4885-ae6c-228cc5810e52 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:34.944824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65704e64-34d1-49cf-8282-bcb5f9bcd217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:34.945829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65704e64-34d1-49cf-8282-bcb5f9bcd217 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:34.946288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65704e64-34d1-49cf-8282-bcb5f9bcd217 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:34.946739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65704e64-34d1-49cf-8282-bcb5f9bcd217 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa/groups/690fc59160104eccad90fa08234f37e9/roles/e577106295c544bfbe1944b178cb95e5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:34.949665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65704e64-34d1-49cf-8282-bcb5f9bcd217 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0b8022912c4451aa812e06166168cfa, group_id=690fc59160104eccad90fa08234f37e9, role_id=e577106295c544bfbe1944b178cb95e5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:34.951336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65704e64-34d1-49cf-8282-bcb5f9bcd217 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:35.011645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:35.021330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 205/415] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 13 03:11:34 2022] PUT /identity/v3/projects/579008ca5633416b90d9e0cc4088e0c7/groups/af24e6270a1941e1bb9a8bc22da6235b/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:35.021330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63760416-98f1-449f-bd8d-35c85479327d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:35.021330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63760416-98f1-449f-bd8d-35c85479327d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:35.021330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63760416-98f1-449f-bd8d-35c85479327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:35.039005 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-63760416-98f1-449f-bd8d-35c85479327d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:35.040501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-63760416-98f1-449f-bd8d-35c85479327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:35.050877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 211/416] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Sep 13 03:11:34 2022] PUT /identity/v3/projects/f0b8022912c4451aa812e06166168cfa/groups/690fc59160104eccad90fa08234f37e9/roles/e577106295c544bfbe1944b178cb95e5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:35.138673 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 206/417] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:35.472207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65704e64-34d1-49cf-8282-bcb5f9bcd217 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:35.526558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:35.585191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65704e64-34d1-49cf-8282-bcb5f9bcd217 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:35.621960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b39bce-4931-452e-a6c5-f55c745ef286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:35.623163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b39bce-4931-452e-a6c5-f55c745ef286 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:35.623403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b39bce-4931-452e-a6c5-f55c745ef286 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:35.623856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b39bce-4931-452e-a6c5-f55c745ef286 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:35.634425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b39bce-4931-452e-a6c5-f55c745ef286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-45b39bce-4931-452e-a6c5-f55c745ef286 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:35.640667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:35.641650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:35.642506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:35.642506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:35.642506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:35.642506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:35.642506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:35.642506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:35.642506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:35.642506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:35.642506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:35.642506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:35.642506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:35.642506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:35.649369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 212/418] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:35.651369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63760416-98f1-449f-bd8d-35c85479327d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:35.724674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8f7b5-4d12-43a6-af3e-d4bb140c29f5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:35.725780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8f7b5-4d12-43a6-af3e-d4bb140c29f5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:35.726361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8f7b5-4d12-43a6-af3e-d4bb140c29f5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:35.728477 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 213/419] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:35.738247 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84f5ba-c3b2-4dad-97e6-e59f6edb7269 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:35.738800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84f5ba-c3b2-4dad-97e6-e59f6edb7269 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:35.739272 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84f5ba-c3b2-4dad-97e6-e59f6edb7269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:35.760923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2d84f5ba-c3b2-4dad-97e6-e59f6edb7269 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:35.763571 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2d84f5ba-c3b2-4dad-97e6-e59f6edb7269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:35.783157 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63760416-98f1-449f-bd8d-35c85479327d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:35.849751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 214/420] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:35.866904 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:35.887027 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e50f4-e8b2-4327-ba25-bee62ca7f836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:35.894002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e50f4-e8b2-4327-ba25-bee62ca7f836 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:35.894002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e50f4-e8b2-4327-ba25-bee62ca7f836 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:35.894002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e50f4-e8b2-4327-ba25-bee62ca7f836 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:35.894002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e50f4-e8b2-4327-ba25-bee62ca7f836 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:35.894002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e50f4-e8b2-4327-ba25-bee62ca7f836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:35.894002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e50f4-e8b2-4327-ba25-bee62ca7f836 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:35.904995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 207/421] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:35.910796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84f5ba-c3b2-4dad-97e6-e59f6edb7269 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:35.968385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:36.028990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84f5ba-c3b2-4dad-97e6-e59f6edb7269 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:36.063936 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94e2e6-4aab-4ae0-9950-a29d88b97ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:36.064548 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94e2e6-4aab-4ae0-9950-a29d88b97ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:36.064829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94e2e6-4aab-4ae0-9950-a29d88b97ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:36.065098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94e2e6-4aab-4ae0-9950-a29d88b97ac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:36.135378 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94e2e6-4aab-4ae0-9950-a29d88b97ac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:36.140452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94e2e6-4aab-4ae0-9950-a29d88b97ac7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:36.179723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:36.247069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 215/422] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:36.250332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e50f4-e8b2-4327-ba25-bee62ca7f836 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:36.296655 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94e2e6-4aab-4ae0-9950-a29d88b97ac7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:36.451938 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e50f4-e8b2-4327-ba25-bee62ca7f836 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:36.470979 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94e2e6-4aab-4ae0-9950-a29d88b97ac7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:36.508657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fe4e5-4bce-4d5c-8e8d-620e51daf585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:36.509691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fe4e5-4bce-4d5c-8e8d-620e51daf585 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:36.510195 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fe4e5-4bce-4d5c-8e8d-620e51daf585 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:36.510724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fe4e5-4bce-4d5c-8e8d-620e51daf585 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:36.521621 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:36.522934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fe4e5-4bce-4d5c-8e8d-620e51daf585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ed6fe4e5-4bce-4d5c-8e8d-620e51daf585 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:36.528371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:36.529689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:36.530568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:36.530568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:36.530568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:36.530568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:36.530568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:36.530568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:36.530568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:36.530568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:36.530568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:36.530568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:36.530568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:36.530568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:36.531219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18fd06-6385-4fb3-981e-08e85d33fe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:36.531219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18fd06-6385-4fb3-981e-08e85d33fe72 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:36.531219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18fd06-6385-4fb3-981e-08e85d33fe72 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:36.531219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18fd06-6385-4fb3-981e-08e85d33fe72 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:36.533409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 216/423] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:11:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:36.541547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fe4e5-4bce-4d5c-8e8d-620e51daf585 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:36.541669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18fd06-6385-4fb3-981e-08e85d33fe72 None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:36.544514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18fd06-6385-4fb3-981e-08e85d33fe72 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:36.547072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 208/424] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:36 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:36.551760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a9a30-c07f-4388-a3a8-c96075d568ee None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:36.551905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a9a30-c07f-4388-a3a8-c96075d568ee None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:36.552071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a9a30-c07f-4388-a3a8-c96075d568ee None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:36.557488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 209/425] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:36.557488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a9a30-c07f-4388-a3a8-c96075d568ee None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:36.630096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:36.674539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a9a30-c07f-4388-a3a8-c96075d568ee None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:36.680769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fe4e5-4bce-4d5c-8e8d-620e51daf585 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:36.711420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5517e2f-201a-4b21-bb4f-49b58eaf1a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:36.712213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5517e2f-201a-4b21-bb4f-49b58eaf1a2d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:36.712595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5517e2f-201a-4b21-bb4f-49b58eaf1a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:36.712973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5517e2f-201a-4b21-bb4f-49b58eaf1a2d None admin] PATH_INFO: `/v3/groups/690fc59160104eccad90fa08234f37e9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:36.714220 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5517e2f-201a-4b21-bb4f-49b58eaf1a2d None admin] RBAC: Authorizing `identity:get_group(group_id=690fc59160104eccad90fa08234f37e9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:36.715918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5517e2f-201a-4b21-bb4f-49b58eaf1a2d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:36.721349 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 210/426] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:36 2022] GET /identity/v3/groups/690fc59160104eccad90fa08234f37e9 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:36.722546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6d6d1-c5bb-4523-8e65-dd2100c390d1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:36.722826 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6d6d1-c5bb-4523-8e65-dd2100c390d1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:36.723099 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6d6d1-c5bb-4523-8e65-dd2100c390d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:36.729122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb9f0c-cbcd-4051-9645-60026a715b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:36.730017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb9f0c-cbcd-4051-9645-60026a715b47 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:36.730958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb9f0c-cbcd-4051-9645-60026a715b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:36.731381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb9f0c-cbcd-4051-9645-60026a715b47 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:36.732167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb9f0c-cbcd-4051-9645-60026a715b47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:36.732578 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb9f0c-cbcd-4051-9645-60026a715b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:36.734213 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb9f0c-cbcd-4051-9645-60026a715b47 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:36.742947 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-56f6d6d1-c5bb-4523-8e65-dd2100c390d1 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:36.744154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-56f6d6d1-c5bb-4523-8e65-dd2100c390d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:36.745139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 217/427] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:36.746837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb9f0c-cbcd-4051-9645-60026a715b47 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:36.816762 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:36.828612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 211/428] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:36.829500 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6d6d1-c5bb-4523-8e65-dd2100c390d1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:36.877924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb9f0c-cbcd-4051-9645-60026a715b47 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:36.939990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:36.943367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe9aa-96b4-4b5e-ac3b-932f3fecc139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:36.944135 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe9aa-96b4-4b5e-ac3b-932f3fecc139 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:36.944411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe9aa-96b4-4b5e-ac3b-932f3fecc139 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:36.944685 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe9aa-96b4-4b5e-ac3b-932f3fecc139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:36.946921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efe9aa-96b4-4b5e-ac3b-932f3fecc139 None admin] RBAC: Adding query filter params (group.id=690fc59160104eccad90fa08234f37e9, role.id=367ec0d2bcdc49f09b0772bbd737e5ce, scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:36.949952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efe9aa-96b4-4b5e-ac3b-932f3fecc139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:36.950131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efe9aa-96b4-4b5e-ac3b-932f3fecc139 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:36.960202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 218/429] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 03:11:36 2022] GET /identity/v3/role_assignments?group.id=690fc59160104eccad90fa08234f37e9&scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0&role.id=367ec0d2bcdc49f09b0772bbd737e5ce => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:36.996026 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6d6d1-c5bb-4523-8e65-dd2100c390d1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:37.034082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723574a1-7dc2-48c3-b3ff-8a3d341e5212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:37.034746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723574a1-7dc2-48c3-b3ff-8a3d341e5212 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:37.035024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723574a1-7dc2-48c3-b3ff-8a3d341e5212 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:37.035293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723574a1-7dc2-48c3-b3ff-8a3d341e5212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:37.101725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe9aa-96b4-4b5e-ac3b-932f3fecc139 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:37.121312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723574a1-7dc2-48c3-b3ff-8a3d341e5212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:37.121312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723574a1-7dc2-48c3-b3ff-8a3d341e5212 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:37.190714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:37.255500 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 212/430] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:37.256833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723574a1-7dc2-48c3-b3ff-8a3d341e5212 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:37.282517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe9aa-96b4-4b5e-ac3b-932f3fecc139 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:37.311241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:37.320668 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c828c-0516-4241-a31b-967cf39557ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:37.321337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c828c-0516-4241-a31b-967cf39557ad None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:37.327395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c828c-0516-4241-a31b-967cf39557ad None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:37.327395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c828c-0516-4241-a31b-967cf39557ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:37.334401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c828c-0516-4241-a31b-967cf39557ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-fe4c828c-0516-4241-a31b-967cf39557ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:37.339349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:37.340792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:37.341610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:37.341610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:37.341610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:37.341610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:37.341610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:37.341610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:37.341610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:37.341610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:37.341610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:37.341610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:37.341610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 03:11:37.341610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:37.345621 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 219/431] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:37.347304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c828c-0516-4241-a31b-967cf39557ad None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:37.375966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723574a1-7dc2-48c3-b3ff-8a3d341e5212 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:37.413798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ee09d-a010-48eb-9e29-18da1f629668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:37.414441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ee09d-a010-48eb-9e29-18da1f629668 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:37.414764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ee09d-a010-48eb-9e29-18da1f629668 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:37.415043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ee09d-a010-48eb-9e29-18da1f629668 None admin] PATH_INFO: `/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:37.416188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ee09d-a010-48eb-9e29-18da1f629668 None admin] RBAC: Authorizing `identity:get_project(project_id=ef2673a95ec34eb9a8e8191d5e0551e0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:37.417704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ee09d-a010-48eb-9e29-18da1f629668 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:37.419735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 213/432] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:37 2022] GET /identity/v3/projects/ef2673a95ec34eb9a8e8191d5e0551e0 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:37.426358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ee09d-a010-48eb-9e29-18da1f629668 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:37.457698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:37.466012 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c828c-0516-4241-a31b-967cf39557ad None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:37.502737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a7207-4bfe-49b5-a463-96900d70cf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:37.503452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a7207-4bfe-49b5-a463-96900d70cf30 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:37.503788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a7207-4bfe-49b5-a463-96900d70cf30 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:37.504129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a7207-4bfe-49b5-a463-96900d70cf30 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:37.504891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a7207-4bfe-49b5-a463-96900d70cf30 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:37.505282 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a7207-4bfe-49b5-a463-96900d70cf30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:37.506792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a7207-4bfe-49b5-a463-96900d70cf30 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:37.517330 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 220/433] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:11:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:37.523685 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a7207-4bfe-49b5-a463-96900d70cf30 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:37.543910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ee09d-a010-48eb-9e29-18da1f629668 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:37.578665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:37.585716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8108161-6287-48eb-97a5-150120d4886e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:37.586434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8108161-6287-48eb-97a5-150120d4886e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:37.586717 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8108161-6287-48eb-97a5-150120d4886e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:37.586995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8108161-6287-48eb-97a5-150120d4886e None admin] PATH_INFO: `/v3/groups/690fc59160104eccad90fa08234f37e9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:37.588290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8108161-6287-48eb-97a5-150120d4886e None admin] RBAC: Authorizing `identity:get_group(group_id=690fc59160104eccad90fa08234f37e9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:37.590594 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8108161-6287-48eb-97a5-150120d4886e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:37.593189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 214/434] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:37 2022] GET /identity/v3/groups/690fc59160104eccad90fa08234f37e9 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:37.600114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8108161-6287-48eb-97a5-150120d4886e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:37.645696 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a7207-4bfe-49b5-a463-96900d70cf30 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:37.684345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bf31c-1b7b-4b70-9701-58a49f9cf566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:37.684958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bf31c-1b7b-4b70-9701-58a49f9cf566 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:37.685234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bf31c-1b7b-4b70-9701-58a49f9cf566 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:37.685534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bf31c-1b7b-4b70-9701-58a49f9cf566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:37.717789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8108161-6287-48eb-97a5-150120d4886e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:37.728673 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:37.760774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c4ad1-7acf-4638-baa4-ea840bc43c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:37.762332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c4ad1-7acf-4638-baa4-ea840bc43c3b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:37.763105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c4ad1-7acf-4638-baa4-ea840bc43c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:37.763397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c4ad1-7acf-4638-baa4-ea840bc43c3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:37.764476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c4ad1-7acf-4638-baa4-ea840bc43c3b None admin] RBAC: Adding query filter params (group.id=690fc59160104eccad90fa08234f37e9, role.id=e577106295c544bfbe1944b178cb95e5, scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:37.764794 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c4ad1-7acf-4638-baa4-ea840bc43c3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:37.766544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c4ad1-7acf-4638-baa4-ea840bc43c3b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:37.776072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bf31c-1b7b-4b70-9701-58a49f9cf566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:37.777578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 215/435] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 03:11:37 2022] GET /identity/v3/role_assignments?group.id=690fc59160104eccad90fa08234f37e9&scope.project.id=ef2673a95ec34eb9a8e8191d5e0551e0&role.id=e577106295c544bfbe1944b178cb95e5 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:37.778173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bf31c-1b7b-4b70-9701-58a49f9cf566 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:37.779538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aab92-a1e5-46d1-820d-5adc5d6117b8 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:37.780066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aab92-a1e5-46d1-820d-5adc5d6117b8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:37.780538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90aab92-a1e5-46d1-820d-5adc5d6117b8 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:37.782517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 216/436] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:37.789107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588d5b7-a448-4d27-8701-4ac2380f0414 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:37.789679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588d5b7-a448-4d27-8701-4ac2380f0414 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:37.789964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588d5b7-a448-4d27-8701-4ac2380f0414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:37.820770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b588d5b7-a448-4d27-8701-4ac2380f0414 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:37.822611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b588d5b7-a448-4d27-8701-4ac2380f0414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:37.850056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:37.919051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 217/437] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:37.920821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f7173-8c68-4603-8f55-7f8f01e4ef95 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:37.921107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f7173-8c68-4603-8f55-7f8f01e4ef95 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:37.921450 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f7173-8c68-4603-8f55-7f8f01e4ef95 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:37.922757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 218/438] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:37.929056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f92c0-c654-4ca9-a7d1-d0d0cae6ecfb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:37.929363 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f92c0-c654-4ca9-a7d1-d0d0cae6ecfb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:37.929638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f92c0-c654-4ca9-a7d1-d0d0cae6ecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:37.934865 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 221/439] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:37.940990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bf31c-1b7b-4b70-9701-58a49f9cf566 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:37.950615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6a0f92c0-c654-4ca9-a7d1-d0d0cae6ecfb None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:37.952094 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6a0f92c0-c654-4ca9-a7d1-d0d0cae6ecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:38.041301 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 219/440] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:38.061180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bf31c-1b7b-4b70-9701-58a49f9cf566 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:38.097102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e697f7d-7b9b-4bf4-8cef-a4b4cbb6bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:38.097838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e697f7d-7b9b-4bf4-8cef-a4b4cbb6bd78 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:38.098116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e697f7d-7b9b-4bf4-8cef-a4b4cbb6bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:38.098386 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e697f7d-7b9b-4bf4-8cef-a4b4cbb6bd78 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:38.099501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e697f7d-7b9b-4bf4-8cef-a4b4cbb6bd78 None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:38.100996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e697f7d-7b9b-4bf4-8cef-a4b4cbb6bd78 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:38.102993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 222/441] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:37 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:38.108733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f92c0-c654-4ca9-a7d1-d0d0cae6ecfb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:38.129098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:38.213768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f92c0-c654-4ca9-a7d1-d0d0cae6ecfb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:38.235482 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e697f7d-7b9b-4bf4-8cef-a4b4cbb6bd78 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:38.253304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022c87-27be-4c64-b4e4-1f20253d244c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:38.253991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022c87-27be-4c64-b4e4-1f20253d244c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:38.254269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022c87-27be-4c64-b4e4-1f20253d244c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:38.254537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022c87-27be-4c64-b4e4-1f20253d244c None admin] PATH_INFO: `/v3/groups/690fc59160104eccad90fa08234f37e9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:38.255635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5022c87-27be-4c64-b4e4-1f20253d244c None admin] RBAC: Authorizing `identity:get_group(group_id=690fc59160104eccad90fa08234f37e9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:38.256372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:38.257066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5022c87-27be-4c64-b4e4-1f20253d244c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:38.258836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 220/442] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:38 2022] GET /identity/v3/groups/690fc59160104eccad90fa08234f37e9 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:38.266023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022c87-27be-4c64-b4e4-1f20253d244c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:38.356892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e697f7d-7b9b-4bf4-8cef-a4b4cbb6bd78 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:38.364864 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:38.379104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022c87-27be-4c64-b4e4-1f20253d244c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:38.390629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c80644-5c3d-4ebf-8456-ebd4988df379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:38.391338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c80644-5c3d-4ebf-8456-ebd4988df379 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:38.391612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c80644-5c3d-4ebf-8456-ebd4988df379 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:38.391886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c80644-5c3d-4ebf-8456-ebd4988df379 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:38.401665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c80644-5c3d-4ebf-8456-ebd4988df379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-44c80644-5c3d-4ebf-8456-ebd4988df379 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:38.407108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:38.408235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:38.409212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:38.409212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:38.409212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:38.409212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:38.409212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:38.409212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:38.409212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:38.409212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:38.409212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:38.409212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:38.409212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:38.409212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:38.409212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 223/443] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:11:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:38.410061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c80644-5c3d-4ebf-8456-ebd4988df379 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:38.416036 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77686dcb-90a8-47d1-b5de-caca23d8fbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:38.416637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77686dcb-90a8-47d1-b5de-caca23d8fbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:38.416917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77686dcb-90a8-47d1-b5de-caca23d8fbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:38.417187 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77686dcb-90a8-47d1-b5de-caca23d8fbd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:38.418582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77686dcb-90a8-47d1-b5de-caca23d8fbd9 None admin] RBAC: Adding query filter params (group.id=690fc59160104eccad90fa08234f37e9, role.id=367ec0d2bcdc49f09b0772bbd737e5ce, scope.project.id=f0b8022912c4451aa812e06166168cfa) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:38.418890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77686dcb-90a8-47d1-b5de-caca23d8fbd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:38.420319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77686dcb-90a8-47d1-b5de-caca23d8fbd9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:38.426104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 221/444] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 03:11:38 2022] GET /identity/v3/role_assignments?group.id=690fc59160104eccad90fa08234f37e9&scope.project.id=f0b8022912c4451aa812e06166168cfa&role.id=367ec0d2bcdc49f09b0772bbd737e5ce => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:38.426865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77686dcb-90a8-47d1-b5de-caca23d8fbd9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:38.498730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:38.523319 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c80644-5c3d-4ebf-8456-ebd4988df379 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:38.545485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77686dcb-90a8-47d1-b5de-caca23d8fbd9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:38.561580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8dde-1c99-4f69-bb63-add182bff627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:38.562220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8dde-1c99-4f69-bb63-add182bff627 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:38.562499 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8dde-1c99-4f69-bb63-add182bff627 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:38.562770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8dde-1c99-4f69-bb63-add182bff627 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:38.574717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab8dde-1c99-4f69-bb63-add182bff627 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-00ab8dde-1c99-4f69-bb63-add182bff627 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:38.579703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:38.581226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:38.582265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:38.582265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:38.582265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:38.582265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:38.582265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:38.582265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:38.582265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:38.582265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:38.582265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:38.582265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:38.582265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:11:38.582265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:38.585868 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 224/445] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:38.586824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8dde-1c99-4f69-bb63-add182bff627 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:38.590049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f828f63-d5f7-4bcd-8f01-594b8a350871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:38.590908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f828f63-d5f7-4bcd-8f01-594b8a350871 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:38.591394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f828f63-d5f7-4bcd-8f01-594b8a350871 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:38.591663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f828f63-d5f7-4bcd-8f01-594b8a350871 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:38.592331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f828f63-d5f7-4bcd-8f01-594b8a350871 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:38.592628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f828f63-d5f7-4bcd-8f01-594b8a350871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:38.594025 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f828f63-d5f7-4bcd-8f01-594b8a350871 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:38.603263 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 222/446] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:38.609595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f828f63-d5f7-4bcd-8f01-594b8a350871 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:38.627226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:38.697449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8dde-1c99-4f69-bb63-add182bff627 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:38.733730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f828f63-d5f7-4bcd-8f01-594b8a350871 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:38.739127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de3363-a335-4e0e-9121-3ac9764fcb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:38.739127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de3363-a335-4e0e-9121-3ac9764fcb9d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:38.739127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de3363-a335-4e0e-9121-3ac9764fcb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:38.739394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de3363-a335-4e0e-9121-3ac9764fcb9d None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:38.739956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de3363-a335-4e0e-9121-3ac9764fcb9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:38.740368 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de3363-a335-4e0e-9121-3ac9764fcb9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:38.742076 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de3363-a335-4e0e-9121-3ac9764fcb9d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:38.744593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:38.754655 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 225/447] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:38.759022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de3363-a335-4e0e-9121-3ac9764fcb9d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:38.783911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100037c9-4401-4347-b25a-ddd64b0888a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:38.784528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100037c9-4401-4347-b25a-ddd64b0888a8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:38.784810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100037c9-4401-4347-b25a-ddd64b0888a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:38.785083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100037c9-4401-4347-b25a-ddd64b0888a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:38.860076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100037c9-4401-4347-b25a-ddd64b0888a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:38.861581 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100037c9-4401-4347-b25a-ddd64b0888a8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:38.869635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de3363-a335-4e0e-9121-3ac9764fcb9d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:38.875264 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:38.903421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeafd8e-77b4-4ffd-bdf8-354dd83d5ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:38.904017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeafd8e-77b4-4ffd-bdf8-354dd83d5ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:38.904295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeafd8e-77b4-4ffd-bdf8-354dd83d5ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:38.904564 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeafd8e-77b4-4ffd-bdf8-354dd83d5ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:38.958523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 223/448] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 03:11:38.964154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100037c9-4401-4347-b25a-ddd64b0888a8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:38.967447 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:38.970835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeafd8e-77b4-4ffd-bdf8-354dd83d5ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:38.972322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeafd8e-77b4-4ffd-bdf8-354dd83d5ed9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:39.060709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100037c9-4401-4347-b25a-ddd64b0888a8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:39.070040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 226/449] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 03:11:39.073523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:39.075611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeafd8e-77b4-4ffd-bdf8-354dd83d5ed9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:39.094614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee02af-a887-44cc-9514-d3a22e589672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:39.095235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee02af-a887-44cc-9514-d3a22e589672 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:39.095520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee02af-a887-44cc-9514-d3a22e589672 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:39.095787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee02af-a887-44cc-9514-d3a22e589672 None admin] PATH_INFO: `/v3/projects/f0b8022912c4451aa812e06166168cfa` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:39.096890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee02af-a887-44cc-9514-d3a22e589672 None admin] RBAC: Authorizing `identity:get_project(project_id=f0b8022912c4451aa812e06166168cfa)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:39.098451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee02af-a887-44cc-9514-d3a22e589672 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:39.100191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 224/450] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:38 2022] GET /identity/v3/projects/f0b8022912c4451aa812e06166168cfa => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:39.106183 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee02af-a887-44cc-9514-d3a22e589672 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:39.178361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:39.182218 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeafd8e-77b4-4ffd-bdf8-354dd83d5ed9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:39.204129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee02af-a887-44cc-9514-d3a22e589672 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:39.215533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e979a53-7b97-4844-8c9a-058c5fbefefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:39.216157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e979a53-7b97-4844-8c9a-058c5fbefefd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:39.216446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e979a53-7b97-4844-8c9a-058c5fbefefd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:39.216701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e979a53-7b97-4844-8c9a-058c5fbefefd None admin] PATH_INFO: `/v3/projects/579008ca5633416b90d9e0cc4088e0c7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:39.217832 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e979a53-7b97-4844-8c9a-058c5fbefefd None admin] RBAC: Authorizing `identity:get_project(project_id=579008ca5633416b90d9e0cc4088e0c7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:39.219281 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e979a53-7b97-4844-8c9a-058c5fbefefd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:39.220890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 227/451] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:11:39 2022] GET /identity/v3/projects/579008ca5633416b90d9e0cc4088e0c7 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:39.226309 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e979a53-7b97-4844-8c9a-058c5fbefefd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:39.240453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df0856-f0e5-47ac-9787-3f31ba3d046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:39.241073 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0856-f0e5-47ac-9787-3f31ba3d046d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:39.241379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0856-f0e5-47ac-9787-3f31ba3d046d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:39.241650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df0856-f0e5-47ac-9787-3f31ba3d046d None admin] PATH_INFO: `/v3/groups/690fc59160104eccad90fa08234f37e9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:39.242731 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df0856-f0e5-47ac-9787-3f31ba3d046d None admin] RBAC: Authorizing `identity:get_group(group_id=690fc59160104eccad90fa08234f37e9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:39.244150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df0856-f0e5-47ac-9787-3f31ba3d046d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:39.245725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 225/452] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:39 2022] GET /identity/v3/groups/690fc59160104eccad90fa08234f37e9 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:39.251351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df0856-f0e5-47ac-9787-3f31ba3d046d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:39.298512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:39.322899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e979a53-7b97-4844-8c9a-058c5fbefefd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:39.347673 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df0856-f0e5-47ac-9787-3f31ba3d046d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:39.356133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0d98-aed1-4083-a789-afbe1740287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:39.356747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0d98-aed1-4083-a789-afbe1740287e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:39.357021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0d98-aed1-4083-a789-afbe1740287e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:39.357349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0d98-aed1-4083-a789-afbe1740287e None admin] PATH_INFO: `/v3/groups/af24e6270a1941e1bb9a8bc22da6235b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:39.358424 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc0d98-aed1-4083-a789-afbe1740287e None admin] RBAC: Authorizing `identity:get_group(group_id=af24e6270a1941e1bb9a8bc22da6235b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:39.359858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc0d98-aed1-4083-a789-afbe1740287e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:39.361431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 228/453] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Sep 13 03:11:39 2022] GET /identity/v3/groups/af24e6270a1941e1bb9a8bc22da6235b => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:39.367150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0d98-aed1-4083-a789-afbe1740287e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:39.381971 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc001e-a1c4-45d1-af73-3d60a88086c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:39.382566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc001e-a1c4-45d1-af73-3d60a88086c2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:39.382839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc001e-a1c4-45d1-af73-3d60a88086c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:39.383107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc001e-a1c4-45d1-af73-3d60a88086c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:39.383815 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc001e-a1c4-45d1-af73-3d60a88086c2 None admin] RBAC: Adding query filter params (group.id=690fc59160104eccad90fa08234f37e9, role.id=e577106295c544bfbe1944b178cb95e5, scope.project.id=f0b8022912c4451aa812e06166168cfa) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:39.384120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc001e-a1c4-45d1-af73-3d60a88086c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:39.385560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc001e-a1c4-45d1-af73-3d60a88086c2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:39.391742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 226/454] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 03:11:39 2022] GET /identity/v3/role_assignments?group.id=690fc59160104eccad90fa08234f37e9&scope.project.id=f0b8022912c4451aa812e06166168cfa&role.id=e577106295c544bfbe1944b178cb95e5 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:39.398904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:39.468775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0d98-aed1-4083-a789-afbe1740287e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:39.503689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a13d4-11a6-47c7-ad56-0ecf9cbaf94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:39.504296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a13d4-11a6-47c7-ad56-0ecf9cbaf94d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:39.504571 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a13d4-11a6-47c7-ad56-0ecf9cbaf94d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:39.504840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a13d4-11a6-47c7-ad56-0ecf9cbaf94d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:39.505597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a13d4-11a6-47c7-ad56-0ecf9cbaf94d None admin] RBAC: Adding query filter params (group.id=af24e6270a1941e1bb9a8bc22da6235b, role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=579008ca5633416b90d9e0cc4088e0c7) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:39.505902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a13d4-11a6-47c7-ad56-0ecf9cbaf94d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:39.507355 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a13d4-11a6-47c7-ad56-0ecf9cbaf94d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:39.514574 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 229/455] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Sep 13 03:11:39 2022] GET /identity/v3/role_assignments?group.id=af24e6270a1941e1bb9a8bc22da6235b&scope.project.id=579008ca5633416b90d9e0cc4088e0c7&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:42.085027 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3199a0f-5095-4325-8390-895930a3c90e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:42.085578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3199a0f-5095-4325-8390-895930a3c90e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:42.085578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3199a0f-5095-4325-8390-895930a3c90e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:42.087411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 227/456] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:42.094035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86717e9-6b6d-4ae9-b047-62114d533bb2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:42.094541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86717e9-6b6d-4ae9-b047-62114d533bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:42.094626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86717e9-6b6d-4ae9-b047-62114d533bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:42.118381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a86717e9-6b6d-4ae9-b047-62114d533bb2 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:42.119593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a86717e9-6b6d-4ae9-b047-62114d533bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:42.219860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 230/457] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:42.273693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1609a-68f6-470d-9778-b7002084aeda None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:42.273964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1609a-68f6-470d-9778-b7002084aeda None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:42.274402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1609a-68f6-470d-9778-b7002084aeda None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:42.276120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 228/458] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:42.281791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87a431-b68c-441d-b463-514d86fe9772 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:42.282082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87a431-b68c-441d-b463-514d86fe9772 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:42.282354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87a431-b68c-441d-b463-514d86fe9772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:42.310025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-eb87a431-b68c-441d-b463-514d86fe9772 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:42.311217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eb87a431-b68c-441d-b463-514d86fe9772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:42.339900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:42.397282 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 231/459] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:42.707774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1609a-68f6-470d-9778-b7002084aeda None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:42.735570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87a431-b68c-441d-b463-514d86fe9772 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:42.829655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1609a-68f6-470d-9778-b7002084aeda None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:42.844725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:42.853450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87a431-b68c-441d-b463-514d86fe9772 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:42.864790 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc5cda-9089-45ba-bdb2-140ded6b3f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:42.865438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc5cda-9089-45ba-bdb2-140ded6b3f9a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:42.867841 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc5cda-9089-45ba-bdb2-140ded6b3f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:42.867841 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc5cda-9089-45ba-bdb2-140ded6b3f9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:42.877633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc5cda-9089-45ba-bdb2-140ded6b3f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:42.879083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc5cda-9089-45ba-bdb2-140ded6b3f9a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:42.890839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9142c7-d54b-42a8-8251-88c2d42c7c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:42.891698 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9142c7-d54b-42a8-8251-88c2d42c7c30 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:42.892155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9142c7-d54b-42a8-8251-88c2d42c7c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:42.892628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9142c7-d54b-42a8-8251-88c2d42c7c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f6dc5cda-9089-45ba-bdb2-140ded6b3f9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:42.894817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:42.895708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:42.896561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:42.896561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:42.896561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:42.896561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 229/460] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:42.897504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe9bd-bf33-4a05-883a-6ca58b2405b3 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:42.897504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe9bd-bf33-4a05-883a-6ca58b2405b3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:42.897658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe9bd-bf33-4a05-883a-6ca58b2405b3 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:42.898875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 230/461] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:42.899728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d33fa-91ec-4ef2-b21c-38ded74fa4ae None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:42.900000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d33fa-91ec-4ef2-b21c-38ded74fa4ae None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:42.900268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d33fa-91ec-4ef2-b21c-38ded74fa4ae None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:42.901699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 231/462] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:42.904161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6fdb5-a05e-4b5e-9976-caf11085326c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:42.904446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6fdb5-a05e-4b5e-9976-caf11085326c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:42.904713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6fdb5-a05e-4b5e-9976-caf11085326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:42.914374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9142c7-d54b-42a8-8251-88c2d42c7c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:42.916132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9142c7-d54b-42a8-8251-88c2d42c7c30 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:42.923115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a0d6fdb5-a05e-4b5e-9976-caf11085326c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:42.924302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a0d6fdb5-a05e-4b5e-9976-caf11085326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6d9142c7-d54b-42a8-8251-88c2d42c7c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:42.934693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:42.935598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:42.936454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:42.936454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:42.936454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:42.936454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 232/463] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:42.936740 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9142c7-d54b-42a8-8251-88c2d42c7c30 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:42.949870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:43.000418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 232/464] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:43.001916 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f801d-04a3-43a7-85e1-32ded5103ac4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:43.002195 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f801d-04a3-43a7-85e1-32ded5103ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:43.002471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f801d-04a3-43a7-85e1-32ded5103ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:43.021688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f54f801d-04a3-43a7-85e1-32ded5103ac4 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:43.022866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f54f801d-04a3-43a7-85e1-32ded5103ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:43.057372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9142c7-d54b-42a8-8251-88c2d42c7c30 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:43.106598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 233/465] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:43.106598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f801d-04a3-43a7-85e1-32ded5103ac4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:43.107147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da54a44-834f-4089-aa75-1eae42565530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:43.107147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da54a44-834f-4089-aa75-1eae42565530 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:43.107147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da54a44-834f-4089-aa75-1eae42565530 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:43.107147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da54a44-834f-4089-aa75-1eae42565530 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:43.107687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da54a44-834f-4089-aa75-1eae42565530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:43.107687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da54a44-834f-4089-aa75-1eae42565530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:43.109982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da54a44-834f-4089-aa75-1eae42565530 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:43.149066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 233/466] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:43.155938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da54a44-834f-4089-aa75-1eae42565530 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:43.161180 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:43.281719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:43.294445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f801d-04a3-43a7-85e1-32ded5103ac4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:43.328208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da54a44-834f-4089-aa75-1eae42565530 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:43.334207 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f90e5-68a5-46f0-b5d3-18e6c0b87850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:43.334879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f90e5-68a5-46f0-b5d3-18e6c0b87850 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:43.335224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f90e5-68a5-46f0-b5d3-18e6c0b87850 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:43.335664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f90e5-68a5-46f0-b5d3-18e6c0b87850 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:43.336375 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f90e5-68a5-46f0-b5d3-18e6c0b87850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:43.336743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f90e5-68a5-46f0-b5d3-18e6c0b87850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:43.338328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f90e5-68a5-46f0-b5d3-18e6c0b87850 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:43.361416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 234/467] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:43.362627 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f90e5-68a5-46f0-b5d3-18e6c0b87850 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:43.371545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfede11-3c4e-4531-9a63-3bf01a818ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:43.372203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfede11-3c4e-4531-9a63-3bf01a818ed2 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:43.372483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfede11-3c4e-4531-9a63-3bf01a818ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:43.372753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfede11-3c4e-4531-9a63-3bf01a818ed2 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:43.373431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfede11-3c4e-4531-9a63-3bf01a818ed2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:43.375373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfede11-3c4e-4531-9a63-3bf01a818ed2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:43.452616 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:43.467925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f90e5-68a5-46f0-b5d3-18e6c0b87850 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:43.480691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 234/468] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:11:43 2022] POST /identity/v3/users => generated 246 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:11:43.482141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfede11-3c4e-4531-9a63-3bf01a818ed2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:43.516519 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532bf3f-5013-4f33-924b-ec3240e1d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:43.522688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532bf3f-5013-4f33-924b-ec3240e1d215 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:43.522688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532bf3f-5013-4f33-924b-ec3240e1d215 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:43.522688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532bf3f-5013-4f33-924b-ec3240e1d215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:43.530958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532bf3f-5013-4f33-924b-ec3240e1d215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:43.532674 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532bf3f-5013-4f33-924b-ec3240e1d215 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a532bf3f-5013-4f33-924b-ec3240e1d215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:43.550984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:43.551981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:43.558803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:43.558803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:43.558803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:43.558803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 235/469] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:43.558803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532bf3f-5013-4f33-924b-ec3240e1d215 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:43.620461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfede11-3c4e-4531-9a63-3bf01a818ed2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:43.657691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:43.676945 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe96f2-4a8c-46d9-a217-98800e55c8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:43.677995 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe96f2-4a8c-46d9-a217-98800e55c8bf None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:43.678952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe96f2-4a8c-46d9-a217-98800e55c8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:43.679425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe96f2-4a8c-46d9-a217-98800e55c8bf None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:43.680560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe96f2-4a8c-46d9-a217-98800e55c8bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:43.685390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe96f2-4a8c-46d9-a217-98800e55c8bf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:43.695481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532bf3f-5013-4f33-924b-ec3240e1d215 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:43.738840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3014b7-fb3c-4888-839b-76613903e138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:43.739525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3014b7-fb3c-4888-839b-76613903e138 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:43.739800 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3014b7-fb3c-4888-839b-76613903e138 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:43.740062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3014b7-fb3c-4888-839b-76613903e138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:43.743835 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:43.753364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3014b7-fb3c-4888-839b-76613903e138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:43.754815 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3014b7-fb3c-4888-839b-76613903e138 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-9a3014b7-fb3c-4888-839b-76613903e138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:43.769882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:43.770959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:43.771998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:43.771998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:43.771998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:43.773401 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 236/470] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:43.774298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3014b7-fb3c-4888-839b-76613903e138 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:43.802826 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 235/471] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:11:43 2022] POST /identity/v3/users => generated 248 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:11:43.803607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe96f2-4a8c-46d9-a217-98800e55c8bf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:43.932730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3014b7-fb3c-4888-839b-76613903e138 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:43.956121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe96f2-4a8c-46d9-a217-98800e55c8bf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:43.980430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce84db5-71ba-4099-8c02-2409af977fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:43.981768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce84db5-71ba-4099-8c02-2409af977fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:43.982276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce84db5-71ba-4099-8c02-2409af977fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:43.982746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce84db5-71ba-4099-8c02-2409af977fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:43.983602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce84db5-71ba-4099-8c02-2409af977fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:43.984562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce84db5-71ba-4099-8c02-2409af977fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:43.986489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce84db5-71ba-4099-8c02-2409af977fd5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:44.004515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbca83-38e6-4cec-b50b-5018df2bdd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:44.005124 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbca83-38e6-4cec-b50b-5018df2bdd6c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:44.005428 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbca83-38e6-4cec-b50b-5018df2bdd6c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:44.005699 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbca83-38e6-4cec-b50b-5018df2bdd6c None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:44.006554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbca83-38e6-4cec-b50b-5018df2bdd6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:44.006754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbca83-38e6-4cec-b50b-5018df2bdd6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:44.008192 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 237/472] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:44.008299 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbca83-38e6-4cec-b50b-5018df2bdd6c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:44.008804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ffd30-1816-49ed-99fe-013343b39621 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:44.009092 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ffd30-1816-49ed-99fe-013343b39621 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:44.010031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ffd30-1816-49ed-99fe-013343b39621 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:44.016403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 238/473] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:44.016403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ffd30-1816-49ed-99fe-013343b39621 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:44.023777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 236/474] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:44.025828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b51b9f-ccd4-48b6-a2a2-8c7355c8bbc9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:44.026105 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b51b9f-ccd4-48b6-a2a2-8c7355c8bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:44.026374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b51b9f-ccd4-48b6-a2a2-8c7355c8bbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:44.046358 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-46b51b9f-ccd4-48b6-a2a2-8c7355c8bbc9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:44.047543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-46b51b9f-ccd4-48b6-a2a2-8c7355c8bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:44.081363 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:44.095207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:44.142411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 237/475] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:44.144110 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b51b9f-ccd4-48b6-a2a2-8c7355c8bbc9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:44.162393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ffd30-1816-49ed-99fe-013343b39621 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:44.251585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b51b9f-ccd4-48b6-a2a2-8c7355c8bbc9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:44.277851 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445737df-73ff-497b-a60f-bdcfd82b8d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:44.278466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445737df-73ff-497b-a60f-bdcfd82b8d33 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:44.278745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445737df-73ff-497b-a60f-bdcfd82b8d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:44.279023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445737df-73ff-497b-a60f-bdcfd82b8d33 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:44.279673 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445737df-73ff-497b-a60f-bdcfd82b8d33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:44.281177 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445737df-73ff-497b-a60f-bdcfd82b8d33 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:44.299724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e50cc-d111-4506-b821-b4fca82750ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:44.300389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e50cc-d111-4506-b821-b4fca82750ab None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:44.300669 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e50cc-d111-4506-b821-b4fca82750ab None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:44.300938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e50cc-d111-4506-b821-b4fca82750ab None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:44.301617 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e50cc-d111-4506-b821-b4fca82750ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:44.304267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e50cc-d111-4506-b821-b4fca82750ab None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:44.398224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 239/476] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:11:44 2022] POST /identity/v3/users => generated 249 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:11:44.409382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445737df-73ff-497b-a60f-bdcfd82b8d33 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:44.428890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 238/477] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:11:44 2022] POST /identity/v3/users => generated 248 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:11:44.543569 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445737df-73ff-497b-a60f-bdcfd82b8d33 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:44.546701 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:44.587311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dec9f2-e15a-49d4-95c3-8e95aa679d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:44.588223 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dec9f2-e15a-49d4-95c3-8e95aa679d0a None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:44.588646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dec9f2-e15a-49d4-95c3-8e95aa679d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:44.589381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dec9f2-e15a-49d4-95c3-8e95aa679d0a None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:44.590208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dec9f2-e15a-49d4-95c3-8e95aa679d0a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:44.591763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dec9f2-e15a-49d4-95c3-8e95aa679d0a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:44.655875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.sql.core [None req-18dec9f2-e15a-49d4-95c3-8e95aa679d0a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 03:11:44.655875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 03:11:44.655875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [parameters: {'id': '0fc1204f2eee486fa65e3a96317021b7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 03:11:44.655875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81585) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-18dec9f2-e15a-49d4-95c3-8e95aa679d0a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Sep 13 03:11:44.673063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return ref.to_dict() Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 03:11:44.674251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application yield resource Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise self.value Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application session.commit() Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 03:11:44.675373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.flush() Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application compat.raise_( Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 03:11:44.676406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 03:11:44.677501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 03:11:44.678542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [parameters: {'id': '0fc1204f2eee486fa65e3a96317021b7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:44.679427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 03:11:44.680373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:44.683786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 240/478] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 13 03:11:44 2022] POST /identity/v3/roles => generated 144 bytes in 275 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:44.689544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e50cc-d111-4506-b821-b4fca82750ab None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:44.722277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:44.796849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e50cc-d111-4506-b821-b4fca82750ab None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:44.833438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed8333-23c8-4b18-b3f2-1b30040de692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:44.834118 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8333-23c8-4b18-b3f2-1b30040de692 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:44.834394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8333-23c8-4b18-b3f2-1b30040de692 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:44.834664 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8333-23c8-4b18-b3f2-1b30040de692 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:44.845610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed8333-23c8-4b18-b3f2-1b30040de692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-58ed8333-23c8-4b18-b3f2-1b30040de692 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:44.851108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:44.853144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:44.855583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:44.855583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:44.855583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:44.855583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:44.855583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:44.855583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:44.855583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:44.855583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:44.855583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:44.855583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:44.855583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 03:11:44.855583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:44.855583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 239/479] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:11:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:44.859695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dec9f2-e15a-49d4-95c3-8e95aa679d0a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:44.973757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dec9f2-e15a-49d4-95c3-8e95aa679d0a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:45.007839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58cd9c-b43c-44ef-857f-81ea73b82352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:45.008445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58cd9c-b43c-44ef-857f-81ea73b82352 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:45.008719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58cd9c-b43c-44ef-857f-81ea73b82352 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:45.008989 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58cd9c-b43c-44ef-857f-81ea73b82352 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:45.009730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58cd9c-b43c-44ef-857f-81ea73b82352 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:45.010030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58cd9c-b43c-44ef-857f-81ea73b82352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:45.011493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58cd9c-b43c-44ef-857f-81ea73b82352 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:45.025408 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 241/480] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:45.958692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dca9a7-8be5-49a7-a106-b5c8e5000d99 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:45.959711 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dca9a7-8be5-49a7-a106-b5c8e5000d99 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:45.960214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dca9a7-8be5-49a7-a106-b5c8e5000d99 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:45.961835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 240/481] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:45.967552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90623c79-b61e-4c84-8eb4-6b9cf50c3100 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:45.968399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90623c79-b61e-4c84-8eb4-6b9cf50c3100 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:45.968863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90623c79-b61e-4c84-8eb4-6b9cf50c3100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:45.990562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-90623c79-b61e-4c84-8eb4-6b9cf50c3100 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:45.992154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-90623c79-b61e-4c84-8eb4-6b9cf50c3100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:46.024235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:46.083975 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 242/482] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:46.395195 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dca9a7-8be5-49a7-a106-b5c8e5000d99 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:46.460181 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140552-a4be-4cc6-8a88-c2138c17421d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:46.461100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140552-a4be-4cc6-8a88-c2138c17421d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:46.461820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72140552-a4be-4cc6-8a88-c2138c17421d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:46.463719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 243/483] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:46.468845 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc1df7-c052-4b84-957e-7c54324d9099 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:46.469124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc1df7-c052-4b84-957e-7c54324d9099 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:46.469421 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc1df7-c052-4b84-957e-7c54324d9099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:46.515415 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-40fc1df7-c052-4b84-957e-7c54324d9099 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:46.516008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:46.516813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-40fc1df7-c052-4b84-957e-7c54324d9099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:46.541370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dca9a7-8be5-49a7-a106-b5c8e5000d99 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:46.582215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d41e9-571e-4fba-8f58-e6440c3573ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:46.583672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d41e9-571e-4fba-8f58-e6440c3573ff None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:46.584588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d41e9-571e-4fba-8f58-e6440c3573ff None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:46.585501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d41e9-571e-4fba-8f58-e6440c3573ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:46.609115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d41e9-571e-4fba-8f58-e6440c3573ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-1d0d41e9-571e-4fba-8f58-e6440c3573ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:46.616935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:46.617885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:46.618686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:46.618686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:46.618686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:46.618686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:46.618686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:46.618686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:46.618686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:46.618686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:46.618686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:46.618686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:46.618686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:46.618686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:46.623553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 241/484] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:11:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:46.630026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d41e9-571e-4fba-8f58-e6440c3573ff None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:46.659038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 244/485] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:46.757875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d41e9-571e-4fba-8f58-e6440c3573ff None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:46.810932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10204e8f-fe88-458b-aeb5-46021c9cef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:46.811542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10204e8f-fe88-458b-aeb5-46021c9cef69 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:46.811817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10204e8f-fe88-458b-aeb5-46021c9cef69 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:46.812087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10204e8f-fe88-458b-aeb5-46021c9cef69 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:46.812761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10204e8f-fe88-458b-aeb5-46021c9cef69 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:46.813060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10204e8f-fe88-458b-aeb5-46021c9cef69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:46.814498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10204e8f-fe88-458b-aeb5-46021c9cef69 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:46.828121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 242/486] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:11:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:46.833700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc1df7-c052-4b84-957e-7c54324d9099 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:46.950956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10204e8f-fe88-458b-aeb5-46021c9cef69 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:46.984024 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:47.005621 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:47.022774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc1df7-c052-4b84-957e-7c54324d9099 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:47.098822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a022783-8b30-4582-b9c4-49590368d054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:47.100242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a022783-8b30-4582-b9c4-49590368d054 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:47.100714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a022783-8b30-4582-b9c4-49590368d054 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:47.101176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a022783-8b30-4582-b9c4-49590368d054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:47.117287 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10204e8f-fe88-458b-aeb5-46021c9cef69 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:47.130420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a022783-8b30-4582-b9c4-49590368d054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:47.132350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a022783-8b30-4582-b9c4-49590368d054 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3a022783-8b30-4582-b9c4-49590368d054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:47.159173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:47.160057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:47.160895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:47.160895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:47.160895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:47.165652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 245/487] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:47.168128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a022783-8b30-4582-b9c4-49590368d054 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:47.189955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04f168-5799-4daf-8608-188aafab26e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:47.190890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04f168-5799-4daf-8608-188aafab26e7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:47.191363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04f168-5799-4daf-8608-188aafab26e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:47.191852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04f168-5799-4daf-8608-188aafab26e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:47.214756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04f168-5799-4daf-8608-188aafab26e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-cc04f168-5799-4daf-8608-188aafab26e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:47.222761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:47.223715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:47.224512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:47.224512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:47.224512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:47.224512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:47.224512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:47.224512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:47.224512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:47.224512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:47.224512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:47.224512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:47.224512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:47.224512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:47.224512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 243/488] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:11:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:47.229287 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04f168-5799-4daf-8608-188aafab26e7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:47.308763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a022783-8b30-4582-b9c4-49590368d054 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:47.321632 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:47.346125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22a803-357a-4e8d-abc9-f64c79e64edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:47.346728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22a803-357a-4e8d-abc9-f64c79e64edf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:47.347003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22a803-357a-4e8d-abc9-f64c79e64edf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:47.347273 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22a803-357a-4e8d-abc9-f64c79e64edf None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:47.347908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22a803-357a-4e8d-abc9-f64c79e64edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:47.348531 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22a803-357a-4e8d-abc9-f64c79e64edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:47.349664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22a803-357a-4e8d-abc9-f64c79e64edf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:47.364452 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 246/489] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:47.365402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1c66-3a13-4451-b026-8adbb1ff2cd5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:47.365682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1c66-3a13-4451-b026-8adbb1ff2cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:47.365999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1c66-3a13-4451-b026-8adbb1ff2cd5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:47.367615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04f168-5799-4daf-8608-188aafab26e7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:47.371350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 247/490] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:47.372498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3b443-ab96-4d7e-abfe-3b0f4c15790b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:47.372776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3b443-ab96-4d7e-abfe-3b0f4c15790b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:47.373043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3b443-ab96-4d7e-abfe-3b0f4c15790b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:47.374403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 248/491] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:47.375014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3b443-ab96-4d7e-abfe-3b0f4c15790b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:47.377881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:47.407926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81f08c-cbed-4451-b8c2-08de32ddca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:47.408857 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81f08c-cbed-4451-b8c2-08de32ddca0e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:47.409392 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81f08c-cbed-4451-b8c2-08de32ddca0e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:47.409727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81f08c-cbed-4451-b8c2-08de32ddca0e None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:47.410388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81f08c-cbed-4451-b8c2-08de32ddca0e None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:47.410690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81f08c-cbed-4451-b8c2-08de32ddca0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:47.412067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81f08c-cbed-4451-b8c2-08de32ddca0e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:47.420913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 244/492] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:11:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:47.421989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e04f1-e106-4f4f-954d-18667b718f76 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:47.422268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e04f1-e106-4f4f-954d-18667b718f76 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:47.422537 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e04f1-e106-4f4f-954d-18667b718f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:47.440917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5e7e04f1-e106-4f4f-954d-18667b718f76 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:47.442129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5e7e04f1-e106-4f4f-954d-18667b718f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:47.486266 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3b443-ab96-4d7e-abfe-3b0f4c15790b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:47.513545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 245/493] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:47.522603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3d758-5a6b-464a-8e9c-20b533f9ca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:47.522758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafeb96-2744-4b57-99d3-adb9b100bc39 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:47.522963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafeb96-2744-4b57-99d3-adb9b100bc39 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:47.523141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafeb96-2744-4b57-99d3-adb9b100bc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:47.523235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3d758-5a6b-464a-8e9c-20b533f9ca87 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:47.523493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3d758-5a6b-464a-8e9c-20b533f9ca87 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:47.523762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3d758-5a6b-464a-8e9c-20b533f9ca87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:47.531818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3d758-5a6b-464a-8e9c-20b533f9ca87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:47.533276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3d758-5a6b-464a-8e9c-20b533f9ca87 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:47.550590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-baafeb96-2744-4b57-99d3-adb9b100bc39 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:47.551825 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-baafeb96-2744-4b57-99d3-adb9b100bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b7c3d758-5a6b-464a-8e9c-20b533f9ca87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:11:47.552199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:47.553071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:47.554303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:47.554303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:47.554303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:11:47.554303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:11:47.554303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:11:47.554303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:11:47.554303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:11:47.554303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:11:47.554303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:11:47.554303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:47.557729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 249/494] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 03:11:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:47.558822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3d758-5a6b-464a-8e9c-20b533f9ca87 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:47.616255 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:47.633341 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 246/495] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:47.633341 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafeb96-2744-4b57-99d3-adb9b100bc39 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:47.665295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:47.734628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3d758-5a6b-464a-8e9c-20b533f9ca87 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:47.786656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafeb96-2744-4b57-99d3-adb9b100bc39 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:47.808201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c6902-7608-466d-8d35-98d969987fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:47.808862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c6902-7608-466d-8d35-98d969987fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:47.809276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c6902-7608-466d-8d35-98d969987fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:47.809626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c6902-7608-466d-8d35-98d969987fe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:47.821781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c6902-7608-466d-8d35-98d969987fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:47.823943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c6902-7608-466d-8d35-98d969987fe8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:47.830310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4973fe-0110-4efb-bd85-23056872f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:47.831081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4973fe-0110-4efb-bd85-23056872f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:47.831454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4973fe-0110-4efb-bd85-23056872f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:47.832434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4973fe-0110-4efb-bd85-23056872f9b3 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:47.833339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4973fe-0110-4efb-bd85-23056872f9b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:47.833771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4973fe-0110-4efb-bd85-23056872f9b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:47.836160 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4973fe-0110-4efb-bd85-23056872f9b3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3d3c6902-7608-466d-8d35-98d969987fe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:47.841603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:47.842762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:47.843817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:47.843817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:47.843817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:47.843817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 250/496] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:47.848716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c6902-7608-466d-8d35-98d969987fe8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:47.889375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 247/497] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 03:11:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:47.890327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4973fe-0110-4efb-bd85-23056872f9b3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:47.959189 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:47.974932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c6902-7608-466d-8d35-98d969987fe8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:47.988889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:48.007849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4973fe-0110-4efb-bd85-23056872f9b3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:48.008321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a44d5a-6090-4aba-8985-61d3b055f162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:48.008790 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a44d5a-6090-4aba-8985-61d3b055f162 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:48.009069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a44d5a-6090-4aba-8985-61d3b055f162 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:48.009364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a44d5a-6090-4aba-8985-61d3b055f162 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:48.021777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a44d5a-6090-4aba-8985-61d3b055f162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f4a44d5a-6090-4aba-8985-61d3b055f162 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:48.027776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:48.028917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 251/498] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:11:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:48.029791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a44d5a-6090-4aba-8985-61d3b055f162 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:48.044943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69845618-2d29-4cf7-9613-01d829ccec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:48.045506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69845618-2d29-4cf7-9613-01d829ccec5b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:48.045780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69845618-2d29-4cf7-9613-01d829ccec5b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:48.046043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69845618-2d29-4cf7-9613-01d829ccec5b None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:48.046674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69845618-2d29-4cf7-9613-01d829ccec5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:48.046976 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69845618-2d29-4cf7-9613-01d829ccec5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:48.048338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69845618-2d29-4cf7-9613-01d829ccec5b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:48.059168 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 248/499] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:48.060313 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bed19-3121-4f81-a3a7-d8a020df97d5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:48.060592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bed19-3121-4f81-a3a7-d8a020df97d5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:48.060862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bed19-3121-4f81-a3a7-d8a020df97d5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:48.062156 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 249/500] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:48.062846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bed19-3121-4f81-a3a7-d8a020df97d5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:48.135103 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a44d5a-6090-4aba-8985-61d3b055f162 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:48.165181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bed19-3121-4f81-a3a7-d8a020df97d5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:48.169132 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8084d-0c1b-4033-bf5f-aa43c60966ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:48.169777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8084d-0c1b-4033-bf5f-aa43c60966ff None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:48.170057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8084d-0c1b-4033-bf5f-aa43c60966ff None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:48.170329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8084d-0c1b-4033-bf5f-aa43c60966ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:48.175488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:48.199295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1c4bc-7806-422e-964b-09e9cdc0be68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:48.199903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1c4bc-7806-422e-964b-09e9cdc0be68 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:48.200177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1c4bc-7806-422e-964b-09e9cdc0be68 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:48.200446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1c4bc-7806-422e-964b-09e9cdc0be68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:48.210814 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1c4bc-7806-422e-964b-09e9cdc0be68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:48.213153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-95a1c4bc-7806-422e-964b-09e9cdc0be68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:48.216072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:48.216998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:48.218224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:48.218224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:48.218224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:48.218224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:48.218224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:48.218224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:48.218224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:48.218224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:48.218224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:48.218224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:48.218224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:48.218224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:48.218224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 250/501] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:11:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:48.219022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1c4bc-7806-422e-964b-09e9cdc0be68 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:48.244529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8084d-0c1b-4033-bf5f-aa43c60966ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:48.246039 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8084d-0c1b-4033-bf5f-aa43c60966ff None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:48.316835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1c4bc-7806-422e-964b-09e9cdc0be68 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:48.342969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 252/502] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:48.343786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8084d-0c1b-4033-bf5f-aa43c60966ff None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:48.354246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6c3be-d1ea-4af1-90d9-79a616929ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:48.355412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6c3be-d1ea-4af1-90d9-79a616929ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:48.355690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6c3be-d1ea-4af1-90d9-79a616929ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:48.355959 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6c3be-d1ea-4af1-90d9-79a616929ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:48.356620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6c3be-d1ea-4af1-90d9-79a616929ca5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:48.356923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6c3be-d1ea-4af1-90d9-79a616929ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:48.358338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6c3be-d1ea-4af1-90d9-79a616929ca5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:48.366131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 251/503] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:11:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:48.368332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff2fa3-c0aa-4f8d-8ecc-282fc43584c5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:48.368614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff2fa3-c0aa-4f8d-8ecc-282fc43584c5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:48.368885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff2fa3-c0aa-4f8d-8ecc-282fc43584c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:48.386809 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9aff2fa3-c0aa-4f8d-8ecc-282fc43584c5 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:48.387989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9aff2fa3-c0aa-4f8d-8ecc-282fc43584c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:48.413453 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:48.416046 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:48.440464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8084d-0c1b-4033-bf5f-aa43c60966ff None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:48.454553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 252/504] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:48.455367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff2fa3-c0aa-4f8d-8ecc-282fc43584c5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:48.476439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f72c8-b92e-415b-95dc-a8d6eef849ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:48.477142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f72c8-b92e-415b-95dc-a8d6eef849ad None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:48.477462 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f72c8-b92e-415b-95dc-a8d6eef849ad None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:48.477733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f72c8-b92e-415b-95dc-a8d6eef849ad None admin] PATH_INFO: `/v3/users/glance` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:48.487278 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f72c8-b92e-415b-95dc-a8d6eef849ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:48.488726 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f72c8-b92e-415b-95dc-a8d6eef849ad None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-173f72c8-b92e-415b-95dc-a8d6eef849ad None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:11:48.503151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:48.504070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:48.504958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:48.504958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:48.504958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:11:48.504958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:11:48.504958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:11:48.504958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:11:48.504958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:11:48.504958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:11:48.504958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 03:11:48.504958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:48.504958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 253/505] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:48.504958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f72c8-b92e-415b-95dc-a8d6eef849ad None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:48.571712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff2fa3-c0aa-4f8d-8ecc-282fc43584c5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:48.606896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147fc18-ca05-4d31-ae41-ac8039e6e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:48.607485 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147fc18-ca05-4d31-ae41-ac8039e6e525 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:48.607757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147fc18-ca05-4d31-ae41-ac8039e6e525 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:48.608028 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147fc18-ca05-4d31-ae41-ac8039e6e525 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:48.608680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147fc18-ca05-4d31-ae41-ac8039e6e525 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:48.608976 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147fc18-ca05-4d31-ae41-ac8039e6e525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:48.610392 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147fc18-ca05-4d31-ae41-ac8039e6e525 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:48.616503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f72c8-b92e-415b-95dc-a8d6eef849ad None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:48.618640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 253/506] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:11:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:48.619510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147fc18-ca05-4d31-ae41-ac8039e6e525 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:48.645518 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:48.653391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d251c8e-962c-4f67-85ea-cfd86fc5c542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:48.654024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d251c8e-962c-4f67-85ea-cfd86fc5c542 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:48.654304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d251c8e-962c-4f67-85ea-cfd86fc5c542 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:48.674566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d251c8e-962c-4f67-85ea-cfd86fc5c542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:48.674566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:48.674566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d251c8e-962c-4f67-85ea-cfd86fc5c542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:48.674566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d251c8e-962c-4f67-85ea-cfd86fc5c542 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-0d251c8e-962c-4f67-85ea-cfd86fc5c542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:48.681893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:48.682825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:48.683697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:48.683697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:48.683697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:48.687763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 254/507] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:48.689268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d251c8e-962c-4f67-85ea-cfd86fc5c542 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:48.720862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147fc18-ca05-4d31-ae41-ac8039e6e525 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:48.753204 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7740c0d-fff8-43d0-8f0d-b50c254f61ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:48.753857 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7740c0d-fff8-43d0-8f0d-b50c254f61ac None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:48.754135 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7740c0d-fff8-43d0-8f0d-b50c254f61ac None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:48.754405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7740c0d-fff8-43d0-8f0d-b50c254f61ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:48.765652 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7740c0d-fff8-43d0-8f0d-b50c254f61ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:48.767172 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7740c0d-fff8-43d0-8f0d-b50c254f61ac None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e7740c0d-fff8-43d0-8f0d-b50c254f61ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:48.781654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:48.782736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:48.783784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:48.783784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:48.783784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:48.783784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 254/508] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:48.783784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7740c0d-fff8-43d0-8f0d-b50c254f61ac None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:48.793082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d251c8e-962c-4f67-85ea-cfd86fc5c542 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:48.826657 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158430ac-4dcd-4e29-b07f-6dfb9f794e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:48.827193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158430ac-4dcd-4e29-b07f-6dfb9f794e9a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:48.827493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158430ac-4dcd-4e29-b07f-6dfb9f794e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:48.827772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158430ac-4dcd-4e29-b07f-6dfb9f794e9a None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:48.828494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158430ac-4dcd-4e29-b07f-6dfb9f794e9a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:48.828801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158430ac-4dcd-4e29-b07f-6dfb9f794e9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:48.830271 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158430ac-4dcd-4e29-b07f-6dfb9f794e9a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:48.858100 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:48.867186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 255/509] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 13 03:11:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:48.871488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158430ac-4dcd-4e29-b07f-6dfb9f794e9a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:48.884066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7740c0d-fff8-43d0-8f0d-b50c254f61ac None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:48.915827 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:48.918937 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb50d9-f7c5-443f-b4a7-d3ba530ee8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:48.919745 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb50d9-f7c5-443f-b4a7-d3ba530ee8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:48.920028 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb50d9-f7c5-443f-b4a7-d3ba530ee8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:48.920302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb50d9-f7c5-443f-b4a7-d3ba530ee8b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:48.930665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb50d9-f7c5-443f-b4a7-d3ba530ee8b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:48.932205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb50d9-f7c5-443f-b4a7-d3ba530ee8b0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-abeb50d9-f7c5-443f-b4a7-d3ba530ee8b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:48.947365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:48.949102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:48.950066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:48.950066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:48.950066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:48.950066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 255/510] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:48.950066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb50d9-f7c5-443f-b4a7-d3ba530ee8b0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:48.971600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158430ac-4dcd-4e29-b07f-6dfb9f794e9a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:49.005876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a78c-82a0-407b-a0a2-9372c699f03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:49.006472 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a78c-82a0-407b-a0a2-9372c699f03b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:49.006751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a78c-82a0-407b-a0a2-9372c699f03b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:49.007020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a78c-82a0-407b-a0a2-9372c699f03b None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:49.007660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831a78c-82a0-407b-a0a2-9372c699f03b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:49.007963 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831a78c-82a0-407b-a0a2-9372c699f03b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:49.009364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831a78c-82a0-407b-a0a2-9372c699f03b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:49.020966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 256/511] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:49.021771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a78c-82a0-407b-a0a2-9372c699f03b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:49.048325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb50d9-f7c5-443f-b4a7-d3ba530ee8b0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:49.074620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:49.085200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9a0a8-ef41-4ae8-962a-83b939aab45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:49.085200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a0a8-ef41-4ae8-962a-83b939aab45d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:49.085200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a0a8-ef41-4ae8-962a-83b939aab45d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:49.085200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a0a8-ef41-4ae8-962a-83b939aab45d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:49.093665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9a0a8-ef41-4ae8-962a-83b939aab45d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:49.095329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9a0a8-ef41-4ae8-962a-83b939aab45d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9cb9a0a8-ef41-4ae8-962a-83b939aab45d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:49.109420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:49.110441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:49.111293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:49.111293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:49.111293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:49.111293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 256/512] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:49.111293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9a0a8-ef41-4ae8-962a-83b939aab45d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:49.123052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a78c-82a0-407b-a0a2-9372c699f03b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:49.125312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:49.159295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366d162-019f-43e8-bda1-61608f411600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:49.159892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366d162-019f-43e8-bda1-61608f411600 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:49.160330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366d162-019f-43e8-bda1-61608f411600 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:49.160604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366d162-019f-43e8-bda1-61608f411600 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:49.161248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366d162-019f-43e8-bda1-61608f411600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:49.161570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366d162-019f-43e8-bda1-61608f411600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:49.162924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366d162-019f-43e8-bda1-61608f411600 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:49.174268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 257/513] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:49.175038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366d162-019f-43e8-bda1-61608f411600 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:49.212355 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9a0a8-ef41-4ae8-962a-83b939aab45d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:49.245891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79596781-a3e9-4f40-972f-73e0ee4c3d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:49.246760 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79596781-a3e9-4f40-972f-73e0ee4c3d67 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:49.247038 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79596781-a3e9-4f40-972f-73e0ee4c3d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:49.247307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79596781-a3e9-4f40-972f-73e0ee4c3d67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:49.275572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366d162-019f-43e8-bda1-61608f411600 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:49.298141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:49.317354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79596781-a3e9-4f40-972f-73e0ee4c3d67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:49.318884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79596781-a3e9-4f40-972f-73e0ee4c3d67 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:49.319490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002febe-95ee-42b4-a135-6ce3661b4951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:49.320089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002febe-95ee-42b4-a135-6ce3661b4951 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:49.320363 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002febe-95ee-42b4-a135-6ce3661b4951 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:49.321330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002febe-95ee-42b4-a135-6ce3661b4951 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:49.321330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002febe-95ee-42b4-a135-6ce3661b4951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:49.321645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002febe-95ee-42b4-a135-6ce3661b4951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:49.323013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002febe-95ee-42b4-a135-6ce3661b4951 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:49.335110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 258/514] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:49.336239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002febe-95ee-42b4-a135-6ce3661b4951 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:49.374260 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:49.428441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 257/515] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:49.429457 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79596781-a3e9-4f40-972f-73e0ee4c3d67 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:49.454159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002febe-95ee-42b4-a135-6ce3661b4951 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:49.495784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61472634-f6fc-40cb-bb81-60c0c5983235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:49.496420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61472634-f6fc-40cb-bb81-60c0c5983235 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:49.496697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61472634-f6fc-40cb-bb81-60c0c5983235 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:49.496964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61472634-f6fc-40cb-bb81-60c0c5983235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:49.503738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61472634-f6fc-40cb-bb81-60c0c5983235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:49.505210 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61472634-f6fc-40cb-bb81-60c0c5983235 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:49.516602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-61472634-f6fc-40cb-bb81-60c0c5983235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:11:49.517435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:49.518265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:49.519128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:11:49.519128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:11:49.519128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:11:49.519128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:11:49.519128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:11:49.519128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:11:49.519128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:49.519128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:49.519555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 259/516] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:49.520066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61472634-f6fc-40cb-bb81-60c0c5983235 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:49.540569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79596781-a3e9-4f40-972f-73e0ee4c3d67 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:49.575787 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086be67-0458-4250-9f24-8981a15f336a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:49.576687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086be67-0458-4250-9f24-8981a15f336a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:49.576963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086be67-0458-4250-9f24-8981a15f336a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:49.577232 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086be67-0458-4250-9f24-8981a15f336a None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:49.577899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086be67-0458-4250-9f24-8981a15f336a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:49.578197 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086be67-0458-4250-9f24-8981a15f336a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:49.579576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086be67-0458-4250-9f24-8981a15f336a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:49.591122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 258/517] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:49.591712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086be67-0458-4250-9f24-8981a15f336a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:49.608911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:49.624335 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61472634-f6fc-40cb-bb81-60c0c5983235 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:49.658524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fbe5b-3233-4a1e-bb0e-e0054cdd221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:49.659145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fbe5b-3233-4a1e-bb0e-e0054cdd221a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:49.659422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fbe5b-3233-4a1e-bb0e-e0054cdd221a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:49.659689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fbe5b-3233-4a1e-bb0e-e0054cdd221a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:49.666518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fbe5b-3233-4a1e-bb0e-e0054cdd221a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:49.668593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fbe5b-3233-4a1e-bb0e-e0054cdd221a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a94fbe5b-3233-4a1e-bb0e-e0054cdd221a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:11:49.680138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:49.681144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:49.682312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:49.682312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:49.682312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:11:49.682312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:11:49.682312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:11:49.682312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:11:49.682312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:11:49.682312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:11:49.682312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 03:11:49.682312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:49.682312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 260/518] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:49.682312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fbe5b-3233-4a1e-bb0e-e0054cdd221a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:49.691564 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086be67-0458-4250-9f24-8981a15f336a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:49.724582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431ef00-f9cc-4224-9d6f-3dd3e3dd07cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:49.725542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431ef00-f9cc-4224-9d6f-3dd3e3dd07cb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:49.725826 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431ef00-f9cc-4224-9d6f-3dd3e3dd07cb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:49.726097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431ef00-f9cc-4224-9d6f-3dd3e3dd07cb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:49.734218 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431ef00-f9cc-4224-9d6f-3dd3e3dd07cb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:49.735643 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431ef00-f9cc-4224-9d6f-3dd3e3dd07cb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:49.738139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5431ef00-f9cc-4224-9d6f-3dd3e3dd07cb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:11:49.748494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:49.754878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:49.755775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:49.755775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:49.755775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:11:49.755775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:11:49.755775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:11:49.755775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:11:49.755775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:11:49.755775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:11:49.755775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 03:11:49.755775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:49.755775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 259/519] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:11:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:49.755775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431ef00-f9cc-4224-9d6f-3dd3e3dd07cb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:49.782051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fbe5b-3233-4a1e-bb0e-e0054cdd221a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:49.814932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3d8b2-52f6-4925-a3ff-43373804e5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:49.815555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3d8b2-52f6-4925-a3ff-43373804e5be None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:49.815837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3d8b2-52f6-4925-a3ff-43373804e5be None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:49.816107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3d8b2-52f6-4925-a3ff-43373804e5be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:49.826447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3d8b2-52f6-4925-a3ff-43373804e5be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:49.827897 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3d8b2-52f6-4925-a3ff-43373804e5be None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:49.830365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f9a3d8b2-52f6-4925-a3ff-43373804e5be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:49.842884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:49.843874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:49.844728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:49.844728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:49.844728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:49.844728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 261/520] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:49.844728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3d8b2-52f6-4925-a3ff-43373804e5be None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:49.852088 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431ef00-f9cc-4224-9d6f-3dd3e3dd07cb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:49.884793 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd7d99-425c-4b35-9b6d-9c2f3c61dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:49.885418 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd7d99-425c-4b35-9b6d-9c2f3c61dc37 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:49.885725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd7d99-425c-4b35-9b6d-9c2f3c61dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:49.885991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd7d99-425c-4b35-9b6d-9c2f3c61dc37 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:49.886925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd7d99-425c-4b35-9b6d-9c2f3c61dc37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:49.887223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd7d99-425c-4b35-9b6d-9c2f3c61dc37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:49.888659 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd7d99-425c-4b35-9b6d-9c2f3c61dc37 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:49.905916 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 260/521] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:11:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:49.906774 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd7d99-425c-4b35-9b6d-9c2f3c61dc37 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:49.949030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3d8b2-52f6-4925-a3ff-43373804e5be None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:49.965668 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:49.983039 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec50ed-e87c-4e96-8c05-3bfeb01ff286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:49.983636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec50ed-e87c-4e96-8c05-3bfeb01ff286 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:49.983914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec50ed-e87c-4e96-8c05-3bfeb01ff286 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:49.984183 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec50ed-e87c-4e96-8c05-3bfeb01ff286 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:49.984820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec50ed-e87c-4e96-8c05-3bfeb01ff286 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:49.986406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec50ed-e87c-4e96-8c05-3bfeb01ff286 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:50.004629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd7d99-425c-4b35-9b6d-9c2f3c61dc37 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:50.038515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69748663-7118-4ebd-8786-e30034bb87dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:50.039105 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69748663-7118-4ebd-8786-e30034bb87dd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:50.039381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69748663-7118-4ebd-8786-e30034bb87dd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:50.039647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69748663-7118-4ebd-8786-e30034bb87dd None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:50.040371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69748663-7118-4ebd-8786-e30034bb87dd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:50.040673 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69748663-7118-4ebd-8786-e30034bb87dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:50.042221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69748663-7118-4ebd-8786-e30034bb87dd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:50.058473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 261/522] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 13 03:11:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:50.059235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69748663-7118-4ebd-8786-e30034bb87dd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:50.089757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 262/523] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:11:49 2022] POST /identity/v3/users => generated 247 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:11:50.091128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec50ed-e87c-4e96-8c05-3bfeb01ff286 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:50.170286 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69748663-7118-4ebd-8786-e30034bb87dd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:50.178440 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:50.190607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:50.209196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae0b5-9f86-4194-bcea-aa23831fdfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:50.209867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae0b5-9f86-4194-bcea-aa23831fdfc2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:50.210141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae0b5-9f86-4194-bcea-aa23831fdfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:50.210409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae0b5-9f86-4194-bcea-aa23831fdfc2 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:50.211149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ae0b5-9f86-4194-bcea-aa23831fdfc2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:50.211489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ae0b5-9f86-4194-bcea-aa23831fdfc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:50.212921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ae0b5-9f86-4194-bcea-aa23831fdfc2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:50.231345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec50ed-e87c-4e96-8c05-3bfeb01ff286 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:50.236956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 262/524] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Sep 13 03:11:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:50.236956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae0b5-9f86-4194-bcea-aa23831fdfc2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:50.274768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e139a-6811-4cd5-aaaa-d7e9f6d43562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:50.275387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e139a-6811-4cd5-aaaa-d7e9f6d43562 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:50.275773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e139a-6811-4cd5-aaaa-d7e9f6d43562 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:50.276102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e139a-6811-4cd5-aaaa-d7e9f6d43562 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:50.277406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e139a-6811-4cd5-aaaa-d7e9f6d43562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:50.280398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e139a-6811-4cd5-aaaa-d7e9f6d43562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:50.280398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e139a-6811-4cd5-aaaa-d7e9f6d43562 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:50.291544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 263/525] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:50.292481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e139a-6811-4cd5-aaaa-d7e9f6d43562 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:50.358708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae0b5-9f86-4194-bcea-aa23831fdfc2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:50.395575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5da57b-94cb-4a93-9346-4cb022bd4a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:50.396176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5da57b-94cb-4a93-9346-4cb022bd4a83 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:50.396760 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5da57b-94cb-4a93-9346-4cb022bd4a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:50.397032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5da57b-94cb-4a93-9346-4cb022bd4a83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:50.398035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5da57b-94cb-4a93-9346-4cb022bd4a83 None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=fcff121c9e974a6aabaa18775de65f63) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:50.398341 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5da57b-94cb-4a93-9346-4cb022bd4a83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:50.400546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5da57b-94cb-4a93-9346-4cb022bd4a83 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:50.402253 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e139a-6811-4cd5-aaaa-d7e9f6d43562 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:50.413367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 263/526] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:50 2022] GET /identity/v3/role_assignments?user.id=fcff121c9e974a6aabaa18775de65f63&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:50.413367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5da57b-94cb-4a93-9346-4cb022bd4a83 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:50.422117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:50.450653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96810b-619f-4766-ab13-e16821076a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:50.453580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96810b-619f-4766-ab13-e16821076a0f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:50.454145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96810b-619f-4766-ab13-e16821076a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:50.454622 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96810b-619f-4766-ab13-e16821076a0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:50.458912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:50.542174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96810b-619f-4766-ab13-e16821076a0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:50.542407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5da57b-94cb-4a93-9346-4cb022bd4a83 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:50.544186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96810b-619f-4766-ab13-e16821076a0f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:50.593035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217aece-529b-49fa-96c4-23f7964a56d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:50.593725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217aece-529b-49fa-96c4-23f7964a56d7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:50.594003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217aece-529b-49fa-96c4-23f7964a56d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:50.594271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217aece-529b-49fa-96c4-23f7964a56d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:50.670181 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 264/527] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:50.670181 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96810b-619f-4766-ab13-e16821076a0f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:50.685836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:50.694442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217aece-529b-49fa-96c4-23f7964a56d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:50.703275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217aece-529b-49fa-96c4-23f7964a56d7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:50.740456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:50.800347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96810b-619f-4766-ab13-e16821076a0f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:50.806759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 264/528] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:11:50.808288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217aece-529b-49fa-96c4-23f7964a56d7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:50.841370 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a4116-3da2-41c2-99a1-ecb69cdb6525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:50.842441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a4116-3da2-41c2-99a1-ecb69cdb6525 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:50.842965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a4116-3da2-41c2-99a1-ecb69cdb6525 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:50.843467 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a4116-3da2-41c2-99a1-ecb69cdb6525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:50.850965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a4116-3da2-41c2-99a1-ecb69cdb6525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:50.852798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a4116-3da2-41c2-99a1-ecb69cdb6525 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-175a4116-3da2-41c2-99a1-ecb69cdb6525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:11:50.868045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:50.868943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:50.870399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:11:50.870399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:11:50.870399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:11:50.870399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:11:50.870399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:11:50.870399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:11:50.870399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:50.870399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:50.873429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 265/529] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:50.874513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a4116-3da2-41c2-99a1-ecb69cdb6525 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:50.917695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217aece-529b-49fa-96c4-23f7964a56d7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:50.962957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:50.963756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769194a-fcaf-4118-98cf-5458cda72063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:50.964391 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769194a-fcaf-4118-98cf-5458cda72063 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:50.964662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769194a-fcaf-4118-98cf-5458cda72063 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:50.964926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769194a-fcaf-4118-98cf-5458cda72063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:50.975583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:50.978648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769194a-fcaf-4118-98cf-5458cda72063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:50.981079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769194a-fcaf-4118-98cf-5458cda72063 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:50.994047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a4116-3da2-41c2-99a1-ecb69cdb6525 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6769194a-fcaf-4118-98cf-5458cda72063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:51.001191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:51.002356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:51.003400 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:51.003400 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:51.003400 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:51.005323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 265/530] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:51.006812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769194a-fcaf-4118-98cf-5458cda72063 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:51.036738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc48cd8-6667-4ac3-a39d-d81fb30a2dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:51.038126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc48cd8-6667-4ac3-a39d-d81fb30a2dae None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:51.038509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc48cd8-6667-4ac3-a39d-d81fb30a2dae None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:51.038874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc48cd8-6667-4ac3-a39d-d81fb30a2dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:51.052175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc48cd8-6667-4ac3-a39d-d81fb30a2dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:51.053786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc48cd8-6667-4ac3-a39d-d81fb30a2dae None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-fcc48cd8-6667-4ac3-a39d-d81fb30a2dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:51.072214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:51.073389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:51.074292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:51.074292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:51.074292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:51.079507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 266/531] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:51.079507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc48cd8-6667-4ac3-a39d-d81fb30a2dae None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:51.160116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769194a-fcaf-4118-98cf-5458cda72063 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:51.199757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc48cd8-6667-4ac3-a39d-d81fb30a2dae None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:51.206211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcebce3-ffe1-4171-9762-eeee52229570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:51.207057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcebce3-ffe1-4171-9762-eeee52229570 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:51.208074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcebce3-ffe1-4171-9762-eeee52229570 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:51.208522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcebce3-ffe1-4171-9762-eeee52229570 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:51.209457 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcebce3-ffe1-4171-9762-eeee52229570 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:51.210358 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcebce3-ffe1-4171-9762-eeee52229570 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:51.212657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcebce3-ffe1-4171-9762-eeee52229570 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:51.226020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:51.230716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 266/532] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:51.231877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcebce3-ffe1-4171-9762-eeee52229570 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:51.243746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aec854-4b9f-4d52-b958-044fd6e83632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:51.244351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aec854-4b9f-4d52-b958-044fd6e83632 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:51.244624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aec854-4b9f-4d52-b958-044fd6e83632 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:51.244979 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aec854-4b9f-4d52-b958-044fd6e83632 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:51.246176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aec854-4b9f-4d52-b958-044fd6e83632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:51.246618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aec854-4b9f-4d52-b958-044fd6e83632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:51.248137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aec854-4b9f-4d52-b958-044fd6e83632 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:51.261853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 267/533] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:51.262905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aec854-4b9f-4d52-b958-044fd6e83632 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:51.290543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:51.345125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcebce3-ffe1-4171-9762-eeee52229570 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:51.381563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aec854-4b9f-4d52-b958-044fd6e83632 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:51.384836 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb6634-e8e1-4a2a-a906-8ee6297c0869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:51.385776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb6634-e8e1-4a2a-a906-8ee6297c0869 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:51.386232 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb6634-e8e1-4a2a-a906-8ee6297c0869 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:51.386926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb6634-e8e1-4a2a-a906-8ee6297c0869 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:51.387736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb6634-e8e1-4a2a-a906-8ee6297c0869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:51.388233 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb6634-e8e1-4a2a-a906-8ee6297c0869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:51.389900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb6634-e8e1-4a2a-a906-8ee6297c0869 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:51.407913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 267/534] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:51.409187 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb6634-e8e1-4a2a-a906-8ee6297c0869 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:51.419021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e53d15-da6c-4d90-9403-f544cd4815a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:51.420053 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53d15-da6c-4d90-9403-f544cd4815a6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:51.420338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53d15-da6c-4d90-9403-f544cd4815a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:51.420609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e53d15-da6c-4d90-9403-f544cd4815a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:51.421362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e53d15-da6c-4d90-9403-f544cd4815a6 None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=f746dd2ce4404b679db81794c4d23f26) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:51.421671 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e53d15-da6c-4d90-9403-f544cd4815a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:51.423484 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e53d15-da6c-4d90-9403-f544cd4815a6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:51.437347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 268/535] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:51 2022] GET /identity/v3/role_assignments?user.id=f746dd2ce4404b679db81794c4d23f26&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:51.438595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e53d15-da6c-4d90-9403-f544cd4815a6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:51.554929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:51.592471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb6634-e8e1-4a2a-a906-8ee6297c0869 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:51.608181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:51.640101 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a705a-3fd4-4063-896c-86cd9ed9597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:51.641222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a705a-3fd4-4063-896c-86cd9ed9597b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:51.641725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a705a-3fd4-4063-896c-86cd9ed9597b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:51.642190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a705a-3fd4-4063-896c-86cd9ed9597b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:51.649971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a705a-3fd4-4063-896c-86cd9ed9597b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:51.652375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a705a-3fd4-4063-896c-86cd9ed9597b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:51.653936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e53d15-da6c-4d90-9403-f544cd4815a6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-609a705a-3fd4-4063-896c-86cd9ed9597b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:11:51.667333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:51.668297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:51.669149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:11:51.669149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:11:51.669149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:11:51.669149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:11:51.669149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:11:51.669149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:11:51.669149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:51.669149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:51.672839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 268/536] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:51.679576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a705a-3fd4-4063-896c-86cd9ed9597b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:51.691880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd4f75-f819-4022-8ec7-e16aa0d88222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:51.691880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd4f75-f819-4022-8ec7-e16aa0d88222 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:51.691880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd4f75-f819-4022-8ec7-e16aa0d88222 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:51.691880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd4f75-f819-4022-8ec7-e16aa0d88222 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:51.702323 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd4f75-f819-4022-8ec7-e16aa0d88222 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:51.703972 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd4f75-f819-4022-8ec7-e16aa0d88222 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-93dd4f75-f819-4022-8ec7-e16aa0d88222 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:11:51.725593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:51.726489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:51.727332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:11:51.727332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:11:51.727332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:11:51.727332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:11:51.727332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:11:51.727332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:11:51.727332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:51.727332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:51.727733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 269/537] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:51.738659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd4f75-f819-4022-8ec7-e16aa0d88222 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:51.888940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd4f75-f819-4022-8ec7-e16aa0d88222 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:51.894541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a705a-3fd4-4063-896c-86cd9ed9597b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:51.898531 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:51.924975 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f1fc5-d2bd-4cf3-a9b1-f45b022c146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:51.925825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f1fc5-d2bd-4cf3-a9b1-f45b022c146d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:51.926384 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f1fc5-d2bd-4cf3-a9b1-f45b022c146d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:51.926805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f1fc5-d2bd-4cf3-a9b1-f45b022c146d None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:51.927632 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f1fc5-d2bd-4cf3-a9b1-f45b022c146d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:51.928077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f1fc5-d2bd-4cf3-a9b1-f45b022c146d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:51.929669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f1fc5-d2bd-4cf3-a9b1-f45b022c146d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:51.951114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 270/538] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:51.957667 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f1fc5-d2bd-4cf3-a9b1-f45b022c146d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:51.962539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ea3f5-0da5-4a6d-8d0c-4ad80c1f3ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:51.963194 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ea3f5-0da5-4a6d-8d0c-4ad80c1f3ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:51.963508 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ea3f5-0da5-4a6d-8d0c-4ad80c1f3ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:51.963785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ea3f5-0da5-4a6d-8d0c-4ad80c1f3ff5 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:51.964487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ea3f5-0da5-4a6d-8d0c-4ad80c1f3ff5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:51.964790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ea3f5-0da5-4a6d-8d0c-4ad80c1f3ff5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:51.966258 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ea3f5-0da5-4a6d-8d0c-4ad80c1f3ff5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:51.991026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 269/539] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:51.998236 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ea3f5-0da5-4a6d-8d0c-4ad80c1f3ff5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:52.058125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:52.081306 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f1fc5-d2bd-4cf3-a9b1-f45b022c146d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:52.117823 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9efa5-c029-47db-89d0-92adc98dbafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:52.118708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9efa5-c029-47db-89d0-92adc98dbafe None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:52.119129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9efa5-c029-47db-89d0-92adc98dbafe None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:52.119538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9efa5-c029-47db-89d0-92adc98dbafe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:52.120916 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9efa5-c029-47db-89d0-92adc98dbafe None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=5bb4ef26660244ce90b0105113e252b3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:52.121503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9efa5-c029-47db-89d0-92adc98dbafe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:52.123199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9efa5-c029-47db-89d0-92adc98dbafe None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:52.129067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 271/540] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:51 2022] GET /identity/v3/role_assignments?user.id=5bb4ef26660244ce90b0105113e252b3&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:52.192925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ea3f5-0da5-4a6d-8d0c-4ad80c1f3ff5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:52.256792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f993ea4-e64a-4612-8cff-5a6143c3420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:52.257439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f993ea4-e64a-4612-8cff-5a6143c3420b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:52.257716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f993ea4-e64a-4612-8cff-5a6143c3420b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:52.257983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f993ea4-e64a-4612-8cff-5a6143c3420b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:52.258724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f993ea4-e64a-4612-8cff-5a6143c3420b None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=92e0ce020fb448bc9d470e918a022ebd) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:52.259029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f993ea4-e64a-4612-8cff-5a6143c3420b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:52.260524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f993ea4-e64a-4612-8cff-5a6143c3420b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:52.269904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 270/541] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:51 2022] GET /identity/v3/role_assignments?user.id=92e0ce020fb448bc9d470e918a022ebd&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:52.503742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee4dd4-d6c2-438d-8fa4-75fd94c93d2b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:52.504257 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee4dd4-d6c2-438d-8fa4-75fd94c93d2b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:52.504257 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee4dd4-d6c2-438d-8fa4-75fd94c93d2b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:52.505844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 272/542] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:52.511539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bed54-7808-41b4-888b-30bb79924b7b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:52.511822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bed54-7808-41b4-888b-30bb79924b7b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:52.512092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bed54-7808-41b4-888b-30bb79924b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:52.532150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-578bed54-7808-41b4-888b-30bb79924b7b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:52.533359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-578bed54-7808-41b4-888b-30bb79924b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:52.613693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 271/543] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:52.751417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4f996-3737-4f35-a4ce-c09a5b8dc9ac None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:52.751758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4f996-3737-4f35-a4ce-c09a5b8dc9ac None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:52.751957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4f996-3737-4f35-a4ce-c09a5b8dc9ac None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:52.753521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 273/544] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:52.759098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a9b30-c2c5-4614-9c41-8a0e5eb0d587 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:52.759330 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a9b30-c2c5-4614-9c41-8a0e5eb0d587 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:52.759607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a9b30-c2c5-4614-9c41-8a0e5eb0d587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:52.797450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a55a9b30-c2c5-4614-9c41-8a0e5eb0d587 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:52.798638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a55a9b30-c2c5-4614-9c41-8a0e5eb0d587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:52.825557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:52.899687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 272/545] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:52.924712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4f996-3737-4f35-a4ce-c09a5b8dc9ac None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:52.976591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:53.078028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4f996-3737-4f35-a4ce-c09a5b8dc9ac None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:53.121797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05001c7b-1386-4d23-b3f2-c1a9a963b30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:53.122420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05001c7b-1386-4d23-b3f2-c1a9a963b30c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:53.122693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05001c7b-1386-4d23-b3f2-c1a9a963b30c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:53.122957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05001c7b-1386-4d23-b3f2-c1a9a963b30c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:53.145912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05001c7b-1386-4d23-b3f2-c1a9a963b30c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-05001c7b-1386-4d23-b3f2-c1a9a963b30c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:53.156359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:53.157239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:53.158077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:53.158077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:53.158077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:53.158077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:53.158077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:53.158077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:53.158077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:53.158077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:53.158077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:53.158077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:53.158077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:53.158077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:53.158077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 274/546] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:11:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:53.167294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a9b30-c2c5-4614-9c41-8a0e5eb0d587 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:53.172475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05001c7b-1386-4d23-b3f2-c1a9a963b30c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:53.306460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:53.323926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05001c7b-1386-4d23-b3f2-c1a9a963b30c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:53.367010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a9b30-c2c5-4614-9c41-8a0e5eb0d587 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:53.387662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb4d70-a3f6-40c8-adde-8847e1a6518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:53.388289 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb4d70-a3f6-40c8-adde-8847e1a6518d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:53.388562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb4d70-a3f6-40c8-adde-8847e1a6518d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:53.388829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb4d70-a3f6-40c8-adde-8847e1a6518d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:53.409839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb4d70-a3f6-40c8-adde-8847e1a6518d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-e1cb4d70-a3f6-40c8-adde-8847e1a6518d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:53.417160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:53.418155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:53.419051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:53.419051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:53.419051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:53.419051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:53.419051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:53.419051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:53.419051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:53.419051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:53.419051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:53.419051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:53.419051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:53.419051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:53.420067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 275/547] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:11:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:53.432176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb4d70-a3f6-40c8-adde-8847e1a6518d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:53.439399 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d607de7-0e6c-413f-8cc4-8d50c5f13f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:53.440009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607de7-0e6c-413f-8cc4-8d50c5f13f20 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:53.440287 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607de7-0e6c-413f-8cc4-8d50c5f13f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:53.440560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607de7-0e6c-413f-8cc4-8d50c5f13f20 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:53.441230 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d607de7-0e6c-413f-8cc4-8d50c5f13f20 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:53.441560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d607de7-0e6c-413f-8cc4-8d50c5f13f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:53.442963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d607de7-0e6c-413f-8cc4-8d50c5f13f20 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:53.458806 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 273/548] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:11:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:53.470180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d607de7-0e6c-413f-8cc4-8d50c5f13f20 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:53.518306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:53.568738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb4d70-a3f6-40c8-adde-8847e1a6518d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:53.630951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56882b-e38c-4d6a-8ac0-7441dee7ff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:53.631476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56882b-e38c-4d6a-8ac0-7441dee7ff0f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:53.631750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56882b-e38c-4d6a-8ac0-7441dee7ff0f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:53.632016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56882b-e38c-4d6a-8ac0-7441dee7ff0f None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:53.632673 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56882b-e38c-4d6a-8ac0-7441dee7ff0f None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:53.632970 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56882b-e38c-4d6a-8ac0-7441dee7ff0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:53.634369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56882b-e38c-4d6a-8ac0-7441dee7ff0f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:53.654148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 276/549] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:11:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:53.659520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56882b-e38c-4d6a-8ac0-7441dee7ff0f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:53.682205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d607de7-0e6c-413f-8cc4-8d50c5f13f20 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:53.687008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:53.733111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc4228-0c30-459b-9f66-8cd916226d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:53.733778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc4228-0c30-459b-9f66-8cd916226d16 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:53.734059 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc4228-0c30-459b-9f66-8cd916226d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:53.734335 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc4228-0c30-459b-9f66-8cd916226d16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:53.746124 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc4228-0c30-459b-9f66-8cd916226d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:53.747768 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc4228-0c30-459b-9f66-8cd916226d16 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-2bcc4228-0c30-459b-9f66-8cd916226d16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:53.764932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:53.765935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:53.766816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:53.766816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:53.766816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:53.767403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 274/550] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:53.774205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc4228-0c30-459b-9f66-8cd916226d16 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:53.854517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:53.864257 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56882b-e38c-4d6a-8ac0-7441dee7ff0f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:53.890806 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc4228-0c30-459b-9f66-8cd916226d16 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:53.937600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090493a-a2b5-4dc7-a3c1-9c66d62307c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:53.938232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090493a-a2b5-4dc7-a3c1-9c66d62307c3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:53.938511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090493a-a2b5-4dc7-a3c1-9c66d62307c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:53.938830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090493a-a2b5-4dc7-a3c1-9c66d62307c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:53.948895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486040d-5f4d-4137-bcb3-8b9eb93c6bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:53.949522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486040d-5f4d-4137-bcb3-8b9eb93c6bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:53.949796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486040d-5f4d-4137-bcb3-8b9eb93c6bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:53.950058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486040d-5f4d-4137-bcb3-8b9eb93c6bc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:53.950783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486040d-5f4d-4137-bcb3-8b9eb93c6bc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:53.951092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486040d-5f4d-4137-bcb3-8b9eb93c6bc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:53.952480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486040d-5f4d-4137-bcb3-8b9eb93c6bc6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:53.966064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090493a-a2b5-4dc7-a3c1-9c66d62307c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:53.967530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090493a-a2b5-4dc7-a3c1-9c66d62307c3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:53.978632 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 275/551] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:53.984435 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486040d-5f4d-4137-bcb3-8b9eb93c6bc6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-e090493a-a2b5-4dc7-a3c1-9c66d62307c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:53.995509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:53.996447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:53.997346 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:53.997346 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:53.997346 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:54.005593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 277/552] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:54.006453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090493a-a2b5-4dc7-a3c1-9c66d62307c3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:54.101893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486040d-5f4d-4137-bcb3-8b9eb93c6bc6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:54.135806 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:54.149630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cb326-d04f-48d9-b0a3-cedbb9eb017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:54.154536 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cb326-d04f-48d9-b0a3-cedbb9eb017c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:54.154828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cb326-d04f-48d9-b0a3-cedbb9eb017c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:54.155099 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cb326-d04f-48d9-b0a3-cedbb9eb017c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:54.163855 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cb326-d04f-48d9-b0a3-cedbb9eb017c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:54.165310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cb326-d04f-48d9-b0a3-cedbb9eb017c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a39cb326-d04f-48d9-b0a3-cedbb9eb017c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:11:54.179057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:54.180610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:54.183115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:54.183115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:54.183115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:11:54.183115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:11:54.183115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:11:54.183115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:11:54.183115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:11:54.183115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:11:54.183115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 03:11:54.183115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:54.183115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 276/553] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:11:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:54.183115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1d853-1955-4fe3-bb5d-6a3258196b99 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:54.183115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1d853-1955-4fe3-bb5d-6a3258196b99 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:54.184579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1d853-1955-4fe3-bb5d-6a3258196b99 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:54.189281 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 277/554] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:54.189689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:54.191130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14505a3-da0a-4fcd-802d-9497b1e756f2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:54.191407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14505a3-da0a-4fcd-802d-9497b1e756f2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:54.191672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14505a3-da0a-4fcd-802d-9497b1e756f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:54.218564 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b14505a3-da0a-4fcd-802d-9497b1e756f2 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:54.220395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b14505a3-da0a-4fcd-802d-9497b1e756f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:54.230705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090493a-a2b5-4dc7-a3c1-9c66d62307c3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:54.271493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624971f3-a9d4-4482-9c6c-cb10aa85d951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:54.272455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624971f3-a9d4-4482-9c6c-cb10aa85d951 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:54.273385 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624971f3-a9d4-4482-9c6c-cb10aa85d951 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:54.273914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624971f3-a9d4-4482-9c6c-cb10aa85d951 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:54.274855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624971f3-a9d4-4482-9c6c-cb10aa85d951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:54.275726 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624971f3-a9d4-4482-9c6c-cb10aa85d951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:54.278109 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624971f3-a9d4-4482-9c6c-cb10aa85d951 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:54.292299 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 278/555] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:54.293589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624971f3-a9d4-4482-9c6c-cb10aa85d951 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:54.305330 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 278/556] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:54.305812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14505a3-da0a-4fcd-802d-9497b1e756f2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:54.429285 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624971f3-a9d4-4482-9c6c-cb10aa85d951 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:54.459295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:54.470704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52353d6b-77cd-4863-9c74-0433d07af6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:54.471428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52353d6b-77cd-4863-9c74-0433d07af6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:54.471683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52353d6b-77cd-4863-9c74-0433d07af6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:54.472014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52353d6b-77cd-4863-9c74-0433d07af6b9 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:54.472741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52353d6b-77cd-4863-9c74-0433d07af6b9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:54.473039 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52353d6b-77cd-4863-9c74-0433d07af6b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:54.474506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52353d6b-77cd-4863-9c74-0433d07af6b9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:54.493655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 279/557] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 13 03:11:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:54.503818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52353d6b-77cd-4863-9c74-0433d07af6b9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:54.519039 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14505a3-da0a-4fcd-802d-9497b1e756f2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:54.561091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:54.577673 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8909cdc-757a-493d-8eae-bae812db67f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:54.578328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8909cdc-757a-493d-8eae-bae812db67f9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:54.578931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8909cdc-757a-493d-8eae-bae812db67f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:54.579301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8909cdc-757a-493d-8eae-bae812db67f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:54.587260 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8909cdc-757a-493d-8eae-bae812db67f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:54.589475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8909cdc-757a-493d-8eae-bae812db67f9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a8909cdc-757a-493d-8eae-bae812db67f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:11:54.604203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:54.605667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:54.606613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:54.606613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:54.606613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:11:54.606613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:11:54.606613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:11:54.606613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:11:54.606613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:11:54.606613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:11:54.606613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:11:54.606613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:54.606613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 279/558] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 03:11:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:54.610797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8909cdc-757a-493d-8eae-bae812db67f9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:54.670066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52353d6b-77cd-4863-9c74-0433d07af6b9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:54.707725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af415ee-fbba-446f-bb41-253e6b605cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:54.708240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af415ee-fbba-446f-bb41-253e6b605cdf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:54.708516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af415ee-fbba-446f-bb41-253e6b605cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:54.708788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af415ee-fbba-446f-bb41-253e6b605cdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:54.744593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8909cdc-757a-493d-8eae-bae812db67f9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:54.783089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:54.796292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043a2ab-7e40-42f7-a7bc-2fec37e37c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:54.797011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043a2ab-7e40-42f7-a7bc-2fec37e37c5a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:54.797314 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043a2ab-7e40-42f7-a7bc-2fec37e37c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:54.797595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043a2ab-7e40-42f7-a7bc-2fec37e37c5a None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:54.798406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043a2ab-7e40-42f7-a7bc-2fec37e37c5a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:54.798734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043a2ab-7e40-42f7-a7bc-2fec37e37c5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:54.800487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043a2ab-7e40-42f7-a7bc-2fec37e37c5a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:54.806578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af415ee-fbba-446f-bb41-253e6b605cdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:54.808493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af415ee-fbba-446f-bb41-253e6b605cdf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:54.826588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 280/559] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 03:11:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:54.827490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043a2ab-7e40-42f7-a7bc-2fec37e37c5a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:54.877215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:54.928534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 280/560] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:11:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 03:11:54.929716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af415ee-fbba-446f-bb41-253e6b605cdf None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:54.946536 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043a2ab-7e40-42f7-a7bc-2fec37e37c5a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:54.981067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39763b0f-3dbe-418f-a8d4-71a39642a562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:54.981784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39763b0f-3dbe-418f-a8d4-71a39642a562 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:54.982069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39763b0f-3dbe-418f-a8d4-71a39642a562 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:54.982347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39763b0f-3dbe-418f-a8d4-71a39642a562 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:54.992683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39763b0f-3dbe-418f-a8d4-71a39642a562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-39763b0f-3dbe-418f-a8d4-71a39642a562 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:54.997623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:54.998678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 281/561] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:11:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:55.000823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0d244-f173-4ffd-bc8f-a1e48c865b65 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.001646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0d244-f173-4ffd-bc8f-a1e48c865b65 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.001646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0d244-f173-4ffd-bc8f-a1e48c865b65 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.002122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 282/562] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:55.002600 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0d244-f173-4ffd-bc8f-a1e48c865b65 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:55.018715 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:55.034272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af415ee-fbba-446f-bb41-253e6b605cdf None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:55.068733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fa75b-5010-4dfa-b379-12489fc04d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:55.069376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fa75b-5010-4dfa-b379-12489fc04d85 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.069653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fa75b-5010-4dfa-b379-12489fc04d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.069919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fa75b-5010-4dfa-b379-12489fc04d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.080059 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fa75b-5010-4dfa-b379-12489fc04d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:55.081517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fa75b-5010-4dfa-b379-12489fc04d85 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-764fa75b-5010-4dfa-b379-12489fc04d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:55.096032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:55.097058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:55.098013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:55.098013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:55.098013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:55.098013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 281/563] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:55.098288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b98eb-c74c-4259-a6dd-141ffb490083 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.098566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b98eb-c74c-4259-a6dd-141ffb490083 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.098842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b98eb-c74c-4259-a6dd-141ffb490083 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.100209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 282/564] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:55.102024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b98eb-c74c-4259-a6dd-141ffb490083 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:55.102497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:55.107319 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0d244-f173-4ffd-bc8f-a1e48c865b65 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:55.142834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffce325-9c34-4df6-8a95-001d97703793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:55.143467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffce325-9c34-4df6-8a95-001d97703793 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.143737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffce325-9c34-4df6-8a95-001d97703793 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.144001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffce325-9c34-4df6-8a95-001d97703793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.156012 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffce325-9c34-4df6-8a95-001d97703793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:55.157491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffce325-9c34-4df6-8a95-001d97703793 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5ffce325-9c34-4df6-8a95-001d97703793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:55.171880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:55.172804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:55.173810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:55.173810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:55.173810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:55.173810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 283/565] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:55.174128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21cf1d-31c1-4eef-91d9-44cc01b9e6e9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.174488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21cf1d-31c1-4eef-91d9-44cc01b9e6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.174659 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21cf1d-31c1-4eef-91d9-44cc01b9e6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.193194 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ff21cf1d-31c1-4eef-91d9-44cc01b9e6e9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:55.194437 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ff21cf1d-31c1-4eef-91d9-44cc01b9e6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:55.209371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b98eb-c74c-4259-a6dd-141ffb490083 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:55.241967 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92094e4-1819-4322-a21d-045d2245a371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:55.242491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92094e4-1819-4322-a21d-045d2245a371 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.242762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92094e4-1819-4322-a21d-045d2245a371 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.243029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92094e4-1819-4322-a21d-045d2245a371 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.243675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92094e4-1819-4322-a21d-045d2245a371 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:55.243976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92094e4-1819-4322-a21d-045d2245a371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:55.245917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92094e4-1819-4322-a21d-045d2245a371 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:55.248149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:55.254658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 283/566] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:11:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:55.255425 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92094e4-1819-4322-a21d-045d2245a371 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:55.262134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 284/567] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:55.263644 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e60086-55fd-43ed-bef3-b76a59a7472c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.263933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e60086-55fd-43ed-bef3-b76a59a7472c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.264237 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e60086-55fd-43ed-bef3-b76a59a7472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.282243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-07e60086-55fd-43ed-bef3-b76a59a7472c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:55.283421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-07e60086-55fd-43ed-bef3-b76a59a7472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:55.357292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 285/568] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:55.357292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e60086-55fd-43ed-bef3-b76a59a7472c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:55.362451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:55.381003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92094e4-1819-4322-a21d-045d2245a371 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:55.424733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ee76-5227-4369-9310-c70dbd7de6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:55.425470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ee76-5227-4369-9310-c70dbd7de6be None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.425803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ee76-5227-4369-9310-c70dbd7de6be None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.426075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ee76-5227-4369-9310-c70dbd7de6be None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.426711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ee76-5227-4369-9310-c70dbd7de6be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:55.427011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ee76-5227-4369-9310-c70dbd7de6be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:55.428390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ee76-5227-4369-9310-c70dbd7de6be None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:55.441284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 284/569] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:55.442108 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ee76-5227-4369-9310-c70dbd7de6be None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:55.456896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e60086-55fd-43ed-bef3-b76a59a7472c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:55.493510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04f26-1426-4678-bae5-25c6f067a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:55.494185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04f26-1426-4678-bae5-25c6f067a555 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.494502 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04f26-1426-4678-bae5-25c6f067a555 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.494827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea04f26-1426-4678-bae5-25c6f067a555 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.495971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea04f26-1426-4678-bae5-25c6f067a555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:55.496342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea04f26-1426-4678-bae5-25c6f067a555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:55.497840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea04f26-1426-4678-bae5-25c6f067a555 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:55.503534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:55.510801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 286/570] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:55.512129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04f26-1426-4678-bae5-25c6f067a555 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:55.548056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ee76-5227-4369-9310-c70dbd7de6be None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:55.581778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:55.590658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a38b3-a8b7-4856-b857-dea1b6b57e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:55.591281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a38b3-a8b7-4856-b857-dea1b6b57e7a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.591727 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a38b3-a8b7-4856-b857-dea1b6b57e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.591836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a38b3-a8b7-4856-b857-dea1b6b57e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.604116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a38b3-a8b7-4856-b857-dea1b6b57e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:55.605592 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a38b3-a8b7-4856-b857-dea1b6b57e7a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:55.616701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea04f26-1426-4678-bae5-25c6f067a555 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-968a38b3-a8b7-4856-b857-dea1b6b57e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:55.620267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:55.621216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:55.622160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:55.622160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:55.622160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:55.626006 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 285/571] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:55.626633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a38b3-a8b7-4856-b857-dea1b6b57e7a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:55.653499 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429f5dd-54fd-4e57-a8ff-6ecaef2a37e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:55.654121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429f5dd-54fd-4e57-a8ff-6ecaef2a37e0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.654394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429f5dd-54fd-4e57-a8ff-6ecaef2a37e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.654661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429f5dd-54fd-4e57-a8ff-6ecaef2a37e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.661077 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429f5dd-54fd-4e57-a8ff-6ecaef2a37e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:55.662535 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429f5dd-54fd-4e57-a8ff-6ecaef2a37e0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9429f5dd-54fd-4e57-a8ff-6ecaef2a37e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:11:55.673471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:55.674356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:55.675240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:11:55.675240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:11:55.675240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:11:55.675240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:11:55.675240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:11:55.675240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:11:55.675240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:55.675240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:55.675240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 287/572] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:55.675240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429f5dd-54fd-4e57-a8ff-6ecaef2a37e0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:55.727042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a38b3-a8b7-4856-b857-dea1b6b57e7a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:55.736913 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:55.759884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf4b2d-3c74-43f0-bdcc-b99b9a66d0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:55.761474 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf4b2d-3c74-43f0-bdcc-b99b9a66d0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.762034 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf4b2d-3c74-43f0-bdcc-b99b9a66d0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.762305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf4b2d-3c74-43f0-bdcc-b99b9a66d0c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.768841 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf4b2d-3c74-43f0-bdcc-b99b9a66d0c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:55.770580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf4b2d-3c74-43f0-bdcc-b99b9a66d0c5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:55.776001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429f5dd-54fd-4e57-a8ff-6ecaef2a37e0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3dcf4b2d-3c74-43f0-bdcc-b99b9a66d0c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:11:55.781522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:55.782537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:55.788568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:11:55.788568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:11:55.788568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:11:55.788568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:11:55.788568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:11:55.788568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:11:55.788568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:55.788568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:55.788568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 286/573] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:55.788568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf4b2d-3c74-43f0-bdcc-b99b9a66d0c5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:55.803172 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:55.809359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ddf44-da5d-4532-93d7-be0d6cc5edfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:55.809990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ddf44-da5d-4532-93d7-be0d6cc5edfa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.810264 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ddf44-da5d-4532-93d7-be0d6cc5edfa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.810585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ddf44-da5d-4532-93d7-be0d6cc5edfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.820899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ddf44-da5d-4532-93d7-be0d6cc5edfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-625ddf44-da5d-4532-93d7-be0d6cc5edfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:55.826495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:55.827570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:55.828408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:55.828408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:55.828408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:55.828408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:55.828408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:55.828408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:55.828408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:55.828408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:55.828408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:55.828408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:55.828408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:55.828408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:55.828408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 288/574] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:11:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:55.829102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ddf44-da5d-4532-93d7-be0d6cc5edfa None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:55.886883 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf4b2d-3c74-43f0-bdcc-b99b9a66d0c5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:55.919446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc02686-a7b9-4510-8c16-bf167214ae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:55.920176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02686-a7b9-4510-8c16-bf167214ae74 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.920460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02686-a7b9-4510-8c16-bf167214ae74 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.920737 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02686-a7b9-4510-8c16-bf167214ae74 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.921439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc02686-a7b9-4510-8c16-bf167214ae74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:55.934905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc02686-a7b9-4510-8c16-bf167214ae74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:55.934905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc02686-a7b9-4510-8c16-bf167214ae74 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:55.935091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ddf44-da5d-4532-93d7-be0d6cc5edfa None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:55.935540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 287/575] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:55.936137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc02686-a7b9-4510-8c16-bf167214ae74 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:55.961111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187fe2b-5329-430a-b293-22dd339c0850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:55.961767 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187fe2b-5329-430a-b293-22dd339c0850 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:55.962083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187fe2b-5329-430a-b293-22dd339c0850 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:55.962349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187fe2b-5329-430a-b293-22dd339c0850 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:55.965785 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:55.972147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187fe2b-5329-430a-b293-22dd339c0850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7187fe2b-5329-430a-b293-22dd339c0850 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:55.978253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:55.979847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 289/576] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:11:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:55.980863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187fe2b-5329-430a-b293-22dd339c0850 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:56.028217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:56.040250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc02686-a7b9-4510-8c16-bf167214ae74 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:56.074756 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f0129-0117-42d9-b88c-00b4a30688e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:56.075346 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f0129-0117-42d9-b88c-00b4a30688e2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:56.075619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f0129-0117-42d9-b88c-00b4a30688e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:56.075884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f0129-0117-42d9-b88c-00b4a30688e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:56.076554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f0129-0117-42d9-b88c-00b4a30688e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:56.076849 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f0129-0117-42d9-b88c-00b4a30688e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:56.077669 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187fe2b-5329-430a-b293-22dd339c0850 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:56.078305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f0129-0117-42d9-b88c-00b4a30688e2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:56.089502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 288/577] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:56.090283 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f0129-0117-42d9-b88c-00b4a30688e2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:56.112632 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7c439-e285-475e-86f8-e8e8fdeea889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:56.113238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c439-e285-475e-86f8-e8e8fdeea889 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:56.113550 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c439-e285-475e-86f8-e8e8fdeea889 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:56.113825 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c439-e285-475e-86f8-e8e8fdeea889 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:56.114512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7c439-e285-475e-86f8-e8e8fdeea889 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:56.114817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7c439-e285-475e-86f8-e8e8fdeea889 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:56.116265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7c439-e285-475e-86f8-e8e8fdeea889 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:56.133323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 290/578] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:56.133323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7c439-e285-475e-86f8-e8e8fdeea889 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:56.183966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:56.193593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f0129-0117-42d9-b88c-00b4a30688e2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:56.225528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074814b-1b37-419e-9143-a1ba18600e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:56.226124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074814b-1b37-419e-9143-a1ba18600e11 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:56.226401 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074814b-1b37-419e-9143-a1ba18600e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:56.226681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074814b-1b37-419e-9143-a1ba18600e11 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:56.227340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074814b-1b37-419e-9143-a1ba18600e11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:56.227644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074814b-1b37-419e-9143-a1ba18600e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:56.229537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074814b-1b37-419e-9143-a1ba18600e11 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:56.230133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7c439-e285-475e-86f8-e8e8fdeea889 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:56.237926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 289/579] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:11:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:56.238701 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074814b-1b37-419e-9143-a1ba18600e11 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:56.241328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:56.268145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9445b-4a1c-4677-b656-0568e14754d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:56.268761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9445b-4a1c-4677-b656-0568e14754d5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:56.269033 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9445b-4a1c-4677-b656-0568e14754d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:56.269344 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9445b-4a1c-4677-b656-0568e14754d5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:56.276382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9445b-4a1c-4677-b656-0568e14754d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:56.278014 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9445b-4a1c-4677-b656-0568e14754d5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f0a9445b-4a1c-4677-b656-0568e14754d5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:11:56.289382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:56.290480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:56.291962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:56.291962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:56.291962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:11:56.291962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:11:56.291962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:11:56.291962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:11:56.291962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:11:56.291962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:11:56.291962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 03:11:56.291962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:56.291962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 291/580] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:56.291962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9445b-4a1c-4677-b656-0568e14754d5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:56.342954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074814b-1b37-419e-9143-a1ba18600e11 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:56.375811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d549e3-cd5a-4bbf-98cd-7e714d234984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:56.376414 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d549e3-cd5a-4bbf-98cd-7e714d234984 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:56.376723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d549e3-cd5a-4bbf-98cd-7e714d234984 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:56.377003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d549e3-cd5a-4bbf-98cd-7e714d234984 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:56.377677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d549e3-cd5a-4bbf-98cd-7e714d234984 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:56.377975 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d549e3-cd5a-4bbf-98cd-7e714d234984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:56.379321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d549e3-cd5a-4bbf-98cd-7e714d234984 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:56.387267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 290/581] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:11:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:56.388028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d549e3-cd5a-4bbf-98cd-7e714d234984 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:56.388679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9445b-4a1c-4677-b656-0568e14754d5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:56.403916 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:56.422365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7872e7c-6b74-4203-8c84-1b0af2d0a765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:56.423021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7872e7c-6b74-4203-8c84-1b0af2d0a765 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:56.423303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7872e7c-6b74-4203-8c84-1b0af2d0a765 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:56.423580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7872e7c-6b74-4203-8c84-1b0af2d0a765 None admin] PATH_INFO: `/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/fcff121c9e974a6aabaa18775de65f63/roles/79cc79c433824f04b3110bccd205b2ba` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:56.437699 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7872e7c-6b74-4203-8c84-1b0af2d0a765 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad922f6e2414214abe3ba1de67fc8de, user_id=fcff121c9e974a6aabaa18775de65f63, role_id=79cc79c433824f04b3110bccd205b2ba)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:56.439146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7872e7c-6b74-4203-8c84-1b0af2d0a765 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:56.485343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d549e3-cd5a-4bbf-98cd-7e714d234984 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:56.517157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 292/582] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:11:56 2022] PUT /identity/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/fcff121c9e974a6aabaa18775de65f63/roles/79cc79c433824f04b3110bccd205b2ba => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:56.517313 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac4d1a-69db-4054-ba84-99033dc37f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:56.517890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac4d1a-69db-4054-ba84-99033dc37f15 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:56.517993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7872e7c-6b74-4203-8c84-1b0af2d0a765 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:56.518164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac4d1a-69db-4054-ba84-99033dc37f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:56.518430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac4d1a-69db-4054-ba84-99033dc37f15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:56.519137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac4d1a-69db-4054-ba84-99033dc37f15 None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=bd3284a5c047425d8148f178eee4069d) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:56.519439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac4d1a-69db-4054-ba84-99033dc37f15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:56.520991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac4d1a-69db-4054-ba84-99033dc37f15 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:56.527620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 291/583] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:11:56 2022] GET /identity/v3/role_assignments?user.id=bd3284a5c047425d8148f178eee4069d&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:56.528481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac4d1a-69db-4054-ba84-99033dc37f15 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:56.569752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:56.652092 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:56.669336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7872e7c-6b74-4203-8c84-1b0af2d0a765 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:56.688597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac4d1a-69db-4054-ba84-99033dc37f15 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:56.711882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb2343-9e08-40a0-8157-f52e8cca3c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:56.714045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb2343-9e08-40a0-8157-f52e8cca3c61 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:56.714437 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb2343-9e08-40a0-8157-f52e8cca3c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:56.714708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb2343-9e08-40a0-8157-f52e8cca3c61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:56.731353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb2343-9e08-40a0-8157-f52e8cca3c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:56.733528 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb2343-9e08-40a0-8157-f52e8cca3c61 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:56.738014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa7ca6-9f77-4978-a578-61a309a77eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:56.738628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa7ca6-9f77-4978-a578-61a309a77eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:56.738908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa7ca6-9f77-4978-a578-61a309a77eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:56.739178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa7ca6-9f77-4978-a578-61a309a77eb4 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:56.739908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa7ca6-9f77-4978-a578-61a309a77eb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:56.740211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa7ca6-9f77-4978-a578-61a309a77eb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:56.741772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa7ca6-9f77-4978-a578-61a309a77eb4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b2eb2343-9e08-40a0-8157-f52e8cca3c61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:56.749858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:56.750845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:56.751751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:56.751751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:56.751751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:56.755737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 293/584] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:56.756592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb2343-9e08-40a0-8157-f52e8cca3c61 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:56.769398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 292/585] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 13 03:11:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:56.770757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa7ca6-9f77-4978-a578-61a309a77eb4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:56.843295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:56.882510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa7ca6-9f77-4978-a578-61a309a77eb4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:56.890090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb2343-9e08-40a0-8157-f52e8cca3c61 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:56.923898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b5f74-9c1b-4d0e-a336-3771f6cd1e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:56.924877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b5f74-9c1b-4d0e-a336-3771f6cd1e1a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:56.925322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b5f74-9c1b-4d0e-a336-3771f6cd1e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:56.925919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b5f74-9c1b-4d0e-a336-3771f6cd1e1a None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:56.926699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b5f74-9c1b-4d0e-a336-3771f6cd1e1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:56.927142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b5f74-9c1b-4d0e-a336-3771f6cd1e1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:56.928825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b5f74-9c1b-4d0e-a336-3771f6cd1e1a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:56.932793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:56.935541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96198c4-0266-4618-9e67-500167470597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:56.940905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96198c4-0266-4618-9e67-500167470597 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:56.940905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96198c4-0266-4618-9e67-500167470597 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:56.940905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96198c4-0266-4618-9e67-500167470597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:56.945368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 293/586] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:56.946465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b5f74-9c1b-4d0e-a336-3771f6cd1e1a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:56.957520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96198c4-0266-4618-9e67-500167470597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:56.959228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96198c4-0266-4618-9e67-500167470597 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f96198c4-0266-4618-9e67-500167470597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:56.976003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:56.977069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:56.978305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:56.978305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:56.978305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:56.980059 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 294/587] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:56.981020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96198c4-0266-4618-9e67-500167470597 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:57.080126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b5f74-9c1b-4d0e-a336-3771f6cd1e1a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:57.087254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96198c4-0266-4618-9e67-500167470597 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:57.116323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:57.120872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b78513-2f41-41b7-9455-eca5d4970dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:57.121699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b78513-2f41-41b7-9455-eca5d4970dcd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:57.122276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b78513-2f41-41b7-9455-eca5d4970dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:57.122706 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b78513-2f41-41b7-9455-eca5d4970dcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:57.123423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea36f94-c641-448b-82e4-b10ac4d4976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:57.124106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36f94-c641-448b-82e4-b10ac4d4976f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:57.124448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36f94-c641-448b-82e4-b10ac4d4976f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:57.124842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea36f94-c641-448b-82e4-b10ac4d4976f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:57.132841 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea36f94-c641-448b-82e4-b10ac4d4976f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:57.134399 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea36f94-c641-448b-82e4-b10ac4d4976f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:57.136469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b78513-2f41-41b7-9455-eca5d4970dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:57.138903 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b78513-2f41-41b7-9455-eca5d4970dcd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5ea36f94-c641-448b-82e4-b10ac4d4976f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:11:57.147056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:57.148205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:57.149387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:57.149387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:57.149387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:11:57.149387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:11:57.149387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:11:57.149387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:11:57.149387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:11:57.149387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:11:57.149387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 03:11:57.149387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:57.154722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 295/588] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:11:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:57.155595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea36f94-c641-448b-82e4-b10ac4d4976f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-03b78513-2f41-41b7-9455-eca5d4970dcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:57.159638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:57.160811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:57.161734 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:57.161734 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:57.161734 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:57.163205 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 294/589] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:57.168548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b78513-2f41-41b7-9455-eca5d4970dcd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:57.227587 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:57.278018 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea36f94-c641-448b-82e4-b10ac4d4976f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:57.286870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b78513-2f41-41b7-9455-eca5d4970dcd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:57.321296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fbda5-ebf1-4744-8949-cd78f8faa4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:57.322176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fbda5-ebf1-4744-8949-cd78f8faa4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:57.323160 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fbda5-ebf1-4744-8949-cd78f8faa4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:57.323575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fbda5-ebf1-4744-8949-cd78f8faa4d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:57.324444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fbda5-ebf1-4744-8949-cd78f8faa4d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:57.325056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fbda5-ebf1-4744-8949-cd78f8faa4d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:57.326771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fbda5-ebf1-4744-8949-cd78f8faa4d3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:57.327274 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0522c-f26f-441d-8f67-0e39570c81e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:57.327936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0522c-f26f-441d-8f67-0e39570c81e5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:57.328364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0522c-f26f-441d-8f67-0e39570c81e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:57.328707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0522c-f26f-441d-8f67-0e39570c81e5 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:57.329581 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0522c-f26f-441d-8f67-0e39570c81e5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:57.329958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0522c-f26f-441d-8f67-0e39570c81e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:57.331432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0522c-f26f-441d-8f67-0e39570c81e5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:57.340901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 296/590] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:57.341943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fbda5-ebf1-4744-8949-cd78f8faa4d3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:57.362338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 295/591] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Sep 13 03:11:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:57.363436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0522c-f26f-441d-8f67-0e39570c81e5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:57.392430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:57.449057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fbda5-ebf1-4744-8949-cd78f8faa4d3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:57.486748 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bacc50-368f-4df1-bfb0-cac405670340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:57.487353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bacc50-368f-4df1-bfb0-cac405670340 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:57.487626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bacc50-368f-4df1-bfb0-cac405670340 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:57.487894 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bacc50-368f-4df1-bfb0-cac405670340 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:57.488573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bacc50-368f-4df1-bfb0-cac405670340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:57.488828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bacc50-368f-4df1-bfb0-cac405670340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:57.490229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bacc50-368f-4df1-bfb0-cac405670340 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:57.494243 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0522c-f26f-441d-8f67-0e39570c81e5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:57.502409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 297/592] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:57.502979 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bacc50-368f-4df1-bfb0-cac405670340 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:57.503927 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:57.537700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbd578-ad29-4d1e-ae49-9c4fe51faf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:57.538929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd578-ad29-4d1e-ae49-9c4fe51faf63 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:57.539724 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd578-ad29-4d1e-ae49-9c4fe51faf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:57.540641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd578-ad29-4d1e-ae49-9c4fe51faf63 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:57.550255 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbd578-ad29-4d1e-ae49-9c4fe51faf63 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:57.551971 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbd578-ad29-4d1e-ae49-9c4fe51faf63 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-84cbd578-ad29-4d1e-ae49-9c4fe51faf63 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:11:57.566868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:57.567784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:57.568708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:57.568708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:57.568708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:11:57.568708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:11:57.568708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:11:57.568708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:11:57.568708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:11:57.568708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:11:57.568708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 03:11:57.568708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:57.572787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 296/593] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:11:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:57.573647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbd578-ad29-4d1e-ae49-9c4fe51faf63 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:57.637912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bacc50-368f-4df1-bfb0-cac405670340 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:57.641706 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:57.687774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbd578-ad29-4d1e-ae49-9c4fe51faf63 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:57.688345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428a1cd-d02e-4bd8-8dd5-e7fed9bf514f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:57.690658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428a1cd-d02e-4bd8-8dd5-e7fed9bf514f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:57.691147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428a1cd-d02e-4bd8-8dd5-e7fed9bf514f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:57.691637 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428a1cd-d02e-4bd8-8dd5-e7fed9bf514f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:57.705735 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428a1cd-d02e-4bd8-8dd5-e7fed9bf514f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:57.707836 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428a1cd-d02e-4bd8-8dd5-e7fed9bf514f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:57.723612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4a13e-cb75-450c-96f0-0e5174ededeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:57.724234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4a13e-cb75-450c-96f0-0e5174ededeb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:57.724508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4a13e-cb75-450c-96f0-0e5174ededeb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:57.724772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4a13e-cb75-450c-96f0-0e5174ededeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-1428a1cd-d02e-4bd8-8dd5-e7fed9bf514f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:57.728275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:57.729778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:57.730656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:57.730656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:57.730656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:57.732365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4a13e-cb75-450c-96f0-0e5174ededeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:57.737781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4a13e-cb75-450c-96f0-0e5174ededeb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:57.738703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 298/594] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:57.739330 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428a1cd-d02e-4bd8-8dd5-e7fed9bf514f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3fa4a13e-cb75-450c-96f0-0e5174ededeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:11:57.750162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:57.751387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:57.752713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:11:57.752713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:11:57.752713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:11:57.752713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:11:57.752713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:11:57.752713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:11:57.752713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:57.752713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:57.756328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 297/595] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:57.757173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4a13e-cb75-450c-96f0-0e5174ededeb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:57.794018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:57.873827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428a1cd-d02e-4bd8-8dd5-e7fed9bf514f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:57.878511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4a13e-cb75-450c-96f0-0e5174ededeb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:57.918568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b1b60-fcbf-4eaf-a1cc-72d0e218106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:57.919169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b1b60-fcbf-4eaf-a1cc-72d0e218106c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:57.919445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b1b60-fcbf-4eaf-a1cc-72d0e218106c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:57.919718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b1b60-fcbf-4eaf-a1cc-72d0e218106c None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:57.920342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505b592-cc34-47ee-aec5-f1e15e49b9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:57.920482 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b1b60-fcbf-4eaf-a1cc-72d0e218106c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:57.920645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b1b60-fcbf-4eaf-a1cc-72d0e218106c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:57.921371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505b592-cc34-47ee-aec5-f1e15e49b9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:57.921838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505b592-cc34-47ee-aec5-f1e15e49b9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:57.922038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b1b60-fcbf-4eaf-a1cc-72d0e218106c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:57.922388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505b592-cc34-47ee-aec5-f1e15e49b9b3 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:57.923573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505b592-cc34-47ee-aec5-f1e15e49b9b3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:57.924019 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505b592-cc34-47ee-aec5-f1e15e49b9b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:57.926101 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505b592-cc34-47ee-aec5-f1e15e49b9b3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:57.939432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 298/596] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:57.939646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b1b60-fcbf-4eaf-a1cc-72d0e218106c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:57.949253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 299/597] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 13 03:11:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:57.950811 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505b592-cc34-47ee-aec5-f1e15e49b9b3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:57.971506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:58.034613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:58.046906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b1b60-fcbf-4eaf-a1cc-72d0e218106c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:58.082026 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89698192-ca5a-4807-bf6a-9c87d22f6227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:58.082713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89698192-ca5a-4807-bf6a-9c87d22f6227 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:58.083058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89698192-ca5a-4807-bf6a-9c87d22f6227 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:58.083468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89698192-ca5a-4807-bf6a-9c87d22f6227 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:58.084192 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89698192-ca5a-4807-bf6a-9c87d22f6227 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:58.084542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89698192-ca5a-4807-bf6a-9c87d22f6227 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:58.086037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89698192-ca5a-4807-bf6a-9c87d22f6227 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:58.086721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505b592-cc34-47ee-aec5-f1e15e49b9b3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:58.104647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 299/598] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:11:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:58.105389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89698192-ca5a-4807-bf6a-9c87d22f6227 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:58.130574 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c1a17-2fd9-4733-a159-65271f3f9080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:58.131308 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c1a17-2fd9-4733-a159-65271f3f9080 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:58.131652 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c1a17-2fd9-4733-a159-65271f3f9080 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:58.132013 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c1a17-2fd9-4733-a159-65271f3f9080 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:58.139771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c1a17-2fd9-4733-a159-65271f3f9080 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:58.141644 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c1a17-2fd9-4733-a159-65271f3f9080 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-1c2c1a17-2fd9-4733-a159-65271f3f9080 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:11:58.154075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:58.155178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:58.156296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:11:58.156296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:11:58.156296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:11:58.156296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:11:58.156296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:11:58.156296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:11:58.156296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:58.156296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:58.156900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 300/599] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:58.162287 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c1a17-2fd9-4733-a159-65271f3f9080 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:58.226231 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89698192-ca5a-4807-bf6a-9c87d22f6227 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:58.263664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ae9b5-371c-4fdf-9fbb-674198214639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:58.264219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:58.264490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ae9b5-371c-4fdf-9fbb-674198214639 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:58.265096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ae9b5-371c-4fdf-9fbb-674198214639 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:58.265096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ae9b5-371c-4fdf-9fbb-674198214639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:58.276958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ae9b5-371c-4fdf-9fbb-674198214639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:58.278521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ae9b5-371c-4fdf-9fbb-674198214639 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:58.286391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-d63ae9b5-371c-4fdf-9fbb-674198214639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:11:58.295031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:58.296182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:11:58.297305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:11:58.297305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:11:58.297305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:58.298095 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 300/600] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:11:58.299149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ae9b5-371c-4fdf-9fbb-674198214639 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:58.300647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c1a17-2fd9-4733-a159-65271f3f9080 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:58.347718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe05bc-59da-4d99-afb1-426408182681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:58.348844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe05bc-59da-4d99-afb1-426408182681 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:58.349627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe05bc-59da-4d99-afb1-426408182681 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:58.349906 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe05bc-59da-4d99-afb1-426408182681 None admin] PATH_INFO: `/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/f746dd2ce4404b679db81794c4d23f26/roles/79cc79c433824f04b3110bccd205b2ba` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:58.371523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe05bc-59da-4d99-afb1-426408182681 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad922f6e2414214abe3ba1de67fc8de, user_id=f746dd2ce4404b679db81794c4d23f26, role_id=79cc79c433824f04b3110bccd205b2ba)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:58.374113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe05bc-59da-4d99-afb1-426408182681 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:58.407817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ae9b5-371c-4fdf-9fbb-674198214639 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:58.443644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54d6ef-4239-47e7-8781-ad083ed747b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:58.444244 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54d6ef-4239-47e7-8781-ad083ed747b6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:58.444520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54d6ef-4239-47e7-8781-ad083ed747b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:58.444792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54d6ef-4239-47e7-8781-ad083ed747b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:58.445504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54d6ef-4239-47e7-8781-ad083ed747b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:58.445838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54d6ef-4239-47e7-8781-ad083ed747b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:58.447272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54d6ef-4239-47e7-8781-ad083ed747b6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:58.462085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 301/601] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:11:58 2022] PUT /identity/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/f746dd2ce4404b679db81794c4d23f26/roles/79cc79c433824f04b3110bccd205b2ba => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:58.463640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe05bc-59da-4d99-afb1-426408182681 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:58.473365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 301/602] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:58.473365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54d6ef-4239-47e7-8781-ad083ed747b6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:58.586821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:58.613695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe05bc-59da-4d99-afb1-426408182681 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:58.643441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:58.658038 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a6cc-39d9-45f5-af05-abf5be49c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:58.658933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a6cc-39d9-45f5-af05-abf5be49c68b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:58.659461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a6cc-39d9-45f5-af05-abf5be49c68b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:58.659882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a6cc-39d9-45f5-af05-abf5be49c68b None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:58.660755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9a6cc-39d9-45f5-af05-abf5be49c68b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:58.661214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9a6cc-39d9-45f5-af05-abf5be49c68b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:58.663033 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9a6cc-39d9-45f5-af05-abf5be49c68b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:58.669473 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54d6ef-4239-47e7-8781-ad083ed747b6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:58.680725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 302/603] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:58.688871 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a6cc-39d9-45f5-af05-abf5be49c68b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:58.723574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f9190-a4d4-4620-9bd5-6e78024287c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:58.724245 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f9190-a4d4-4620-9bd5-6e78024287c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:58.724525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f9190-a4d4-4620-9bd5-6e78024287c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:58.724870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f9190-a4d4-4620-9bd5-6e78024287c8 None admin] PATH_INFO: `/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/5bb4ef26660244ce90b0105113e252b3/roles/79cc79c433824f04b3110bccd205b2ba` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:58.758277 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f9190-a4d4-4620-9bd5-6e78024287c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad922f6e2414214abe3ba1de67fc8de, user_id=5bb4ef26660244ce90b0105113e252b3, role_id=79cc79c433824f04b3110bccd205b2ba)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:58.759764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f9190-a4d4-4620-9bd5-6e78024287c8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:58.814922 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a6cc-39d9-45f5-af05-abf5be49c68b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:58.829781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 302/604] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:11:58 2022] PUT /identity/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/5bb4ef26660244ce90b0105113e252b3/roles/79cc79c433824f04b3110bccd205b2ba => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:58.833438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddec81-c352-4da2-9ef6-a967b5b6428c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:58.833438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddec81-c352-4da2-9ef6-a967b5b6428c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:58.833438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddec81-c352-4da2-9ef6-a967b5b6428c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:58.834982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 303/605] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:58.840573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4fd8-80f2-4124-b933-4ad8ef2a4db3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:58.840881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4fd8-80f2-4124-b933-4ad8ef2a4db3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:58.841099 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4fd8-80f2-4124-b933-4ad8ef2a4db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:58.857819 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785f4c7-6b5b-4922-b33d-6cda14626025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:58.858968 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785f4c7-6b5b-4922-b33d-6cda14626025 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:58.862849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785f4c7-6b5b-4922-b33d-6cda14626025 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:58.862849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785f4c7-6b5b-4922-b33d-6cda14626025 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:58.863016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-639b4fd8-80f2-4124-b933-4ad8ef2a4db3 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:58.863977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-639b4fd8-80f2-4124-b933-4ad8ef2a4db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:58.868328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785f4c7-6b5b-4922-b33d-6cda14626025 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:58.870397 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785f4c7-6b5b-4922-b33d-6cda14626025 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5785f4c7-6b5b-4922-b33d-6cda14626025 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:11:58.886950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:58.887903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:58.888816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:11:58.888816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:11:58.888816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:11:58.888816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:11:58.888816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:11:58.888816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:11:58.888816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:11:58.888816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:58.891492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 303/606] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:58.892992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafc783-dd26-44df-8706-569cc41b3327 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:58.893295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafc783-dd26-44df-8706-569cc41b3327 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:58.893574 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafc783-dd26-44df-8706-569cc41b3327 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:58.895713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 304/607] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:11:58.898997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafc783-dd26-44df-8706-569cc41b3327 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:58.951665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 304/608] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 03:11:58.957810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:58.959189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512633ab-4950-4b4f-9c63-b86b4bf8c0ce None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:58.959720 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512633ab-4950-4b4f-9c63-b86b4bf8c0ce None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:58.960177 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512633ab-4950-4b4f-9c63-b86b4bf8c0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:58.993454 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-512633ab-4950-4b4f-9c63-b86b4bf8c0ce None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:11:58.995576 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-512633ab-4950-4b4f-9c63-b86b4bf8c0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:11:59.014582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafc783-dd26-44df-8706-569cc41b3327 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:59.051057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62f97f-9956-40d9-bdd5-8442fb8deb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:59.051678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62f97f-9956-40d9-bdd5-8442fb8deb59 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:59.051999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62f97f-9956-40d9-bdd5-8442fb8deb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:59.052213 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62f97f-9956-40d9-bdd5-8442fb8deb59 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:59.052904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62f97f-9956-40d9-bdd5-8442fb8deb59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:59.053205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62f97f-9956-40d9-bdd5-8442fb8deb59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:59.054648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62f97f-9956-40d9-bdd5-8442fb8deb59 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:59.069876 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 305/609] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:59.074949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62f97f-9956-40d9-bdd5-8442fb8deb59 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:59.082265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:59.136492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 305/610] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:11:59.192015 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62f97f-9956-40d9-bdd5-8442fb8deb59 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:59.194380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:59.227178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a51a0e-e284-4e3c-b8e9-01041495f861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:59.227827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a51a0e-e284-4e3c-b8e9-01041495f861 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:59.228102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a51a0e-e284-4e3c-b8e9-01041495f861 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:59.228373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a51a0e-e284-4e3c-b8e9-01041495f861 None admin] PATH_INFO: `/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/92e0ce020fb448bc9d470e918a022ebd/roles/79cc79c433824f04b3110bccd205b2ba` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:59.250060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a51a0e-e284-4e3c-b8e9-01041495f861 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad922f6e2414214abe3ba1de67fc8de, user_id=92e0ce020fb448bc9d470e918a022ebd, role_id=79cc79c433824f04b3110bccd205b2ba)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:59.251549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a51a0e-e284-4e3c-b8e9-01041495f861 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:59.326976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512633ab-4950-4b4f-9c63-b86b4bf8c0ce None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:59.343525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 306/611] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:11:59 2022] PUT /identity/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/92e0ce020fb448bc9d470e918a022ebd/roles/79cc79c433824f04b3110bccd205b2ba => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:11:59.423521 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a51a0e-e284-4e3c-b8e9-01041495f861 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:59.469651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512633ab-4950-4b4f-9c63-b86b4bf8c0ce None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:59.514941 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4831c8-d59a-4702-b7d6-4df5ffac9dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:59.515598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4831c8-d59a-4702-b7d6-4df5ffac9dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:59.515873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4831c8-d59a-4702-b7d6-4df5ffac9dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:59.516138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4831c8-d59a-4702-b7d6-4df5ffac9dc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:59.529153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4831c8-d59a-4702-b7d6-4df5ffac9dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3a4831c8-d59a-4702-b7d6-4df5ffac9dc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:59.535242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:59.536185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:59.537019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:59.537019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:59.537019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:59.537019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:59.537019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:59.537019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:59.537019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:59.537019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:59.537019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:59.537019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:59.537019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:59.537019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:11:59.537019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 306/612] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:11:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:59.549742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4831c8-d59a-4702-b7d6-4df5ffac9dc3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:59.595159 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a51a0e-e284-4e3c-b8e9-01041495f861 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:59.617343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:59.659302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abc183-9d0b-44cb-816a-33b27ee8abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:59.659935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc183-9d0b-44cb-816a-33b27ee8abfa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:59.660208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc183-9d0b-44cb-816a-33b27ee8abfa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:59.660473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc183-9d0b-44cb-816a-33b27ee8abfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:59.675041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abc183-9d0b-44cb-816a-33b27ee8abfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e5abc183-9d0b-44cb-816a-33b27ee8abfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:11:59.679891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:11:59.680817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:11:59.681717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:11:59.681717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:11:59.681717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:11:59.681717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:11:59.681717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:11:59.681717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:11:59.681717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:11:59.681717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:11:59.681717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:11:59.681717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:11:59.681717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:11:59.681717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:11:59.681717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 307/613] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:11:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:11:59.690240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abc183-9d0b-44cb-816a-33b27ee8abfa None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:59.711415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:59.712539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4831c8-d59a-4702-b7d6-4df5ffac9dc3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:59.755336 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d0f60-dcc1-42e9-bd15-8078d3ba3661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:59.755941 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d0f60-dcc1-42e9-bd15-8078d3ba3661 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:59.756217 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d0f60-dcc1-42e9-bd15-8078d3ba3661 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:59.756488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d0f60-dcc1-42e9-bd15-8078d3ba3661 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:59.757148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d0f60-dcc1-42e9-bd15-8078d3ba3661 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:59.757478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d0f60-dcc1-42e9-bd15-8078d3ba3661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:59.759591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d0f60-dcc1-42e9-bd15-8078d3ba3661 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:59.771460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 307/614] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:11:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:11:59.777173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d0f60-dcc1-42e9-bd15-8078d3ba3661 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:59.852086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abc183-9d0b-44cb-816a-33b27ee8abfa None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:59.890358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:11:59.901057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d0f60-dcc1-42e9-bd15-8078d3ba3661 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:11:59.917706 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21a78b-e1d4-4d4a-ad09-39096ada2e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:59.918634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21a78b-e1d4-4d4a-ad09-39096ada2e76 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:59.919147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21a78b-e1d4-4d4a-ad09-39096ada2e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:59.919644 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21a78b-e1d4-4d4a-ad09-39096ada2e76 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:59.920509 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21a78b-e1d4-4d4a-ad09-39096ada2e76 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:11:59.921030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21a78b-e1d4-4d4a-ad09-39096ada2e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:59.922679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21a78b-e1d4-4d4a-ad09-39096ada2e76 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:11:59.931423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 308/615] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:11:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:11:59.942023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2e770-6088-4e1d-b9ac-221a6552b4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:11:59.942612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21a78b-e1d4-4d4a-ad09-39096ada2e76 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:11:59.942746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2e770-6088-4e1d-b9ac-221a6552b4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:11:59.942930 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2e770-6088-4e1d-b9ac-221a6552b4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:11:59.943192 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2e770-6088-4e1d-b9ac-221a6552b4f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:11:59.974467 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2e770-6088-4e1d-b9ac-221a6552b4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:11:59.976091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2e770-6088-4e1d-b9ac-221a6552b4f4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-84e2e770-6088-4e1d-b9ac-221a6552b4f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:00.011610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:00.012642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:00.013746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:00.013746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:00.013746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:00.018940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 308/616] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:00.026857 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2e770-6088-4e1d-b9ac-221a6552b4f4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:00.041613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:00.087497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21a78b-e1d4-4d4a-ad09-39096ada2e76 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:00.162813 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949fa3f-7a01-46bf-b5cc-556261af5459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:00.163452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949fa3f-7a01-46bf-b5cc-556261af5459 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:00.163733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949fa3f-7a01-46bf-b5cc-556261af5459 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:00.164007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949fa3f-7a01-46bf-b5cc-556261af5459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:00.177583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2e770-6088-4e1d-b9ac-221a6552b4f4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:00.187534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949fa3f-7a01-46bf-b5cc-556261af5459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:00.188942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949fa3f-7a01-46bf-b5cc-556261af5459 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-2949fa3f-7a01-46bf-b5cc-556261af5459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:00.204573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:00.205728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:00.206816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:00.206816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:00.206816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:00.206816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 309/617] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:00.211365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949fa3f-7a01-46bf-b5cc-556261af5459 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:00.249951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9fed7-76ed-4768-98d7-181049c4307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:00.250556 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9fed7-76ed-4768-98d7-181049c4307d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:00.250833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9fed7-76ed-4768-98d7-181049c4307d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:00.251105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9fed7-76ed-4768-98d7-181049c4307d None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:00.251745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9fed7-76ed-4768-98d7-181049c4307d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:00.252044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9fed7-76ed-4768-98d7-181049c4307d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:00.253740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9fed7-76ed-4768-98d7-181049c4307d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:00.279284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 309/618] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:00.284326 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9fed7-76ed-4768-98d7-181049c4307d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:00.287051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:00.384221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949fa3f-7a01-46bf-b5cc-556261af5459 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:00.432844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:00.441644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9fed7-76ed-4768-98d7-181049c4307d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:00.449949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0671e53-afcc-4ca9-8f76-467def378a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:00.450610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0671e53-afcc-4ca9-8f76-467def378a56 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:00.450888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0671e53-afcc-4ca9-8f76-467def378a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:00.454904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0671e53-afcc-4ca9-8f76-467def378a56 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:00.454904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0671e53-afcc-4ca9-8f76-467def378a56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:00.454904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0671e53-afcc-4ca9-8f76-467def378a56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:00.454904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0671e53-afcc-4ca9-8f76-467def378a56 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:00.474572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 310/619] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:00.481423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0671e53-afcc-4ca9-8f76-467def378a56 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:00.520308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b51911-bbd8-45cf-9ead-4c4fa5b43012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:00.522261 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b51911-bbd8-45cf-9ead-4c4fa5b43012 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:00.522801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b51911-bbd8-45cf-9ead-4c4fa5b43012 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:00.523235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b51911-bbd8-45cf-9ead-4c4fa5b43012 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:00.535011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b51911-bbd8-45cf-9ead-4c4fa5b43012 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:00.537874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b51911-bbd8-45cf-9ead-4c4fa5b43012 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-14b51911-bbd8-45cf-9ead-4c4fa5b43012 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:00.566420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:00.567652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:00.568825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:00.568825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:00.568825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:00.568825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:00.568825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:00.568825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:00.568825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:00.568825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:00.568825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:12:00.568825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:00.568825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 310/620] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 03:12:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:00.574501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b51911-bbd8-45cf-9ead-4c4fa5b43012 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:00.661729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0671e53-afcc-4ca9-8f76-467def378a56 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:00.701698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:00.741982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb185e3-b3e6-4887-b06f-b409113ded87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:00.742688 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb185e3-b3e6-4887-b06f-b409113ded87 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:00.742936 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb185e3-b3e6-4887-b06f-b409113ded87 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:00.743214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb185e3-b3e6-4887-b06f-b409113ded87 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:00.746297 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b51911-bbd8-45cf-9ead-4c4fa5b43012 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:00.758321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb185e3-b3e6-4887-b06f-b409113ded87 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:00.760331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb185e3-b3e6-4887-b06f-b409113ded87 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:00.784650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c423ed3-27da-4416-a989-b788a5831e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:00.786000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c423ed3-27da-4416-a989-b788a5831e6a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:00.786492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c423ed3-27da-4416-a989-b788a5831e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-8eb185e3-b3e6-4887-b06f-b409113ded87 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:00.786834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:00.787750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:00.788749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:00.788749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:00.788749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:00.788749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:00.788749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:00.788749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:00.788749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:00.788749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:00.788749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 03:12:00.788749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:00.788749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 311/621] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:12:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:00.790085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c423ed3-27da-4416-a989-b788a5831e6a None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:00.795423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c423ed3-27da-4416-a989-b788a5831e6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:00.796014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c423ed3-27da-4416-a989-b788a5831e6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:00.797742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c423ed3-27da-4416-a989-b788a5831e6a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:00.798128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb185e3-b3e6-4887-b06f-b409113ded87 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:00.818112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 311/622] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 03:12:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:00.823835 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c423ed3-27da-4416-a989-b788a5831e6a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:00.927219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:00.942917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c423ed3-27da-4416-a989-b788a5831e6a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:00.966519 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:00.986034 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e998c3-ee58-46aa-b3a6-329834485b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:00.986651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e998c3-ee58-46aa-b3a6-329834485b2b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:00.986983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e998c3-ee58-46aa-b3a6-329834485b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:00.987252 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e998c3-ee58-46aa-b3a6-329834485b2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:01.024499 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb185e3-b3e6-4887-b06f-b409113ded87 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:01.073979 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e998c3-ee58-46aa-b3a6-329834485b2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:01.075428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e998c3-ee58-46aa-b3a6-329834485b2b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:01.076505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29497f50-7ca2-45ae-a6fc-c5b90a48e178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:01.077646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497f50-7ca2-45ae-a6fc-c5b90a48e178 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:01.079075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497f50-7ca2-45ae-a6fc-c5b90a48e178 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:01.079579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497f50-7ca2-45ae-a6fc-c5b90a48e178 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:01.080573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29497f50-7ca2-45ae-a6fc-c5b90a48e178 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:01.081079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29497f50-7ca2-45ae-a6fc-c5b90a48e178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:01.082827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29497f50-7ca2-45ae-a6fc-c5b90a48e178 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:01.105306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 312/623] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 13 03:12:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:01.110586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ff8f8-ad30-4d53-a54e-fdb2e9115b3f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:01.110870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ff8f8-ad30-4d53-a54e-fdb2e9115b3f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:01.111142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ff8f8-ad30-4d53-a54e-fdb2e9115b3f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:01.112505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 313/624] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:01.115196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ff8f8-ad30-4d53-a54e-fdb2e9115b3f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:01.191509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 312/625] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:12:01.192962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5394-7033-42d5-83ec-ab41ee36a974 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:01.193383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5394-7033-42d5-83ec-ab41ee36a974 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:01.193742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5394-7033-42d5-83ec-ab41ee36a974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:01.211964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c44a5394-7033-42d5-83ec-ab41ee36a974 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:01.213762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c44a5394-7033-42d5-83ec-ab41ee36a974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:01.230131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:01.255467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ff8f8-ad30-4d53-a54e-fdb2e9115b3f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:01.266758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:01.293977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 313/626] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:12:01.293977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5394-7033-42d5-83ec-ab41ee36a974 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:01.306926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a15e5e-f293-444b-b8ca-a67b76c995ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:01.307806 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a15e5e-f293-444b-b8ca-a67b76c995ab None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:01.308269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a15e5e-f293-444b-b8ca-a67b76c995ab None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:01.308833 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a15e5e-f293-444b-b8ca-a67b76c995ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:01.328286 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a15e5e-f293-444b-b8ca-a67b76c995ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:01.330112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a15e5e-f293-444b-b8ca-a67b76c995ab None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-42a15e5e-f293-444b-b8ca-a67b76c995ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:01.359145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:01.360214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:01.361116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:01.361116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:01.361116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:01.369980 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 314/627] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:01.371350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a15e5e-f293-444b-b8ca-a67b76c995ab None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:01.406654 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5394-7033-42d5-83ec-ab41ee36a974 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:01.446321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa90f92-a31c-476a-a83e-8e514f8859f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:01.446984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90f92-a31c-476a-a83e-8e514f8859f6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:01.447794 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90f92-a31c-476a-a83e-8e514f8859f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:01.448063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa90f92-a31c-476a-a83e-8e514f8859f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:01.459063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa90f92-a31c-476a-a83e-8e514f8859f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:01.460998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa90f92-a31c-476a-a83e-8e514f8859f6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-7fa90f92-a31c-476a-a83e-8e514f8859f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:01.481961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:01.482954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:01.483939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:01.483939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:01.483939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:01.483939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 314/628] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:01.484829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf13ea-30cb-4bd4-ba1a-1f5493eb44bf None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:01.485115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf13ea-30cb-4bd4-ba1a-1f5493eb44bf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:01.488427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf13ea-30cb-4bd4-ba1a-1f5493eb44bf None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:01.488427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 315/629] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:01.488427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf13ea-30cb-4bd4-ba1a-1f5493eb44bf None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:01.491520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:01.536237 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a15e5e-f293-444b-b8ca-a67b76c995ab None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:01.573781 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0d09f-be8e-461d-8318-2f487534bf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:01.574540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0d09f-be8e-461d-8318-2f487534bf96 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:01.574822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0d09f-be8e-461d-8318-2f487534bf96 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:01.575230 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0d09f-be8e-461d-8318-2f487534bf96 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:01.575880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0d09f-be8e-461d-8318-2f487534bf96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:01.576186 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0d09f-be8e-461d-8318-2f487534bf96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:01.577775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0d09f-be8e-461d-8318-2f487534bf96 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:01.594087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 315/630] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:01.595413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4eb14-0187-4a2a-9237-079c97f68cc7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:01.595701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4eb14-0187-4a2a-9237-079c97f68cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:01.595977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4eb14-0187-4a2a-9237-079c97f68cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:01.613881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-20d4eb14-0187-4a2a-9237-079c97f68cc7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:01.615080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-20d4eb14-0187-4a2a-9237-079c97f68cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:01.619524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf13ea-30cb-4bd4-ba1a-1f5493eb44bf None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:01.629730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:01.666105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b33e7-d5da-4755-b013-1ffc2f977001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:01.667250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b33e7-d5da-4755-b013-1ffc2f977001 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:01.667745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b33e7-d5da-4755-b013-1ffc2f977001 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:01.668307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b33e7-d5da-4755-b013-1ffc2f977001 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:01.669405 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b33e7-d5da-4755-b013-1ffc2f977001 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:01.669699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b33e7-d5da-4755-b013-1ffc2f977001 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:01.671090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b33e7-d5da-4755-b013-1ffc2f977001 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:01.686687 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 316/631] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:01.687958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b33e7-d5da-4755-b013-1ffc2f977001 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:01.697945 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 316/632] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:12:01.697945 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4eb14-0187-4a2a-9237-079c97f68cc7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:01.770685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:01.791532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4eb14-0187-4a2a-9237-079c97f68cc7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:01.820698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b33e7-d5da-4755-b013-1ffc2f977001 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:01.826584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8908f9f-c4a4-44f8-8550-47545309611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:01.827268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8908f9f-c4a4-44f8-8550-47545309611e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:01.827551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8908f9f-c4a4-44f8-8550-47545309611e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:01.827817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8908f9f-c4a4-44f8-8550-47545309611e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:01.838643 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8908f9f-c4a4-44f8-8550-47545309611e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f8908f9f-c4a4-44f8-8550-47545309611e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:01.843778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:01.844717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:01.845592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:01.845592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:01.845592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:01.845592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:01.845592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:01.845592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:01.845592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:01.845592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:01.845592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:01.845592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:01.845592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:01.845592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:01.845592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 317/633] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:12:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:01.846301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8908f9f-c4a4-44f8-8550-47545309611e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:01.860374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02b143-f360-4e10-af4e-637b584e2f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:01.861017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02b143-f360-4e10-af4e-637b584e2f8b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:01.861320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02b143-f360-4e10-af4e-637b584e2f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:01.861599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02b143-f360-4e10-af4e-637b584e2f8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:01.870227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:01.871058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02b143-f360-4e10-af4e-637b584e2f8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:01.872661 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02b143-f360-4e10-af4e-637b584e2f8b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-7c02b143-f360-4e10-af4e-637b584e2f8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:01.890284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:01.891281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:01.892175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:01.892175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:01.892175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:01.892175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:01.892175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:01.892175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:01.892175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:01.892175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:01.892175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 317/634] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:01.892671 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02b143-f360-4e10-af4e-637b584e2f8b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:01.979003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8908f9f-c4a4-44f8-8550-47545309611e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:02.016756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d80cb6-c4bf-49de-97b0-de200a8fb0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:02.017421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d80cb6-c4bf-49de-97b0-de200a8fb0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:02.017703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d80cb6-c4bf-49de-97b0-de200a8fb0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:02.017979 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d80cb6-c4bf-49de-97b0-de200a8fb0c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:02.024414 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02b143-f360-4e10-af4e-637b584e2f8b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:02.024599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d80cb6-c4bf-49de-97b0-de200a8fb0c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:02.026118 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d80cb6-c4bf-49de-97b0-de200a8fb0c7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-c6d80cb6-c4bf-49de-97b0-de200a8fb0c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:02.037147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:02.038277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:02.039178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:02.039178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:02.039178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:02.039178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:02.039178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:02.039178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:02.039178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:02.039178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:02.039178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 318/635] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:02.039178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d80cb6-c4bf-49de-97b0-de200a8fb0c7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:02.051071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:02.063087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7ed13-d52e-40a3-b81c-3bef47ce71a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:02.065481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ed13-d52e-40a3-b81c-3bef47ce71a0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:02.065481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ed13-d52e-40a3-b81c-3bef47ce71a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:02.065481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7ed13-d52e-40a3-b81c-3bef47ce71a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:02.065481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7ed13-d52e-40a3-b81c-3bef47ce71a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:02.065481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7ed13-d52e-40a3-b81c-3bef47ce71a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:02.066572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7ed13-d52e-40a3-b81c-3bef47ce71a0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:02.074342 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 318/636] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:12:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:02.075118 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7ed13-d52e-40a3-b81c-3bef47ce71a0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:02.106725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:02.142433 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d80cb6-c4bf-49de-97b0-de200a8fb0c7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:02.173771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7ed13-d52e-40a3-b81c-3bef47ce71a0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:02.176139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d28ee-52d3-4b71-bd79-d86b46ba5678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:02.176740 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d28ee-52d3-4b71-bd79-d86b46ba5678 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:02.177019 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d28ee-52d3-4b71-bd79-d86b46ba5678 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:02.177312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d28ee-52d3-4b71-bd79-d86b46ba5678 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:02.178005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d28ee-52d3-4b71-bd79-d86b46ba5678 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:02.178310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d28ee-52d3-4b71-bd79-d86b46ba5678 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:02.179861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d28ee-52d3-4b71-bd79-d86b46ba5678 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:02.191674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 319/637] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:02.193123 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c034239-655c-404c-bc9d-bf50486e404f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:02.193442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c034239-655c-404c-bc9d-bf50486e404f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:02.193719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c034239-655c-404c-bc9d-bf50486e404f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:02.194897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 320/638] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:02.195582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c034239-655c-404c-bc9d-bf50486e404f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:02.210864 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe632a7-53cc-44d9-828a-a5110f45c7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:02.211512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe632a7-53cc-44d9-828a-a5110f45c7ed None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:02.211789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe632a7-53cc-44d9-828a-a5110f45c7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:02.212055 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe632a7-53cc-44d9-828a-a5110f45c7ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:02.222052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe632a7-53cc-44d9-828a-a5110f45c7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ffe632a7-53cc-44d9-828a-a5110f45c7ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:02.227946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:02.229583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:02.230487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:02.230487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:02.230487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:02.230487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:02.230487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:02.230487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:02.230487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:02.230487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:02.230487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:02.230487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:02.230487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:02.230487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:02.233404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 319/639] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:12:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:02.234404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe632a7-53cc-44d9-828a-a5110f45c7ed None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:02.278950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:02.298248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c034239-655c-404c-bc9d-bf50486e404f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:02.324227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:02.331628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ba00f-6fbf-4467-ae6b-1196f7872ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:02.332231 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ba00f-6fbf-4467-ae6b-1196f7872ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:02.332513 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ba00f-6fbf-4467-ae6b-1196f7872ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:02.332644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe632a7-53cc-44d9-828a-a5110f45c7ed None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:02.332784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ba00f-6fbf-4467-ae6b-1196f7872ed7 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:02.333501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ba00f-6fbf-4467-ae6b-1196f7872ed7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:02.333811 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ba00f-6fbf-4467-ae6b-1196f7872ed7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:02.335243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ba00f-6fbf-4467-ae6b-1196f7872ed7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:02.348511 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 321/640] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:02.349079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ba00f-6fbf-4467-ae6b-1196f7872ed7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:02.367436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111ada2-e122-4f9f-8fd5-3f71e69461b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:02.368082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111ada2-e122-4f9f-8fd5-3f71e69461b8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:02.368358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111ada2-e122-4f9f-8fd5-3f71e69461b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:02.368628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111ada2-e122-4f9f-8fd5-3f71e69461b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:02.379189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111ada2-e122-4f9f-8fd5-3f71e69461b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:02.380635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111ada2-e122-4f9f-8fd5-3f71e69461b8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3111ada2-e122-4f9f-8fd5-3f71e69461b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:02.394597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:02.395610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:02.396984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:02.396984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:02.396984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:02.396984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 320/641] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:02.397224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2afacf-18a7-4434-b22d-be7c42324a4d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:02.397326 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2afacf-18a7-4434-b22d-be7c42324a4d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:02.397645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2afacf-18a7-4434-b22d-be7c42324a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:02.414946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fc2afacf-18a7-4434-b22d-be7c42324a4d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:02.416658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fc2afacf-18a7-4434-b22d-be7c42324a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:02.451370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ba00f-6fbf-4467-ae6b-1196f7872ed7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:02.482659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 321/642] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:12:02.483480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2afacf-18a7-4434-b22d-be7c42324a4d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:02.493018 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90322c-44fe-449f-992d-3470353cb763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:02.493722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90322c-44fe-449f-992d-3470353cb763 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:02.494171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90322c-44fe-449f-992d-3470353cb763 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:02.494641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90322c-44fe-449f-992d-3470353cb763 None admin] PATH_INFO: `/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/bd3284a5c047425d8148f178eee4069d/roles/79cc79c433824f04b3110bccd205b2ba` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:02.509797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:02.519377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90322c-44fe-449f-992d-3470353cb763 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad922f6e2414214abe3ba1de67fc8de, user_id=bd3284a5c047425d8148f178eee4069d, role_id=79cc79c433824f04b3110bccd205b2ba)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:02.520841 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90322c-44fe-449f-992d-3470353cb763 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:02.583540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2afacf-18a7-4434-b22d-be7c42324a4d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:02.614344 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 322/643] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:12:02 2022] PUT /identity/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/bd3284a5c047425d8148f178eee4069d/roles/79cc79c433824f04b3110bccd205b2ba => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:12:02.615534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90322c-44fe-449f-992d-3470353cb763 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:02.622183 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d4abd-639d-4751-87a4-922f2b6024cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:02.622832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d4abd-639d-4751-87a4-922f2b6024cc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:02.625049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d4abd-639d-4751-87a4-922f2b6024cc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:02.625049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d4abd-639d-4751-87a4-922f2b6024cc None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:02.630349 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d4abd-639d-4751-87a4-922f2b6024cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:02.630349 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d4abd-639d-4751-87a4-922f2b6024cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:02.630349 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d4abd-639d-4751-87a4-922f2b6024cc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:02.643304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 322/644] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:12:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:02.644247 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d4abd-639d-4751-87a4-922f2b6024cc None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:02.683911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:02.751910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:02.768497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90322c-44fe-449f-992d-3470353cb763 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:02.769169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d4abd-639d-4751-87a4-922f2b6024cc None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:02.808446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8430321-5b5b-4996-a561-5ff845dfccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:02.808991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60f411-9768-4e0c-8c81-9b2ba8d08def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:02.809089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8430321-5b5b-4996-a561-5ff845dfccaf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:02.809361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f411-9768-4e0c-8c81-9b2ba8d08def None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:02.809464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8430321-5b5b-4996-a561-5ff845dfccaf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:02.809636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f411-9768-4e0c-8c81-9b2ba8d08def None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:02.809750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8430321-5b5b-4996-a561-5ff845dfccaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:02.809933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60f411-9768-4e0c-8c81-9b2ba8d08def None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:02.810327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8430321-5b5b-4996-a561-5ff845dfccaf None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=fcff121c9e974a6aabaa18775de65f63) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:02.810494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60f411-9768-4e0c-8c81-9b2ba8d08def None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:02.810649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8430321-5b5b-4996-a561-5ff845dfccaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:02.810805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60f411-9768-4e0c-8c81-9b2ba8d08def None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:02.812115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8430321-5b5b-4996-a561-5ff845dfccaf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:02.812220 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60f411-9768-4e0c-8c81-9b2ba8d08def None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:02.818327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 323/645] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:02 2022] GET /identity/v3/role_assignments?user.id=fcff121c9e974a6aabaa18775de65f63&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:02.819435 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8430321-5b5b-4996-a561-5ff845dfccaf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:02.827588 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 323/646] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:02.828620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60f411-9768-4e0c-8c81-9b2ba8d08def None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:02.948102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8430321-5b5b-4996-a561-5ff845dfccaf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:02.950760 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:02.959150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60f411-9768-4e0c-8c81-9b2ba8d08def None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:02.998394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fde22a-cd8a-4d59-bbfa-6621117663d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:02.999376 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fde22a-cd8a-4d59-bbfa-6621117663d1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:02.999801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fde22a-cd8a-4d59-bbfa-6621117663d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:03.000215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fde22a-cd8a-4d59-bbfa-6621117663d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:03.001013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f6f80-e18e-4a0a-bef1-72c6b9e299d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:03.001811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f6f80-e18e-4a0a-bef1-72c6b9e299d7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:03.002185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f6f80-e18e-4a0a-bef1-72c6b9e299d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:03.002549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f6f80-e18e-4a0a-bef1-72c6b9e299d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:03.015019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f6f80-e18e-4a0a-bef1-72c6b9e299d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:03.016014 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fde22a-cd8a-4d59-bbfa-6621117663d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:03.017695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fde22a-cd8a-4d59-bbfa-6621117663d1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ac9f6f80-e18e-4a0a-bef1-72c6b9e299d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:03.020959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:03.022004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:03.023071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:03.023071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:03.023071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:03.023071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:03.023071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:03.023071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:03.023071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:03.023071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:03.023071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:03.023071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:03.023071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:03.023071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:03.026093 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 324/647] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:12:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:03.027027 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f6f80-e18e-4a0a-bef1-72c6b9e299d7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:03.040649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-44fde22a-cd8a-4d59-bbfa-6621117663d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:03.045757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:03.046870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:03.047930 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:03.047930 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:03.047930 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:03.047930 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 324/648] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:03.048927 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fde22a-cd8a-4d59-bbfa-6621117663d1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:03.164269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f6f80-e18e-4a0a-bef1-72c6b9e299d7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:03.181963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fde22a-cd8a-4d59-bbfa-6621117663d1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:03.203470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96204b33-d676-4ae9-94c8-556b10ffae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:03.204320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204b33-d676-4ae9-94c8-556b10ffae92 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:03.204745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204b33-d676-4ae9-94c8-556b10ffae92 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:03.205024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204b33-d676-4ae9-94c8-556b10ffae92 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:03.213237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96204b33-d676-4ae9-94c8-556b10ffae92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:03.214880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96204b33-d676-4ae9-94c8-556b10ffae92 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:03.224399 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e92117-786c-4693-b415-862187e18b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:03.225205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e92117-786c-4693-b415-862187e18b40 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:03.225656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e92117-786c-4693-b415-862187e18b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:03.226141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e92117-786c-4693-b415-862187e18b40 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:03.226999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e92117-786c-4693-b415-862187e18b40 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:03.227451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e92117-786c-4693-b415-862187e18b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-96204b33-d676-4ae9-94c8-556b10ffae92 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:03.227855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:03.229047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:03.230250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:03.230250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:03.230250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:03.230250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:03.230250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:03.230250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:03.230250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:03.230250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:03.230250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 03:12:03.230250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:03.232065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e92117-786c-4693-b415-862187e18b40 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:03.233859 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 325/649] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:12:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:03.234691 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96204b33-d676-4ae9-94c8-556b10ffae92 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:03.242749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 325/650] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:12:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:03.243755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e92117-786c-4693-b415-862187e18b40 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:03.269775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:03.318785 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:03.358270 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e92117-786c-4693-b415-862187e18b40 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:03.361418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96204b33-d676-4ae9-94c8-556b10ffae92 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:03.396444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8aef1-eb92-490c-b3dd-22fc2be690ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:03.397062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8aef1-eb92-490c-b3dd-22fc2be690ad None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:03.397411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8aef1-eb92-490c-b3dd-22fc2be690ad None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:03.397635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8aef1-eb92-490c-b3dd-22fc2be690ad None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:03.398361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8aef1-eb92-490c-b3dd-22fc2be690ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:03.398667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8aef1-eb92-490c-b3dd-22fc2be690ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:03.400518 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8aef1-eb92-490c-b3dd-22fc2be690ad None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:03.402298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a2eba-ead2-4ff2-8fa8-d5986a5bed52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:03.403111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a2eba-ead2-4ff2-8fa8-d5986a5bed52 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:03.403613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a2eba-ead2-4ff2-8fa8-d5986a5bed52 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:03.404033 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a2eba-ead2-4ff2-8fa8-d5986a5bed52 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:03.404816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a2eba-ead2-4ff2-8fa8-d5986a5bed52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:03.405381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a2eba-ead2-4ff2-8fa8-d5986a5bed52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:03.406887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a2eba-ead2-4ff2-8fa8-d5986a5bed52 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:03.425690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 326/652] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 13 03:12:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:03.425690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8aef1-eb92-490c-b3dd-22fc2be690ad None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:03.426094 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 326/652] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:03.427158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a2eba-ead2-4ff2-8fa8-d5986a5bed52 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:03.509009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:03.537186 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8aef1-eb92-490c-b3dd-22fc2be690ad None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:03.555310 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a2eba-ead2-4ff2-8fa8-d5986a5bed52 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:03.575708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1978f3-5a9a-4bf5-82a1-a4d117e9560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:03.576602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1978f3-5a9a-4bf5-82a1-a4d117e9560f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:03.577009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1978f3-5a9a-4bf5-82a1-a4d117e9560f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:03.577489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1978f3-5a9a-4bf5-82a1-a4d117e9560f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:03.588948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1978f3-5a9a-4bf5-82a1-a4d117e9560f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:03.590425 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:03.591856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1978f3-5a9a-4bf5-82a1-a4d117e9560f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:03.598693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07226247-b472-4ebc-815f-70df01031c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:03.599293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07226247-b472-4ebc-815f-70df01031c96 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:03.599615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07226247-b472-4ebc-815f-70df01031c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:03.599896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07226247-b472-4ebc-815f-70df01031c96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ff1978f3-5a9a-4bf5-82a1-a4d117e9560f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:03.608752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:03.609914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:03.610913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:03.610913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:03.610913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:03.612891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 327/653] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:03.614054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1978f3-5a9a-4bf5-82a1-a4d117e9560f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:03.683450 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07226247-b472-4ebc-815f-70df01031c96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:03.685043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07226247-b472-4ebc-815f-70df01031c96 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:03.724880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1978f3-5a9a-4bf5-82a1-a4d117e9560f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:03.753970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:03.767461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367d8be-8732-4b23-9465-8f0dae30553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:03.767461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367d8be-8732-4b23-9465-8f0dae30553d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:03.767461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367d8be-8732-4b23-9465-8f0dae30553d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:03.767461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367d8be-8732-4b23-9465-8f0dae30553d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:03.774639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367d8be-8732-4b23-9465-8f0dae30553d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:03.776708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367d8be-8732-4b23-9465-8f0dae30553d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:03.797759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 327/654] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:12:03.798666 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07226247-b472-4ebc-815f-70df01031c96 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6367d8be-8732-4b23-9465-8f0dae30553d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:03.804190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:03.805329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:03.807048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:03.807048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:03.807048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:03.807048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:03.807048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:03.807048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:03.807048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:03.807048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:03.807048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 03:12:03.807048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:03.813283 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 328/655] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:12:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:03.813283 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367d8be-8732-4b23-9465-8f0dae30553d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:03.834458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:03.923925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07226247-b472-4ebc-815f-70df01031c96 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:03.925648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367d8be-8732-4b23-9465-8f0dae30553d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:03.965125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e563e-feeb-4a29-9533-27e8c53bdb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:03.966000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e563e-feeb-4a29-9533-27e8c53bdb63 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:03.966596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e563e-feeb-4a29-9533-27e8c53bdb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:03.967044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e563e-feeb-4a29-9533-27e8c53bdb63 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:03.967790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe0520-ed6d-4aee-8022-405cb6e8ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:03.967995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e563e-feeb-4a29-9533-27e8c53bdb63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:03.968487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e563e-feeb-4a29-9533-27e8c53bdb63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:03.968607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe0520-ed6d-4aee-8022-405cb6e8ab9b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:03.968961 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe0520-ed6d-4aee-8022-405cb6e8ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:03.969817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe0520-ed6d-4aee-8022-405cb6e8ab9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:03.970978 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e563e-feeb-4a29-9533-27e8c53bdb63 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:03.983590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe0520-ed6d-4aee-8022-405cb6e8ab9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:03.984051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 328/656] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:03.985104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e563e-feeb-4a29-9533-27e8c53bdb63 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:03.985222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe0520-ed6d-4aee-8022-405cb6e8ab9b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-14fe0520-ed6d-4aee-8022-405cb6e8ab9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:04.003207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:04.004389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:04.005525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:04.005525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:04.005525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:04.007408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 329/657] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:04.007408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe0520-ed6d-4aee-8022-405cb6e8ab9b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:04.055590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:04.094500 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:04.108293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e563e-feeb-4a29-9533-27e8c53bdb63 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:04.122139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe0520-ed6d-4aee-8022-405cb6e8ab9b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:04.150877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8613e-4332-4551-9b47-5adbb08067ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:04.152047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8613e-4332-4551-9b47-5adbb08067ea None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:04.152654 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8613e-4332-4551-9b47-5adbb08067ea None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:04.155069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8613e-4332-4551-9b47-5adbb08067ea None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:04.155795 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8613e-4332-4551-9b47-5adbb08067ea None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:04.156182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8613e-4332-4551-9b47-5adbb08067ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:04.158423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8613e-4332-4551-9b47-5adbb08067ea None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:04.163142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bd1ff-22ee-43af-b3f5-23bdc1297c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:04.163955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bd1ff-22ee-43af-b3f5-23bdc1297c71 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:04.164403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bd1ff-22ee-43af-b3f5-23bdc1297c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:04.164859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bd1ff-22ee-43af-b3f5-23bdc1297c71 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:04.173747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bd1ff-22ee-43af-b3f5-23bdc1297c71 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:04.175492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bd1ff-22ee-43af-b3f5-23bdc1297c71 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:04.178167 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 329/658] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Sep 13 03:12:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:04.183484 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8613e-4332-4551-9b47-5adbb08067ea None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-d64bd1ff-22ee-43af-b3f5-23bdc1297c71 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:04.191800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:04.192755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:04.193755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:04.193755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:04.193755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:04.193755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:04.193755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:04.193755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:04.193755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:04.193755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:04.193755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 03:12:04.193755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:04.196179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 330/659] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:12:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:04.197281 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bd1ff-22ee-43af-b3f5-23bdc1297c71 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:04.287356 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8613e-4332-4551-9b47-5adbb08067ea None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:04.309387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:04.314278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bd1ff-22ee-43af-b3f5-23bdc1297c71 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:04.323175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a033ad-2211-4d83-9ec5-12aafd859c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:04.323784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a033ad-2211-4d83-9ec5-12aafd859c2d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:04.324065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a033ad-2211-4d83-9ec5-12aafd859c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:04.324335 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a033ad-2211-4d83-9ec5-12aafd859c2d None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:04.325516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a033ad-2211-4d83-9ec5-12aafd859c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:04.325516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a033ad-2211-4d83-9ec5-12aafd859c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:04.326671 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a033ad-2211-4d83-9ec5-12aafd859c2d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:04.343571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 330/660] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:04.343571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a033ad-2211-4d83-9ec5-12aafd859c2d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:04.348980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:04.360902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f85ffe-6d17-46cd-b8dc-1a44cfe809dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:04.362775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f85ffe-6d17-46cd-b8dc-1a44cfe809dd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:04.362775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f85ffe-6d17-46cd-b8dc-1a44cfe809dd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:04.362775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f85ffe-6d17-46cd-b8dc-1a44cfe809dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:04.439859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f85ffe-6d17-46cd-b8dc-1a44cfe809dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:04.441635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f85ffe-6d17-46cd-b8dc-1a44cfe809dd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:04.442627 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a033ad-2211-4d83-9ec5-12aafd859c2d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:04.478866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77610c66-bb57-45b0-b6e6-49d32f613870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:04.479468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77610c66-bb57-45b0-b6e6-49d32f613870 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:04.479752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77610c66-bb57-45b0-b6e6-49d32f613870 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:04.480103 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77610c66-bb57-45b0-b6e6-49d32f613870 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:04.480850 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77610c66-bb57-45b0-b6e6-49d32f613870 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:04.481162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77610c66-bb57-45b0-b6e6-49d32f613870 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:04.482636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77610c66-bb57-45b0-b6e6-49d32f613870 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:04.500296 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 331/661] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Sep 13 03:12:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:04.501197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77610c66-bb57-45b0-b6e6-49d32f613870 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:04.550841 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:04.561019 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 331/662] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:12:04.562212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f85ffe-6d17-46cd-b8dc-1a44cfe809dd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:04.564637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:04.604122 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77610c66-bb57-45b0-b6e6-49d32f613870 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:04.641240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2bd7d-a254-4cc2-9fb1-d8b93b1bcef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:04.641894 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2bd7d-a254-4cc2-9fb1-d8b93b1bcef9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:04.642171 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2bd7d-a254-4cc2-9fb1-d8b93b1bcef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:04.642442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2bd7d-a254-4cc2-9fb1-d8b93b1bcef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:04.649537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2bd7d-a254-4cc2-9fb1-d8b93b1bcef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:04.650878 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a2bd7d-a254-4cc2-9fb1-d8b93b1bcef9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-56a2bd7d-a254-4cc2-9fb1-d8b93b1bcef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:04.662430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:04.663507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:04.664778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:04.664778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:04.664778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:04.664778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:04.664778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:04.664778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:04.664778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:04.664778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:04.668316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 332/663] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:04.669159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2bd7d-a254-4cc2-9fb1-d8b93b1bcef9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:04.675710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f85ffe-6d17-46cd-b8dc-1a44cfe809dd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:04.716582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26dffd-7244-4460-8b34-8ca3ec00e968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:04.717637 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26dffd-7244-4460-8b34-8ca3ec00e968 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:04.718070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26dffd-7244-4460-8b34-8ca3ec00e968 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:04.718494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26dffd-7244-4460-8b34-8ca3ec00e968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:04.779207 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2bd7d-a254-4cc2-9fb1-d8b93b1bcef9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:04.794498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26dffd-7244-4460-8b34-8ca3ec00e968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:04.796296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26dffd-7244-4460-8b34-8ca3ec00e968 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:04.803481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:04.821406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35ce6-3456-4ec6-8fb1-b60591fcb85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:04.821406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35ce6-3456-4ec6-8fb1-b60591fcb85e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:04.821406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35ce6-3456-4ec6-8fb1-b60591fcb85e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:04.821406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35ce6-3456-4ec6-8fb1-b60591fcb85e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:04.822146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:04.827628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e35ce6-3456-4ec6-8fb1-b60591fcb85e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:04.829094 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e35ce6-3456-4ec6-8fb1-b60591fcb85e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a0e35ce6-3456-4ec6-8fb1-b60591fcb85e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:04.844980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:04.848082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:04.848994 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:04.848994 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:04.848994 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:04.848994 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 333/664] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:04.848994 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35ce6-3456-4ec6-8fb1-b60591fcb85e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:04.908514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 332/665] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:12:04.910134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7ef0-c820-4870-8741-4446850587fc None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:04.910607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7ef0-c820-4870-8741-4446850587fc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:04.911029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7ef0-c820-4870-8741-4446850587fc None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:04.912412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 333/666] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:04.913458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7ef0-c820-4870-8741-4446850587fc None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:04.965211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35ce6-3456-4ec6-8fb1-b60591fcb85e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:05.001311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b95b19-822e-46ed-9784-0c2e25a5f844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:05.002067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b95b19-822e-46ed-9784-0c2e25a5f844 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:05.002302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b95b19-822e-46ed-9784-0c2e25a5f844 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:05.002574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b95b19-822e-46ed-9784-0c2e25a5f844 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:05.003385 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b95b19-822e-46ed-9784-0c2e25a5f844 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:05.003692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b95b19-822e-46ed-9784-0c2e25a5f844 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:05.005135 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b95b19-822e-46ed-9784-0c2e25a5f844 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:05.015248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:05.024596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7ef0-c820-4870-8741-4446850587fc None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:05.024755 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 334/667] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:05.024755 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b95b19-822e-46ed-9784-0c2e25a5f844 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:05.057130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0a08b-6b47-42eb-8149-682aaa5eedab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:05.057766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0a08b-6b47-42eb-8149-682aaa5eedab None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:05.058086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0a08b-6b47-42eb-8149-682aaa5eedab None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:05.058369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0a08b-6b47-42eb-8149-682aaa5eedab None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:05.058940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0a08b-6b47-42eb-8149-682aaa5eedab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:05.059241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0a08b-6b47-42eb-8149-682aaa5eedab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:05.060601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0a08b-6b47-42eb-8149-682aaa5eedab None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:05.062119 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:05.078246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 334/668] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:05.078246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acc1e1-deba-4bda-94a0-5545ba63188b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:05.078246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acc1e1-deba-4bda-94a0-5545ba63188b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:05.078246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acc1e1-deba-4bda-94a0-5545ba63188b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:05.094060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-46acc1e1-deba-4bda-94a0-5545ba63188b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:05.095316 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-46acc1e1-deba-4bda-94a0-5545ba63188b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:05.151089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b95b19-822e-46ed-9784-0c2e25a5f844 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:05.173648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 335/669] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:12:05.174497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acc1e1-deba-4bda-94a0-5545ba63188b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:05.198929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6542f3-ddb0-4bc9-91e7-82cf6c0e626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:05.199573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6542f3-ddb0-4bc9-91e7-82cf6c0e626d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:05.199853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6542f3-ddb0-4bc9-91e7-82cf6c0e626d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:05.200124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6542f3-ddb0-4bc9-91e7-82cf6c0e626d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:05.213238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6542f3-ddb0-4bc9-91e7-82cf6c0e626d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:05.214712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6542f3-ddb0-4bc9-91e7-82cf6c0e626d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5d6542f3-ddb0-4bc9-91e7-82cf6c0e626d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:05.230065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:05.231028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:05.231954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:05.231954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:05.231954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:05.231954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 335/670] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:05.231954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6542f3-ddb0-4bc9-91e7-82cf6c0e626d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:05.280692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:05.293764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acc1e1-deba-4bda-94a0-5545ba63188b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:05.329553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649540c6-58d0-46b6-b056-6cd085c72623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:05.330231 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649540c6-58d0-46b6-b056-6cd085c72623 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:05.330617 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649540c6-58d0-46b6-b056-6cd085c72623 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:05.330992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649540c6-58d0-46b6-b056-6cd085c72623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:05.331726 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649540c6-58d0-46b6-b056-6cd085c72623 None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=f746dd2ce4404b679db81794c4d23f26) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:05.332125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649540c6-58d0-46b6-b056-6cd085c72623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:05.333565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649540c6-58d0-46b6-b056-6cd085c72623 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:05.339582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:05.339809 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 336/671] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:05 2022] GET /identity/v3/role_assignments?user.id=f746dd2ce4404b679db81794c4d23f26&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:05.341020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc23a7-1f0f-480e-a126-95c32405a01f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:05.341335 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc23a7-1f0f-480e-a126-95c32405a01f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:05.341612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc23a7-1f0f-480e-a126-95c32405a01f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:05.347324 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 337/672] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:05.347324 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc23a7-1f0f-480e-a126-95c32405a01f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:05.368159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6542f3-ddb0-4bc9-91e7-82cf6c0e626d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:05.413136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a0c6a-0eb6-4bba-b27d-b7f5d6beeb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:05.414177 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a0c6a-0eb6-4bba-b27d-b7f5d6beeb2e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:05.414653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a0c6a-0eb6-4bba-b27d-b7f5d6beeb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:05.415075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a0c6a-0eb6-4bba-b27d-b7f5d6beeb2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:05.424220 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a0c6a-0eb6-4bba-b27d-b7f5d6beeb2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:05.426249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a0c6a-0eb6-4bba-b27d-b7f5d6beeb2e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-768a0c6a-0eb6-4bba-b27d-b7f5d6beeb2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:05.440141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:05.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:05.442477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:05.442477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:05.442477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:05.442477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:05.442477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:05.442477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:05.442477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:05.442477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:05.444718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 336/673] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:05.446407 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc7543-3b80-489f-82ef-aea8a1738b7a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:05.446895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc7543-3b80-489f-82ef-aea8a1738b7a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:05.447478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc7543-3b80-489f-82ef-aea8a1738b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:05.467648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc23a7-1f0f-480e-a126-95c32405a01f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:05.468757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-33cc7543-3b80-489f-82ef-aea8a1738b7a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:05.470516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-33cc7543-3b80-489f-82ef-aea8a1738b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:05.505394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11142b0e-c1e4-46d4-ab70-89c2dd480b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:05.506016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11142b0e-c1e4-46d4-ab70-89c2dd480b74 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:05.506293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11142b0e-c1e4-46d4-ab70-89c2dd480b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:05.506565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11142b0e-c1e4-46d4-ab70-89c2dd480b74 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:05.507215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11142b0e-c1e4-46d4-ab70-89c2dd480b74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:05.507558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11142b0e-c1e4-46d4-ab70-89c2dd480b74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:05.508894 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11142b0e-c1e4-46d4-ab70-89c2dd480b74 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:05.526227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 338/674] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:05.526227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11142b0e-c1e4-46d4-ab70-89c2dd480b74 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:05.540945 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:05.553326 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 337/675] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:12:05.554009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc7543-3b80-489f-82ef-aea8a1738b7a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:05.643362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:05.648850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11142b0e-c1e4-46d4-ab70-89c2dd480b74 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:05.667700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc7543-3b80-489f-82ef-aea8a1738b7a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:05.691898 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57dbaf-3b7a-4423-b664-ea7876ed6008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:05.692966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57dbaf-3b7a-4423-b664-ea7876ed6008 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:05.693525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57dbaf-3b7a-4423-b664-ea7876ed6008 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:05.693802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57dbaf-3b7a-4423-b664-ea7876ed6008 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:05.694498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57dbaf-3b7a-4423-b664-ea7876ed6008 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:05.694958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57dbaf-3b7a-4423-b664-ea7876ed6008 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:05.697530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57dbaf-3b7a-4423-b664-ea7876ed6008 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:05.704409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38850b-f8ad-479c-9119-0bd9e91fd00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:05.705170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38850b-f8ad-479c-9119-0bd9e91fd00c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:05.705577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38850b-f8ad-479c-9119-0bd9e91fd00c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:05.705992 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38850b-f8ad-479c-9119-0bd9e91fd00c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:05.714182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 339/676] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:05.718878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57dbaf-3b7a-4423-b664-ea7876ed6008 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:05.724149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38850b-f8ad-479c-9119-0bd9e91fd00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-0d38850b-f8ad-479c-9119-0bd9e91fd00c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:05.729802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:05.730928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:05.731958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:05.731958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:05.731958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:05.731958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:05.731958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:05.731958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:05.731958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:05.731958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:05.731958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:05.731958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:05.731958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:05.731958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:05.733886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 338/677] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:12:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:05.739264 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38850b-f8ad-479c-9119-0bd9e91fd00c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:05.810272 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:05.842806 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57dbaf-3b7a-4423-b664-ea7876ed6008 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:05.858208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38850b-f8ad-479c-9119-0bd9e91fd00c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:05.881365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b525f-35e2-4ad4-b263-d26628cc194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:05.881996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b525f-35e2-4ad4-b263-d26628cc194b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:05.882274 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b525f-35e2-4ad4-b263-d26628cc194b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:05.882547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b525f-35e2-4ad4-b263-d26628cc194b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:05.889695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b525f-35e2-4ad4-b263-d26628cc194b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:05.891143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b525f-35e2-4ad4-b263-d26628cc194b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:05.896750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90941acd-21dc-41aa-a0f2-5d37b88007f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:05.896750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90941acd-21dc-41aa-a0f2-5d37b88007f5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:05.896750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90941acd-21dc-41aa-a0f2-5d37b88007f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:05.896750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90941acd-21dc-41aa-a0f2-5d37b88007f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:05.897137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90941acd-21dc-41aa-a0f2-5d37b88007f5 None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=5bb4ef26660244ce90b0105113e252b3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:05.897137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90941acd-21dc-41aa-a0f2-5d37b88007f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:05.897935 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90941acd-21dc-41aa-a0f2-5d37b88007f5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-005b525f-35e2-4ad4-b263-d26628cc194b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:05.903190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:05.904082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:05.904981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:05.904981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:05.904981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:05.904981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:05.904981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:05.904981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:05.904981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:05.904981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:05.904981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 340/678] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:05.905525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b525f-35e2-4ad4-b263-d26628cc194b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:05.913450 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 339/679] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:05 2022] GET /identity/v3/role_assignments?user.id=5bb4ef26660244ce90b0105113e252b3&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:05.915497 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90941acd-21dc-41aa-a0f2-5d37b88007f5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:05.920241 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:06.024964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b525f-35e2-4ad4-b263-d26628cc194b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:06.062293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:06.070446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb573f7-2215-4445-b3cd-6f66078326a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:06.074086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb573f7-2215-4445-b3cd-6f66078326a3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:06.074086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb573f7-2215-4445-b3cd-6f66078326a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:06.074086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb573f7-2215-4445-b3cd-6f66078326a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:06.074086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb573f7-2215-4445-b3cd-6f66078326a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:06.074488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb573f7-2215-4445-b3cd-6f66078326a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:06.076283 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb573f7-2215-4445-b3cd-6f66078326a3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:06.078026 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90941acd-21dc-41aa-a0f2-5d37b88007f5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:06.092465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 341/680] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:12:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:06.096986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb573f7-2215-4445-b3cd-6f66078326a3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:06.124582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640c219-bd43-40b9-90a2-eeda0de0a098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:06.125217 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640c219-bd43-40b9-90a2-eeda0de0a098 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:06.125605 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640c219-bd43-40b9-90a2-eeda0de0a098 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:06.125799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640c219-bd43-40b9-90a2-eeda0de0a098 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:06.142511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640c219-bd43-40b9-90a2-eeda0de0a098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-9640c219-bd43-40b9-90a2-eeda0de0a098 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:06.148150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:06.149373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:06.150960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:06.150960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:06.150960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:06.150960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:06.150960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:06.150960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:06.150960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:06.150960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:06.150960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:06.150960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:06.150960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:06.150960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:06.153041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 340/681] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:12:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:06.154073 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640c219-bd43-40b9-90a2-eeda0de0a098 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:06.229449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:06.233858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb573f7-2215-4445-b3cd-6f66078326a3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:06.270822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eb2f0-490c-437e-b88d-b80e403d13c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:06.271861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eb2f0-490c-437e-b88d-b80e403d13c2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:06.272335 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eb2f0-490c-437e-b88d-b80e403d13c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:06.272863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eb2f0-490c-437e-b88d-b80e403d13c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:06.273877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eb2f0-490c-437e-b88d-b80e403d13c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:06.274379 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eb2f0-490c-437e-b88d-b80e403d13c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:06.276749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eb2f0-490c-437e-b88d-b80e403d13c2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:06.281729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640c219-bd43-40b9-90a2-eeda0de0a098 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:06.290405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 342/682] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:06.292162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eb2f0-490c-437e-b88d-b80e403d13c2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:06.325026 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990179e-9d4d-4736-9ae3-0abf6fe28414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:06.325788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990179e-9d4d-4736-9ae3-0abf6fe28414 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:06.326064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990179e-9d4d-4736-9ae3-0abf6fe28414 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:06.326336 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990179e-9d4d-4736-9ae3-0abf6fe28414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:06.341493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990179e-9d4d-4736-9ae3-0abf6fe28414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:06.343656 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990179e-9d4d-4736-9ae3-0abf6fe28414 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:06.356682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-8990179e-9d4d-4736-9ae3-0abf6fe28414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:06.363426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:06.364530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:06.373188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:06.373188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:06.373188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:06.373188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 341/683] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:06.373188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990179e-9d4d-4736-9ae3-0abf6fe28414 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:06.423840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eb2f0-490c-437e-b88d-b80e403d13c2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:06.465911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66556f-432b-4ecf-a486-25b70ef03d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:06.466824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66556f-432b-4ecf-a486-25b70ef03d7e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:06.467112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66556f-432b-4ecf-a486-25b70ef03d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:06.467388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66556f-432b-4ecf-a486-25b70ef03d7e None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:06.468057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66556f-432b-4ecf-a486-25b70ef03d7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:06.468364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66556f-432b-4ecf-a486-25b70ef03d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:06.470043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66556f-432b-4ecf-a486-25b70ef03d7e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:06.485439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 343/684] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:12:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:06.485439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66556f-432b-4ecf-a486-25b70ef03d7e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:06.492946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990179e-9d4d-4736-9ae3-0abf6fe28414 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:06.513006 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:06.541668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f44e9-23e6-4b86-a43a-6d6038e297a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:06.542229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f44e9-23e6-4b86-a43a-6d6038e297a5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:06.542516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f44e9-23e6-4b86-a43a-6d6038e297a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:06.542786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f44e9-23e6-4b86-a43a-6d6038e297a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:06.543552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f44e9-23e6-4b86-a43a-6d6038e297a5 None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=92e0ce020fb448bc9d470e918a022ebd) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:06.543804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f44e9-23e6-4b86-a43a-6d6038e297a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:06.545293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f44e9-23e6-4b86-a43a-6d6038e297a5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:06.553028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 342/685] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:06 2022] GET /identity/v3/role_assignments?user.id=92e0ce020fb448bc9d470e918a022ebd&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:06.553664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f44e9-23e6-4b86-a43a-6d6038e297a5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:06.607068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66556f-432b-4ecf-a486-25b70ef03d7e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:06.626433 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:06.659107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10f16d-9af8-4ba0-83c3-f925b0150774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:06.660165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f16d-9af8-4ba0-83c3-f925b0150774 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:06.661521 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f16d-9af8-4ba0-83c3-f925b0150774 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:06.662036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f16d-9af8-4ba0-83c3-f925b0150774 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:06.664590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10f16d-9af8-4ba0-83c3-f925b0150774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:06.665144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10f16d-9af8-4ba0-83c3-f925b0150774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:06.668056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10f16d-9af8-4ba0-83c3-f925b0150774 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:06.701202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 344/686] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:06.708096 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10f16d-9af8-4ba0-83c3-f925b0150774 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:06.717110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f44e9-23e6-4b86-a43a-6d6038e297a5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:06.791469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e28ae9-d507-4136-ad4e-2a1639b9de22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:06.792517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e28ae9-d507-4136-ad4e-2a1639b9de22 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:06.793012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e28ae9-d507-4136-ad4e-2a1639b9de22 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:06.793536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e28ae9-d507-4136-ad4e-2a1639b9de22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:06.810562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e28ae9-d507-4136-ad4e-2a1639b9de22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:06.812926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e28ae9-d507-4136-ad4e-2a1639b9de22 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f3e28ae9-d507-4136-ad4e-2a1639b9de22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:06.831915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:06.832987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:06.833927 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:06.833927 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:06.833927 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:06.836218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 343/687] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:06.843208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e28ae9-d507-4136-ad4e-2a1639b9de22 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:06.867910 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10f16d-9af8-4ba0-83c3-f925b0150774 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:06.881074 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:06.907442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822bc17-008d-4120-9482-f97eafe908ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:06.908207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822bc17-008d-4120-9482-f97eafe908ea None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:06.908608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822bc17-008d-4120-9482-f97eafe908ea None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:06.908985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822bc17-008d-4120-9482-f97eafe908ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:06.918232 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822bc17-008d-4120-9482-f97eafe908ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:06.919830 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822bc17-008d-4120-9482-f97eafe908ea None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4822bc17-008d-4120-9482-f97eafe908ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:06.936440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:06.940161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:06.941126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:06.941126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:06.941126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:06.941126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:06.941126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:06.941126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:06.941126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:06.941126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:06.941126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 03:12:06.941126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:06.941126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 345/688] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:12:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:06.945004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822bc17-008d-4120-9482-f97eafe908ea None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:06.965019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e28ae9-d507-4136-ad4e-2a1639b9de22 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:06.983083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:07.003226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d80ef-b5d0-4466-b827-dca0d07644d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:07.004114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d80ef-b5d0-4466-b827-dca0d07644d2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:07.004569 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d80ef-b5d0-4466-b827-dca0d07644d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:07.005009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d80ef-b5d0-4466-b827-dca0d07644d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:07.005851 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d80ef-b5d0-4466-b827-dca0d07644d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:07.006321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d80ef-b5d0-4466-b827-dca0d07644d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:07.007845 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d80ef-b5d0-4466-b827-dca0d07644d2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:07.022781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 344/689] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:07.028339 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d80ef-b5d0-4466-b827-dca0d07644d2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:07.053834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822bc17-008d-4120-9482-f97eafe908ea None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:07.090784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938f08-994c-4a4b-b22a-0068a6039ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:07.091556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938f08-994c-4a4b-b22a-0068a6039ccf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:07.091935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938f08-994c-4a4b-b22a-0068a6039ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:07.092312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68938f08-994c-4a4b-b22a-0068a6039ccf None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:07.093138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68938f08-994c-4a4b-b22a-0068a6039ccf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:07.093577 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68938f08-994c-4a4b-b22a-0068a6039ccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:07.095203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68938f08-994c-4a4b-b22a-0068a6039ccf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:07.117576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 346/690] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 13 03:12:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:07.119650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938f08-994c-4a4b-b22a-0068a6039ccf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:07.130424 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:07.142405 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d80ef-b5d0-4466-b827-dca0d07644d2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:07.179531 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfc86d-f707-4054-8dd7-6dfdeaa1e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:07.180474 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc86d-f707-4054-8dd7-6dfdeaa1e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:07.180894 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc86d-f707-4054-8dd7-6dfdeaa1e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:07.181907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc86d-f707-4054-8dd7-6dfdeaa1e0e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:07.189999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfc86d-f707-4054-8dd7-6dfdeaa1e0e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:07.191695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfc86d-f707-4054-8dd7-6dfdeaa1e0e9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5bbfc86d-f707-4054-8dd7-6dfdeaa1e0e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:07.204672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:07.205865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:07.207104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:07.207104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:07.207104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:07.207104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:07.207104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:07.207104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:07.207104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:07.207104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:07.207104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:12:07.207104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:07.213335 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 345/691] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 03:12:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:07.214993 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfc86d-f707-4054-8dd7-6dfdeaa1e0e9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:07.223228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:07.231090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68938f08-994c-4a4b-b22a-0068a6039ccf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:07.267720 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f3443-febb-4d98-a7bf-495d949c4adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:07.268498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f3443-febb-4d98-a7bf-495d949c4adb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:07.268934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f3443-febb-4d98-a7bf-495d949c4adb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:07.276628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f3443-febb-4d98-a7bf-495d949c4adb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:07.326077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfc86d-f707-4054-8dd7-6dfdeaa1e0e9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:07.362910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23bd7-c7e7-4fcf-b4da-68d01e1d4a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:07.363812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23bd7-c7e7-4fcf-b4da-68d01e1d4a17 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:07.364248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23bd7-c7e7-4fcf-b4da-68d01e1d4a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:07.364439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f3443-febb-4d98-a7bf-495d949c4adb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:07.364824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23bd7-c7e7-4fcf-b4da-68d01e1d4a17 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:07.365738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23bd7-c7e7-4fcf-b4da-68d01e1d4a17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:07.366219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23bd7-c7e7-4fcf-b4da-68d01e1d4a17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:07.366343 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f3443-febb-4d98-a7bf-495d949c4adb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:07.367979 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23bd7-c7e7-4fcf-b4da-68d01e1d4a17 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:07.388175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 346/692] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 03:12:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:07.394058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23bd7-c7e7-4fcf-b4da-68d01e1d4a17 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:07.405366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:07.466849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:07.475629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 347/693] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 03:12:07.481935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f3443-febb-4d98-a7bf-495d949c4adb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:07.503249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23bd7-c7e7-4fcf-b4da-68d01e1d4a17 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:07.539068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe40a1d-85ac-4732-a39d-41c604d37069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:07.539945 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe40a1d-85ac-4732-a39d-41c604d37069 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:07.540373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe40a1d-85ac-4732-a39d-41c604d37069 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:07.541348 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe40a1d-85ac-4732-a39d-41c604d37069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:07.592053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f3443-febb-4d98-a7bf-495d949c4adb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:07.615028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe40a1d-85ac-4732-a39d-41c604d37069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:07.616768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe40a1d-85ac-4732-a39d-41c604d37069 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:07.627432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:07.631275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998c02e-cc98-4b23-bd8e-bf27456bd28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:07.632153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998c02e-cc98-4b23-bd8e-bf27456bd28e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:07.632692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998c02e-cc98-4b23-bd8e-bf27456bd28e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:07.633317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998c02e-cc98-4b23-bd8e-bf27456bd28e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:07.644719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998c02e-cc98-4b23-bd8e-bf27456bd28e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:07.646448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998c02e-cc98-4b23-bd8e-bf27456bd28e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7998c02e-cc98-4b23-bd8e-bf27456bd28e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:07.662244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:07.663211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:07.665439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:07.665439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:07.665439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:07.668790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 348/694] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:07.674401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998c02e-cc98-4b23-bd8e-bf27456bd28e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:07.722656 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 347/695] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:12:07.726301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:07.733294 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe40a1d-85ac-4732-a39d-41c604d37069 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:07.847428 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998c02e-cc98-4b23-bd8e-bf27456bd28e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:07.849902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe40a1d-85ac-4732-a39d-41c604d37069 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:07.862806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:07.888318 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c322813-d608-4f7c-9a16-6be6d45f11a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:07.889091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c322813-d608-4f7c-9a16-6be6d45f11a3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:07.889328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c322813-d608-4f7c-9a16-6be6d45f11a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:07.889578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c322813-d608-4f7c-9a16-6be6d45f11a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:07.901757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c322813-d608-4f7c-9a16-6be6d45f11a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:07.903235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c322813-d608-4f7c-9a16-6be6d45f11a3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5c322813-d608-4f7c-9a16-6be6d45f11a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:07.922226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:07.923232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:07.924129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:07.924129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:07.924129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:07.924129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 348/696] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:07.925772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2412c1-65eb-4916-9413-4d168dd0599b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:07.925772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2412c1-65eb-4916-9413-4d168dd0599b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:07.925772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2412c1-65eb-4916-9413-4d168dd0599b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:07.929291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 349/697] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:07.930735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2412c1-65eb-4916-9413-4d168dd0599b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:07.932146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8946260-8aa5-4d3b-bb93-5137f78b4750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:07.932762 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8946260-8aa5-4d3b-bb93-5137f78b4750 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:07.933039 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8946260-8aa5-4d3b-bb93-5137f78b4750 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:07.933338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8946260-8aa5-4d3b-bb93-5137f78b4750 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:07.934524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8946260-8aa5-4d3b-bb93-5137f78b4750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:07.934524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8946260-8aa5-4d3b-bb93-5137f78b4750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:07.935699 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8946260-8aa5-4d3b-bb93-5137f78b4750 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:07.952244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 349/698] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:07.953644 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e8677-c449-480b-a1c9-a198e52dd479 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:07.953928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e8677-c449-480b-a1c9-a198e52dd479 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:07.954200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e8677-c449-480b-a1c9-a198e52dd479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:07.985789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-284e8677-c449-480b-a1c9-a198e52dd479 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:07.987414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-284e8677-c449-480b-a1c9-a198e52dd479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:08.055025 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2412c1-65eb-4916-9413-4d168dd0599b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:08.084553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 350/699] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:12:08.085928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e8677-c449-480b-a1c9-a198e52dd479 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:08.093609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462549f-cdd3-40bb-9449-ec12733c200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:08.094219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462549f-cdd3-40bb-9449-ec12733c200e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:08.094571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462549f-cdd3-40bb-9449-ec12733c200e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:08.094885 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462549f-cdd3-40bb-9449-ec12733c200e None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:08.095529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462549f-cdd3-40bb-9449-ec12733c200e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:08.095830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462549f-cdd3-40bb-9449-ec12733c200e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:08.097409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462549f-cdd3-40bb-9449-ec12733c200e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:08.114453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 350/700] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:08.115688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462549f-cdd3-40bb-9449-ec12733c200e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:08.130090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:08.139221 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:08.209936 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e8677-c449-480b-a1c9-a198e52dd479 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:08.282061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc5f16-59c6-41fd-be77-f3000cfbf2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:08.282627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc5f16-59c6-41fd-be77-f3000cfbf2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:08.282902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc5f16-59c6-41fd-be77-f3000cfbf2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:08.283173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc5f16-59c6-41fd-be77-f3000cfbf2e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:08.296380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc5f16-59c6-41fd-be77-f3000cfbf2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:08.297859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc5f16-59c6-41fd-be77-f3000cfbf2e8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:08.303129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462549f-cdd3-40bb-9449-ec12733c200e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-70fc5f16-59c6-41fd-be77-f3000cfbf2e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:08.310585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:08.311487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:08.312366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:08.312366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:08.312366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:08.312366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:08.312366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:08.312366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:08.312366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:08.312366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:08.312366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 351/701] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:08.319518 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc5f16-59c6-41fd-be77-f3000cfbf2e8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:08.369370 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6ddc3-56b7-4c2e-8168-9eb8e1f7df3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:08.370014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6ddc3-56b7-4c2e-8168-9eb8e1f7df3a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:08.370297 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6ddc3-56b7-4c2e-8168-9eb8e1f7df3a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:08.370579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6ddc3-56b7-4c2e-8168-9eb8e1f7df3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:08.389218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6ddc3-56b7-4c2e-8168-9eb8e1f7df3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:08.391022 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6ddc3-56b7-4c2e-8168-9eb8e1f7df3a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-d0e6ddc3-56b7-4c2e-8168-9eb8e1f7df3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:08.410976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:08.412091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:08.413211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:08.413211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:08.413211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:08.413211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:08.413211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:08.413211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:08.413211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:08.413211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:08.415224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 351/702] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:08.416164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6ddc3-56b7-4c2e-8168-9eb8e1f7df3a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:08.456195 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:08.463102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc5f16-59c6-41fd-be77-f3000cfbf2e8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:08.501396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c507a29-f268-4e83-bca5-75e26616d924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:08.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c507a29-f268-4e83-bca5-75e26616d924 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:08.502524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c507a29-f268-4e83-bca5-75e26616d924 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:08.502892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c507a29-f268-4e83-bca5-75e26616d924 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:08.503713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c507a29-f268-4e83-bca5-75e26616d924 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:08.504171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c507a29-f268-4e83-bca5-75e26616d924 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:08.506408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c507a29-f268-4e83-bca5-75e26616d924 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:08.521189 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 352/703] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:08.522276 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c507a29-f268-4e83-bca5-75e26616d924 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:08.538951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:08.563480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6ddc3-56b7-4c2e-8168-9eb8e1f7df3a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:08.599405 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24189b5-5565-4ab0-9caa-263b828e12de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:08.600034 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24189b5-5565-4ab0-9caa-263b828e12de None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:08.600314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24189b5-5565-4ab0-9caa-263b828e12de None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:08.600577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24189b5-5565-4ab0-9caa-263b828e12de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:08.611926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24189b5-5565-4ab0-9caa-263b828e12de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:08.613399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24189b5-5565-4ab0-9caa-263b828e12de None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f24189b5-5565-4ab0-9caa-263b828e12de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:08.627950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:08.628946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:08.630224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:08.630224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:08.630224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:08.630224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 352/704] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:08.630224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24189b5-5565-4ab0-9caa-263b828e12de None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:08.644797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c507a29-f268-4e83-bca5-75e26616d924 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:08.680525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe991b-dac4-4a9b-b346-7ed4e21f5d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:08.681807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe991b-dac4-4a9b-b346-7ed4e21f5d28 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:08.682180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe991b-dac4-4a9b-b346-7ed4e21f5d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:08.682545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe991b-dac4-4a9b-b346-7ed4e21f5d28 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:08.683467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe991b-dac4-4a9b-b346-7ed4e21f5d28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:08.683687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe991b-dac4-4a9b-b346-7ed4e21f5d28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:08.685165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe991b-dac4-4a9b-b346-7ed4e21f5d28 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:08.702846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 353/705] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:08.704017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a4e0-be65-43a8-84fc-426596c75eb6 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:08.704371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a4e0-be65-43a8-84fc-426596c75eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:08.704707 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a4e0-be65-43a8-84fc-426596c75eb6 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:08.709296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 354/706] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:08.709296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a4e0-be65-43a8-84fc-426596c75eb6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:08.730398 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:08.742289 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24189b5-5565-4ab0-9caa-263b828e12de None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:08.771717 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:08.776440 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a82dcb-ae00-43d2-9806-968bff7de485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:08.777035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82dcb-ae00-43d2-9806-968bff7de485 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:08.777333 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82dcb-ae00-43d2-9806-968bff7de485 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:08.777798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82dcb-ae00-43d2-9806-968bff7de485 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:08.778298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a82dcb-ae00-43d2-9806-968bff7de485 None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=bd3284a5c047425d8148f178eee4069d) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:08.778599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a82dcb-ae00-43d2-9806-968bff7de485 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:08.780025 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a82dcb-ae00-43d2-9806-968bff7de485 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:08.785692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 353/707] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:08 2022] GET /identity/v3/role_assignments?user.id=bd3284a5c047425d8148f178eee4069d&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:08.786880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a82dcb-ae00-43d2-9806-968bff7de485 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:08.832608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a4e0-be65-43a8-84fc-426596c75eb6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:08.873347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c87dda-4646-4377-b9d8-dbdf4b4ea042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:08.874027 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c87dda-4646-4377-b9d8-dbdf4b4ea042 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:08.874307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c87dda-4646-4377-b9d8-dbdf4b4ea042 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:08.874582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c87dda-4646-4377-b9d8-dbdf4b4ea042 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:08.875240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c87dda-4646-4377-b9d8-dbdf4b4ea042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:08.875663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c87dda-4646-4377-b9d8-dbdf4b4ea042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:08.877477 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c87dda-4646-4377-b9d8-dbdf4b4ea042 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:08.896533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 355/708] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:08.896533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378427cd-0a03-4bf9-8b27-429556b73669 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:08.896533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378427cd-0a03-4bf9-8b27-429556b73669 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:08.896533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378427cd-0a03-4bf9-8b27-429556b73669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:08.915861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-378427cd-0a03-4bf9-8b27-429556b73669 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:08.917410 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-378427cd-0a03-4bf9-8b27-429556b73669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:08.949045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a82dcb-ae00-43d2-9806-968bff7de485 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:08.990807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98102613-e3c3-4333-9f10-4ffbe40feb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:08.991719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98102613-e3c3-4333-9f10-4ffbe40feb2c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:08.992138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98102613-e3c3-4333-9f10-4ffbe40feb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:08.992555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98102613-e3c3-4333-9f10-4ffbe40feb2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:08.994261 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98102613-e3c3-4333-9f10-4ffbe40feb2c None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=fcff121c9e974a6aabaa18775de65f63) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:08.994716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98102613-e3c3-4333-9f10-4ffbe40feb2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:08.996736 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98102613-e3c3-4333-9f10-4ffbe40feb2c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:09.003156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 354/709] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:08 2022] GET /identity/v3/role_assignments?user.id=fcff121c9e974a6aabaa18775de65f63&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:09.004098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98102613-e3c3-4333-9f10-4ffbe40feb2c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:09.018417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 356/710] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:12:09.079714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:09.127951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98102613-e3c3-4333-9f10-4ffbe40feb2c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:09.177234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f98ded-12c2-4b6c-a59c-e8dd9c1106fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:09.177884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f98ded-12c2-4b6c-a59c-e8dd9c1106fe None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:09.178163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f98ded-12c2-4b6c-a59c-e8dd9c1106fe None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:09.178435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f98ded-12c2-4b6c-a59c-e8dd9c1106fe None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:09.179088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f98ded-12c2-4b6c-a59c-e8dd9c1106fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:09.180541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f98ded-12c2-4b6c-a59c-e8dd9c1106fe None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:09.283493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 355/711] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:12:09 2022] POST /identity/v3/users => generated 254 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:12:09.303381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378427cd-0a03-4bf9-8b27-429556b73669 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:09.313809 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:09.433646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9e48c-360f-4b35-98ab-947bb5a02ff4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:09.433829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9e48c-360f-4b35-98ab-947bb5a02ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:09.434103 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9e48c-360f-4b35-98ab-947bb5a02ff4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:09.435686 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 356/712] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:12:09.440627 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f712d4-9f65-41c1-bf4c-c2d099ef69df None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:09.440851 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f712d4-9f65-41c1-bf4c-c2d099ef69df None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:09.441132 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f712d4-9f65-41c1-bf4c-c2d099ef69df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:09.444759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378427cd-0a03-4bf9-8b27-429556b73669 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:09.473855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e2f712d4-9f65-41c1-bf4c-c2d099ef69df None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:09.475085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e2f712d4-9f65-41c1-bf4c-c2d099ef69df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:09.521929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97000f-bfc7-4e34-8b4e-170d2819615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:09.522586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97000f-bfc7-4e34-8b4e-170d2819615a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:09.522861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97000f-bfc7-4e34-8b4e-170d2819615a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:09.523130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97000f-bfc7-4e34-8b4e-170d2819615a None admin] PATH_INFO: `/v3/services/network` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:09.523728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97000f-bfc7-4e34-8b4e-170d2819615a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:09.525728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97000f-bfc7-4e34-8b4e-170d2819615a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5d97000f-bfc7-4e34-8b4e-170d2819615a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:09.542946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:09.544322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 03:12:09.545497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:09.546420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 357/713] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:09 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:09.551633 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97000f-bfc7-4e34-8b4e-170d2819615a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:09.624636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 357/714] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:12:09.644661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:09.679183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97000f-bfc7-4e34-8b4e-170d2819615a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:09.716670 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a338fa-52f5-4dc2-b6f3-6cc8c598f5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:09.717476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a338fa-52f5-4dc2-b6f3-6cc8c598f5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:09.717857 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a338fa-52f5-4dc2-b6f3-6cc8c598f5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:09.718246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a338fa-52f5-4dc2-b6f3-6cc8c598f5b7 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:09.719035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a338fa-52f5-4dc2-b6f3-6cc8c598f5b7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:09.719435 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a338fa-52f5-4dc2-b6f3-6cc8c598f5b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:09.720955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a338fa-52f5-4dc2-b6f3-6cc8c598f5b7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:09.730480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 358/715] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 03:12:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:09.731905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f712d4-9f65-41c1-bf4c-c2d099ef69df None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:09.781908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:09.839136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f712d4-9f65-41c1-bf4c-c2d099ef69df None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:09.876990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7274970-87dd-44d0-96ca-c69b911896b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:09.877803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7274970-87dd-44d0-96ca-c69b911896b3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:09.878182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7274970-87dd-44d0-96ca-c69b911896b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:09.878553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7274970-87dd-44d0-96ca-c69b911896b3 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:09.879286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7274970-87dd-44d0-96ca-c69b911896b3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:09.879689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7274970-87dd-44d0-96ca-c69b911896b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:09.881148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7274970-87dd-44d0-96ca-c69b911896b3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:09.889108 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 358/716] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 03:12:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:09.908630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a338fa-52f5-4dc2-b6f3-6cc8c598f5b7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:10.042030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a338fa-52f5-4dc2-b6f3-6cc8c598f5b7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:10.086312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e8c52-84e2-4770-b737-5219cb9992ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:10.086947 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e8c52-84e2-4770-b737-5219cb9992ec None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:10.087759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e8c52-84e2-4770-b737-5219cb9992ec None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:10.088034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e8c52-84e2-4770-b737-5219cb9992ec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:10.088620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e8c52-84e2-4770-b737-5219cb9992ec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:10.090014 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e8c52-84e2-4770-b737-5219cb9992ec None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:10.095050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-621e8c52-84e2-4770-b737-5219cb9992ec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:10.103466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:10.104505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 03:12:10.105413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:10.118000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 359/717] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Sep 13 03:12:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:10.118077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7274970-87dd-44d0-96ca-c69b911896b3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:10.235668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7274970-87dd-44d0-96ca-c69b911896b3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:10.246545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:10.271061 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f7c56-825d-413c-9c1c-70030104d356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:10.271905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f7c56-825d-413c-9c1c-70030104d356 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:10.272330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f7c56-825d-413c-9c1c-70030104d356 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:10.272748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f7c56-825d-413c-9c1c-70030104d356 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:10.273549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f7c56-825d-413c-9c1c-70030104d356 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:10.274016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f7c56-825d-413c-9c1c-70030104d356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:10.276057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f7c56-825d-413c-9c1c-70030104d356 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:10.280728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 359/718] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 13 03:12:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:10.287682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e8c52-84e2-4770-b737-5219cb9992ec None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:10.431723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e8c52-84e2-4770-b737-5219cb9992ec None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:10.478937 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe38987-56d5-486d-99c8-86abd48b8297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:10.479554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe38987-56d5-486d-99c8-86abd48b8297 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:10.479835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe38987-56d5-486d-99c8-86abd48b8297 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:10.480112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe38987-56d5-486d-99c8-86abd48b8297 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:10.480749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe38987-56d5-486d-99c8-86abd48b8297 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:10.481055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe38987-56d5-486d-99c8-86abd48b8297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:10.482530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe38987-56d5-486d-99c8-86abd48b8297 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:10.488226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 360/719] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 13 03:12:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:11.588312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e412-7ddf-4f93-aed6-440ae195afcd None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:11.588865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e412-7ddf-4f93-aed6-440ae195afcd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:11.588865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6e412-7ddf-4f93-aed6-440ae195afcd None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:11.590454 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 360/720] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:11.595849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12060dd-6008-4125-aa86-4be318e1ef0a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:11.596646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12060dd-6008-4125-aa86-4be318e1ef0a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:11.597123 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12060dd-6008-4125-aa86-4be318e1ef0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:11.626268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a12060dd-6008-4125-aa86-4be318e1ef0a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:11.627840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a12060dd-6008-4125-aa86-4be318e1ef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:11.707752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:11.723047 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 361/721] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:12:11.777837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc30160-3932-46a7-9efa-ec07bd34be1e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:11.778138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc30160-3932-46a7-9efa-ec07bd34be1e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:11.778390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc30160-3932-46a7-9efa-ec07bd34be1e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:11.779719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 361/722] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:11.785174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55650001-1413-4b07-aa32-abe883302c46 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:11.785495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55650001-1413-4b07-aa32-abe883302c46 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:11.785778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55650001-1413-4b07-aa32-abe883302c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:11.806960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-55650001-1413-4b07-aa32-abe883302c46 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:11.808139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-55650001-1413-4b07-aa32-abe883302c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:11.890391 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 362/723] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:12:12.074642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc30160-3932-46a7-9efa-ec07bd34be1e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:12.190995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc30160-3932-46a7-9efa-ec07bd34be1e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:12.236128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991a78a-9b1c-495c-bcc8-14370ca25f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:12.236759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991a78a-9b1c-495c-bcc8-14370ca25f81 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:12.237038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991a78a-9b1c-495c-bcc8-14370ca25f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:12.237337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991a78a-9b1c-495c-bcc8-14370ca25f81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:12.254239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991a78a-9b1c-495c-bcc8-14370ca25f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-1991a78a-9b1c-495c-bcc8-14370ca25f81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:12.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:12.260741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:12.262197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:12.262197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:12.262197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:12.262197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:12.262197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:12.262197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:12.262197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:12.262197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:12.262197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:12.262197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:12.262197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:12.262197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:12.262197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 362/724] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:12:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:12.270347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55650001-1413-4b07-aa32-abe883302c46 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:12.276501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991a78a-9b1c-495c-bcc8-14370ca25f81 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:12.320535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:12.402270 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991a78a-9b1c-495c-bcc8-14370ca25f81 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:12.440984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a239e1-e5e8-4c7f-a555-0083eaea2712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:12.442022 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a239e1-e5e8-4c7f-a555-0083eaea2712 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:12.442477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a239e1-e5e8-4c7f-a555-0083eaea2712 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:12.442897 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a239e1-e5e8-4c7f-a555-0083eaea2712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:12.455131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a239e1-e5e8-4c7f-a555-0083eaea2712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-d9a239e1-e5e8-4c7f-a555-0083eaea2712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:12.461149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:12.463111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:12.464126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:12.464126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:12.464126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:12.464126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:12.464126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:12.464126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:12.464126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:12.464126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:12.464126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:12.464126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:12.464126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:12.464126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:12.467587 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 363/725] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:12:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:12.474295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a239e1-e5e8-4c7f-a555-0083eaea2712 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:12.540480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55650001-1413-4b07-aa32-abe883302c46 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:12.569307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:12.585295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:12.586895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a49c8b-eca6-4e87-b4fc-65b35b7d47b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:12.588547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49c8b-eca6-4e87-b4fc-65b35b7d47b5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:12.589009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49c8b-eca6-4e87-b4fc-65b35b7d47b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:12.589484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49c8b-eca6-4e87-b4fc-65b35b7d47b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:12.590786 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a49c8b-eca6-4e87-b4fc-65b35b7d47b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:12.591375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a49c8b-eca6-4e87-b4fc-65b35b7d47b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:12.593062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a49c8b-eca6-4e87-b4fc-65b35b7d47b5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:12.593651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a239e1-e5e8-4c7f-a555-0083eaea2712 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:12.602486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 363/726] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:12:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:12.604320 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc24a13-7376-4e18-b4f4-e7650730e3cb None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:12.604612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc24a13-7376-4e18-b4f4-e7650730e3cb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:12.604887 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc24a13-7376-4e18-b4f4-e7650730e3cb None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:12.606476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 364/727] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:12.607777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacdc9b-c045-428c-a42c-67a199419a98 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:12.608264 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacdc9b-c045-428c-a42c-67a199419a98 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:12.608753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacdc9b-c045-428c-a42c-67a199419a98 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:12.610284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 365/728] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:12.611287 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacdc9b-c045-428c-a42c-67a199419a98 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:12.645697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae9b7d-46bb-4080-99c8-a6ca15cab42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:12.646318 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae9b7d-46bb-4080-99c8-a6ca15cab42a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:12.646689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae9b7d-46bb-4080-99c8-a6ca15cab42a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:12.647115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae9b7d-46bb-4080-99c8-a6ca15cab42a None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:12.647778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae9b7d-46bb-4080-99c8-a6ca15cab42a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:12.648126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae9b7d-46bb-4080-99c8-a6ca15cab42a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:12.650186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae9b7d-46bb-4080-99c8-a6ca15cab42a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:12.658547 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 364/729] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:12:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:12.659954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49d61-ee69-4f52-8d21-0dbff19c054b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:12.660236 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49d61-ee69-4f52-8d21-0dbff19c054b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:12.660506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49d61-ee69-4f52-8d21-0dbff19c054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:12.678958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-88c49d61-ee69-4f52-8d21-0dbff19c054b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:12.680127 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-88c49d61-ee69-4f52-8d21-0dbff19c054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:12.724550 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacdc9b-c045-428c-a42c-67a199419a98 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:12.753973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 365/730] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:12:12.755438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed8c62-1654-4214-9c65-45d9f7321221 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:12.755729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed8c62-1654-4214-9c65-45d9f7321221 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:12.756001 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed8c62-1654-4214-9c65-45d9f7321221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:12.772003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833aad8-bce0-4ca7-aa17-eb9ba30f7d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:12.772995 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833aad8-bce0-4ca7-aa17-eb9ba30f7d45 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:12.773526 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833aad8-bce0-4ca7-aa17-eb9ba30f7d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:12.774055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833aad8-bce0-4ca7-aa17-eb9ba30f7d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:12.775385 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c0ed8c62-1654-4214-9c65-45d9f7321221 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:12.776790 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c0ed8c62-1654-4214-9c65-45d9f7321221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:12.789441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833aad8-bce0-4ca7-aa17-eb9ba30f7d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:12.791500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833aad8-bce0-4ca7-aa17-eb9ba30f7d45 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-0833aad8-bce0-4ca7-aa17-eb9ba30f7d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:12.812023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:12.813244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:12.814421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:12.814421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:12.814421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:12.817241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 366/731] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:12.818334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833aad8-bce0-4ca7-aa17-eb9ba30f7d45 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:12.851798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 366/732] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:12:12.852890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed8c62-1654-4214-9c65-45d9f7321221 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:12.866479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:12.871612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:12.957898 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833aad8-bce0-4ca7-aa17-eb9ba30f7d45 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:12.964029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed8c62-1654-4214-9c65-45d9f7321221 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:12.994116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97543c-6f14-4088-8dd4-a9979a2a5e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:12.994824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97543c-6f14-4088-8dd4-a9979a2a5e0c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:12.995205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97543c-6f14-4088-8dd4-a9979a2a5e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:12.995650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97543c-6f14-4088-8dd4-a9979a2a5e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:13.006846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97543c-6f14-4088-8dd4-a9979a2a5e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:13.008432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97543c-6f14-4088-8dd4-a9979a2a5e0c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:13.011659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf190f3-1941-4a5a-aa50-bbe06a1ebda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:13.012845 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf190f3-1941-4a5a-aa50-bbe06a1ebda2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:13.021511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf190f3-1941-4a5a-aa50-bbe06a1ebda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:13.021511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf190f3-1941-4a5a-aa50-bbe06a1ebda2 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:13.021511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf190f3-1941-4a5a-aa50-bbe06a1ebda2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:13.021511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf190f3-1941-4a5a-aa50-bbe06a1ebda2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:13.021511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf190f3-1941-4a5a-aa50-bbe06a1ebda2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-0f97543c-6f14-4088-8dd4-a9979a2a5e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:13.034999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:13.035988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:13.036922 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:13.036922 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:13.036922 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:13.038780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 367/733] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:13.044330 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97543c-6f14-4088-8dd4-a9979a2a5e0c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:13.049969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 367/734] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:13.054802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf190f3-1941-4a5a-aa50-bbe06a1ebda2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:13.186364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:13.188156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:13.201091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97543c-6f14-4088-8dd4-a9979a2a5e0c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:13.211311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf190f3-1941-4a5a-aa50-bbe06a1ebda2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:13.234718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40c84c-6c76-4b4c-9cc0-56becf828de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:13.235317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40c84c-6c76-4b4c-9cc0-56becf828de4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:13.235996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40c84c-6c76-4b4c-9cc0-56becf828de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:13.235996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40c84c-6c76-4b4c-9cc0-56becf828de4 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:13.236530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40c84c-6c76-4b4c-9cc0-56becf828de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:13.236829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40c84c-6c76-4b4c-9cc0-56becf828de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:13.238225 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40c84c-6c76-4b4c-9cc0-56becf828de4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:13.244957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18838f1c-2600-495e-8f52-b12aae6fb97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:13.245567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18838f1c-2600-495e-8f52-b12aae6fb97b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:13.245848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18838f1c-2600-495e-8f52-b12aae6fb97b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:13.246117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18838f1c-2600-495e-8f52-b12aae6fb97b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:13.250405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 368/735] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:13.254850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40c84c-6c76-4b4c-9cc0-56becf828de4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:13.254963 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18838f1c-2600-495e-8f52-b12aae6fb97b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:13.256080 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18838f1c-2600-495e-8f52-b12aae6fb97b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-18838f1c-2600-495e-8f52-b12aae6fb97b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:13.267516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:13.268525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:13.269544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:13.269544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:13.269544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:13.269544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:13.269544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:13.269544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:13.269544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:13.269544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:13.269544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:12:13.269544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:13.269544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 368/736] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 03:12:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:13.270253 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0adbd9-8ee6-4116-948a-396b3e4a97b8 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:13.270253 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0adbd9-8ee6-4116-948a-396b3e4a97b8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:13.270391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0adbd9-8ee6-4116-948a-396b3e4a97b8 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:13.273579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 369/737] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:13.273579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0adbd9-8ee6-4116-948a-396b3e4a97b8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:13.357542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40c84c-6c76-4b4c-9cc0-56becf828de4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:13.372160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0adbd9-8ee6-4116-948a-396b3e4a97b8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:13.391189 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2128c-3f00-47cc-b06c-23856a743966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:13.391793 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2128c-3f00-47cc-b06c-23856a743966 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:13.392071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2128c-3f00-47cc-b06c-23856a743966 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:13.392341 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2128c-3f00-47cc-b06c-23856a743966 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:13.392983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2128c-3f00-47cc-b06c-23856a743966 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:13.394378 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2128c-3f00-47cc-b06c-23856a743966 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:13.404764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c643d-a5ff-443c-a8c6-976f448c6c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:13.405415 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c643d-a5ff-443c-a8c6-976f448c6c20 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:13.405689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c643d-a5ff-443c-a8c6-976f448c6c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:13.405954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c643d-a5ff-443c-a8c6-976f448c6c20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:13.408457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:13.417014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c643d-a5ff-443c-a8c6-976f448c6c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f74c643d-a5ff-443c-a8c6-976f448c6c20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:13.421743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:13.425813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 370/738] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:12:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:13.426863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c643d-a5ff-443c-a8c6-976f448c6c20 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:13.505760 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 369/739] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:12:13 2022] POST /identity/v3/services => generated 240 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:12:13.506209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2128c-3f00-47cc-b06c-23856a743966 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:13.518252 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:13.524804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c643d-a5ff-443c-a8c6-976f448c6c20 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:13.578443 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d765706-7863-489b-91e5-36a90dba49ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:13.579099 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765706-7863-489b-91e5-36a90dba49ae None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:13.579380 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765706-7863-489b-91e5-36a90dba49ae None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:13.579652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d765706-7863-489b-91e5-36a90dba49ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:13.588588 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d765706-7863-489b-91e5-36a90dba49ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:13.590208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d765706-7863-489b-91e5-36a90dba49ae None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-4d765706-7863-489b-91e5-36a90dba49ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:13.603150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:13.607681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:13.608619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:13.608619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:13.608619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:13.608619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:13.608619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:13.608619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:13.608619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:13.608619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:13.608619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 03:12:13.608619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:13.608619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 371/740] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:12:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:13.608619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea40a53-97b3-4dab-8e58-c1c0be60dadf None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:13.608619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea40a53-97b3-4dab-8e58-c1c0be60dadf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:13.609379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea40a53-97b3-4dab-8e58-c1c0be60dadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:13.625587 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fea40a53-97b3-4dab-8e58-c1c0be60dadf None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:13.626865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fea40a53-97b3-4dab-8e58-c1c0be60dadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:13.628829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2128c-3f00-47cc-b06c-23856a743966 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:13.667760 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794f4b3-2e21-44d7-91be-5b5b0574864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:13.668383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794f4b3-2e21-44d7-91be-5b5b0574864a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:13.668659 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794f4b3-2e21-44d7-91be-5b5b0574864a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:13.668928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794f4b3-2e21-44d7-91be-5b5b0574864a None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:13.669702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794f4b3-2e21-44d7-91be-5b5b0574864a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:13.670008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794f4b3-2e21-44d7-91be-5b5b0574864a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:13.671451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794f4b3-2e21-44d7-91be-5b5b0574864a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:13.683225 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:13.691275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 370/741] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 03:12:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:13.692102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794f4b3-2e21-44d7-91be-5b5b0574864a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:13.710239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 372/742] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:13 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 03:12:13.716505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea40a53-97b3-4dab-8e58-c1c0be60dadf None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:13.767202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:13.816229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794f4b3-2e21-44d7-91be-5b5b0574864a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:13.830222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea40a53-97b3-4dab-8e58-c1c0be60dadf None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:13.859988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1086aaa-f752-4bf2-aeb6-2fc52f019893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:13.860604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086aaa-f752-4bf2-aeb6-2fc52f019893 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:13.860880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086aaa-f752-4bf2-aeb6-2fc52f019893 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:13.861150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086aaa-f752-4bf2-aeb6-2fc52f019893 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:13.861855 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1086aaa-f752-4bf2-aeb6-2fc52f019893 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:13.862156 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1086aaa-f752-4bf2-aeb6-2fc52f019893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:13.863654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1086aaa-f752-4bf2-aeb6-2fc52f019893 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:13.868882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b02f0-caf6-4031-ae5e-8a3b0f743c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:13.869942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b02f0-caf6-4031-ae5e-8a3b0f743c88 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:13.870233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b02f0-caf6-4031-ae5e-8a3b0f743c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:13.870500 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b02f0-caf6-4031-ae5e-8a3b0f743c88 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:13.871505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b02f0-caf6-4031-ae5e-8a3b0f743c88 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:13.871808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b02f0-caf6-4031-ae5e-8a3b0f743c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:13.873134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 371/743] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:12:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:13.873249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b02f0-caf6-4031-ae5e-8a3b0f743c88 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:13.874079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1086aaa-f752-4bf2-aeb6-2fc52f019893 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:13.897400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 373/744] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 13 03:12:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:13.906004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b02f0-caf6-4031-ae5e-8a3b0f743c88 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:13.953770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:13.986484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1086aaa-f752-4bf2-aeb6-2fc52f019893 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:14.021438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b02f0-caf6-4031-ae5e-8a3b0f743c88 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:14.026712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:14.035401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531732d7-2846-4d54-a955-d9d551f1915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:14.036031 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531732d7-2846-4d54-a955-d9d551f1915d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:14.036414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531732d7-2846-4d54-a955-d9d551f1915d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:14.036584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531732d7-2846-4d54-a955-d9d551f1915d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:14.047132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531732d7-2846-4d54-a955-d9d551f1915d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:14.048585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531732d7-2846-4d54-a955-d9d551f1915d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:14.060395 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3dcf41-51df-42ce-909e-0afa2831bcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:14.061275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dcf41-51df-42ce-909e-0afa2831bcd9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:14.061754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dcf41-51df-42ce-909e-0afa2831bcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:14.062302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dcf41-51df-42ce-909e-0afa2831bcd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-531732d7-2846-4d54-a955-d9d551f1915d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:14.063184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:14.064290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:14.065357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:14.065357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:14.065357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:14.069680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 372/745] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:14.070463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531732d7-2846-4d54-a955-d9d551f1915d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:14.078869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3dcf41-51df-42ce-909e-0afa2831bcd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:14.080501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3dcf41-51df-42ce-909e-0afa2831bcd9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-dc3dcf41-51df-42ce-909e-0afa2831bcd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:14.096895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:14.098149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:14.099231 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:14.099231 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:14.099231 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:14.102693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 374/746] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:14.103502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3dcf41-51df-42ce-909e-0afa2831bcd9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:14.177277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531732d7-2846-4d54-a955-d9d551f1915d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:14.205912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:14.211428 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c3325-9b62-4d80-b0b8-1040d1f4636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:14.212589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c3325-9b62-4d80-b0b8-1040d1f4636c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:14.212865 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c3325-9b62-4d80-b0b8-1040d1f4636c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:14.213133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c3325-9b62-4d80-b0b8-1040d1f4636c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:14.215895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3dcf41-51df-42ce-909e-0afa2831bcd9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:14.250272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f5dcc-9951-470d-801c-1c80843919da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:14.251169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f5dcc-9951-470d-801c-1c80843919da None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:14.251691 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f5dcc-9951-470d-801c-1c80843919da None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:14.252110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f5dcc-9951-470d-801c-1c80843919da None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:14.252925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f5dcc-9951-470d-801c-1c80843919da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:14.254539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f5dcc-9951-470d-801c-1c80843919da None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:14.262468 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:14.281783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c3325-9b62-4d80-b0b8-1040d1f4636c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:14.283164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c3325-9b62-4d80-b0b8-1040d1f4636c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:14.330342 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 375/747] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:12:14 2022] POST /identity/v3/services => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:12:14.331292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f5dcc-9951-470d-801c-1c80843919da None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:14.398634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 373/748] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:14 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 03:12:14.399917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c3325-9b62-4d80-b0b8-1040d1f4636c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:14.466303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f5dcc-9951-470d-801c-1c80843919da None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:14.498321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:14.505859 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8fa07-134b-4a02-8a48-6ac54aba1649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:14.510985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8fa07-134b-4a02-8a48-6ac54aba1649 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:14.510985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8fa07-134b-4a02-8a48-6ac54aba1649 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:14.510985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8fa07-134b-4a02-8a48-6ac54aba1649 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:14.510985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8fa07-134b-4a02-8a48-6ac54aba1649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:14.510985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8fa07-134b-4a02-8a48-6ac54aba1649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:14.510985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8fa07-134b-4a02-8a48-6ac54aba1649 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:14.521389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c3325-9b62-4d80-b0b8-1040d1f4636c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:14.524226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 376/749] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:14.524539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8fa07-134b-4a02-8a48-6ac54aba1649 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:14.541215 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:14.567469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558add0b-c4f5-4168-9e64-80cf247b4a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:14.568687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558add0b-c4f5-4168-9e64-80cf247b4a30 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:14.568687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558add0b-c4f5-4168-9e64-80cf247b4a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:14.568687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558add0b-c4f5-4168-9e64-80cf247b4a30 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:14.569240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558add0b-c4f5-4168-9e64-80cf247b4a30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:14.569586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558add0b-c4f5-4168-9e64-80cf247b4a30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:14.570951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558add0b-c4f5-4168-9e64-80cf247b4a30 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:14.588498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 374/750] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:14.588498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558add0b-c4f5-4168-9e64-80cf247b4a30 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:14.660945 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8fa07-134b-4a02-8a48-6ac54aba1649 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:14.698402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26ce9a-8848-442c-9771-f0fa15589e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:14.699138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26ce9a-8848-442c-9771-f0fa15589e75 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:14.699478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26ce9a-8848-442c-9771-f0fa15589e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:14.699813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26ce9a-8848-442c-9771-f0fa15589e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:14.700240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558add0b-c4f5-4168-9e64-80cf247b4a30 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:14.711133 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26ce9a-8848-442c-9771-f0fa15589e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:14.712825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26ce9a-8848-442c-9771-f0fa15589e75 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-0e26ce9a-8848-442c-9771-f0fa15589e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:14.729520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:14.730512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:14.731397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:14.731397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:14.731397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:14.731397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 377/751] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:14.732270 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26ce9a-8848-442c-9771-f0fa15589e75 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:14.740797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216846ef-fd89-47fc-8305-7a84572512e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:14.741738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216846ef-fd89-47fc-8305-7a84572512e9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:14.742210 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216846ef-fd89-47fc-8305-7a84572512e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:14.742780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216846ef-fd89-47fc-8305-7a84572512e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:14.750972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216846ef-fd89-47fc-8305-7a84572512e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:14.752627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216846ef-fd89-47fc-8305-7a84572512e9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:14.755717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-216846ef-fd89-47fc-8305-7a84572512e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:14.767257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:14.768885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:14.769893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:14.769893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:14.769893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:14.769893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:14.769893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:14.769893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:14.769893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:14.769893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:14.776326 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 375/752] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:14.777562 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216846ef-fd89-47fc-8305-7a84572512e9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:14.821728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:14.854395 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26ce9a-8848-442c-9771-f0fa15589e75 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:14.893628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216846ef-fd89-47fc-8305-7a84572512e9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:14.899510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977c938-318b-4b43-b905-7e41457ba6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:14.900339 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977c938-318b-4b43-b905-7e41457ba6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:14.901658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977c938-318b-4b43-b905-7e41457ba6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:14.902038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977c938-318b-4b43-b905-7e41457ba6a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:14.912866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977c938-318b-4b43-b905-7e41457ba6a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:14.914665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977c938-318b-4b43-b905-7e41457ba6a8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-1977c938-318b-4b43-b905-7e41457ba6a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:14.930331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:14.931896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:14.932840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:14.932840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:14.932840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:14.932840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:14.932840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:14.932840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:14.932840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:14.932840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:14.932840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 03:12:14.932840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:14.936325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba020ff1-b08c-408b-ad93-f35bfd824bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:14.936978 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 378/753] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 03:12:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:14.937627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba020ff1-b08c-408b-ad93-f35bfd824bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:14.937926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977c938-318b-4b43-b905-7e41457ba6a8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:14.945365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba020ff1-b08c-408b-ad93-f35bfd824bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:14.945365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba020ff1-b08c-408b-ad93-f35bfd824bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:14.945365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba020ff1-b08c-408b-ad93-f35bfd824bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:14.945365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba020ff1-b08c-408b-ad93-f35bfd824bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:14.945365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba020ff1-b08c-408b-ad93-f35bfd824bd4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:14.957460 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 376/754] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:14.957460 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba020ff1-b08c-408b-ad93-f35bfd824bd4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:15.016331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:15.073948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba020ff1-b08c-408b-ad93-f35bfd824bd4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:15.086268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977c938-318b-4b43-b905-7e41457ba6a8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:15.109823 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:15.122552 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2ce47-b1a8-46ce-beff-6f07e836828f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:15.123536 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2ce47-b1a8-46ce-beff-6f07e836828f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:15.124040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2ce47-b1a8-46ce-beff-6f07e836828f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:15.124517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2ce47-b1a8-46ce-beff-6f07e836828f None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:15.125476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2ce47-b1a8-46ce-beff-6f07e836828f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:15.125805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faddc3-1d44-4f51-a566-cfe80abd7e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:15.126326 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2ce47-b1a8-46ce-beff-6f07e836828f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:15.126432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faddc3-1d44-4f51-a566-cfe80abd7e04 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:15.126666 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faddc3-1d44-4f51-a566-cfe80abd7e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:15.126935 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faddc3-1d44-4f51-a566-cfe80abd7e04 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:15.127617 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faddc3-1d44-4f51-a566-cfe80abd7e04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:15.127917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faddc3-1d44-4f51-a566-cfe80abd7e04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:15.128853 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2ce47-b1a8-46ce-beff-6f07e836828f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:15.129373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faddc3-1d44-4f51-a566-cfe80abd7e04 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:15.157075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 379/755] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:15.157075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faddc3-1d44-4f51-a566-cfe80abd7e04 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:15.169792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 377/756] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 13 03:12:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:15.169792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2ce47-b1a8-46ce-beff-6f07e836828f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:15.269820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faddc3-1d44-4f51-a566-cfe80abd7e04 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:15.307598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ad2b2-ecf5-4929-8d1a-823750d6ba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:15.308105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ad2b2-ecf5-4929-8d1a-823750d6ba38 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:15.308381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ad2b2-ecf5-4929-8d1a-823750d6ba38 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:15.308651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ad2b2-ecf5-4929-8d1a-823750d6ba38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:15.311935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2ce47-b1a8-46ce-beff-6f07e836828f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:15.316232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ad2b2-ecf5-4929-8d1a-823750d6ba38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:15.317772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ad2b2-ecf5-4929-8d1a-823750d6ba38 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5c3ad2b2-ecf5-4929-8d1a-823750d6ba38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:15.329590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:15.330504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:15.331411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:15.331411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:15.331411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:15.331411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:15.331411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:15.331411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:15.331411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:15.331411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:15.335174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:15.335292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 380/757] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:15.336503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ad2b2-ecf5-4929-8d1a-823750d6ba38 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:15.355069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26beb702-36e5-42fd-88e2-3def600d1b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:15.355761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26beb702-36e5-42fd-88e2-3def600d1b9c None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:15.356035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26beb702-36e5-42fd-88e2-3def600d1b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:15.356365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26beb702-36e5-42fd-88e2-3def600d1b9c None admin] PATH_INFO: `/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/fcff121c9e974a6aabaa18775de65f63/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:15.358518 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26beb702-36e5-42fd-88e2-3def600d1b9c None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad922f6e2414214abe3ba1de67fc8de, user_id=fcff121c9e974a6aabaa18775de65f63, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:15.360010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26beb702-36e5-42fd-88e2-3def600d1b9c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:15.386997 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:15.433455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 378/758] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:12:15 2022] PUT /identity/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/fcff121c9e974a6aabaa18775de65f63/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:12:15.434754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26beb702-36e5-42fd-88e2-3def600d1b9c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:15.476516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ad2b2-ecf5-4929-8d1a-823750d6ba38 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:15.553629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d60cea-5d95-463a-a08d-c7fd27119795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:15.554498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d60cea-5d95-463a-a08d-c7fd27119795 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:15.555097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d60cea-5d95-463a-a08d-c7fd27119795 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:15.556741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d60cea-5d95-463a-a08d-c7fd27119795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:15.653607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26beb702-36e5-42fd-88e2-3def600d1b9c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:15.698488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f7373-9925-4a0b-a91f-b2520ef46d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:15.699259 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d60cea-5d95-463a-a08d-c7fd27119795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:15.700021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f7373-9925-4a0b-a91f-b2520ef46d8c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:15.700501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f7373-9925-4a0b-a91f-b2520ef46d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:15.700997 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d60cea-5d95-463a-a08d-c7fd27119795 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:15.701533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f7373-9925-4a0b-a91f-b2520ef46d8c None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:15.702439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f7373-9925-4a0b-a91f-b2520ef46d8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:15.703070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f7373-9925-4a0b-a91f-b2520ef46d8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:15.707179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f7373-9925-4a0b-a91f-b2520ef46d8c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:15.722925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 379/759] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:15.731223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f7373-9925-4a0b-a91f-b2520ef46d8c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:15.759241 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:15.798307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:15.836700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 381/760] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:12:15.843950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f437e-aa24-49a0-9763-12bf8aa9aaf6 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:15.844240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f437e-aa24-49a0-9763-12bf8aa9aaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:15.844521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f437e-aa24-49a0-9763-12bf8aa9aaf6 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:15.846023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 382/761] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:15.849306 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f437e-aa24-49a0-9763-12bf8aa9aaf6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:15.894219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f7373-9925-4a0b-a91f-b2520ef46d8c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:15.943525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62023ce9-9407-43b0-9b4e-27005f68b944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:15.944380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62023ce9-9407-43b0-9b4e-27005f68b944 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:15.944752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62023ce9-9407-43b0-9b4e-27005f68b944 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:15.945119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62023ce9-9407-43b0-9b4e-27005f68b944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:15.946760 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62023ce9-9407-43b0-9b4e-27005f68b944 None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=bd3284a5c047425d8148f178eee4069d) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:15.947167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62023ce9-9407-43b0-9b4e-27005f68b944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:15.949524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62023ce9-9407-43b0-9b4e-27005f68b944 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:15.961696 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 380/762] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:15 2022] GET /identity/v3/role_assignments?user.id=bd3284a5c047425d8148f178eee4069d&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:15.963255 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d730-efc5-4979-953a-ae01f3e8d6a8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:15.963637 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d730-efc5-4979-953a-ae01f3e8d6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:15.964010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d730-efc5-4979-953a-ae01f3e8d6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:15.973649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f437e-aa24-49a0-9763-12bf8aa9aaf6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:16.010613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8ed8d730-efc5-4979-953a-ae01f3e8d6a8 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:16.011985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8ed8d730-efc5-4979-953a-ae01f3e8d6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:16.046074 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb48e0e-c609-4419-9840-dfec5a57d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:16.047024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb48e0e-c609-4419-9840-dfec5a57d24e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:16.047523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb48e0e-c609-4419-9840-dfec5a57d24e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:16.047943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb48e0e-c609-4419-9840-dfec5a57d24e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:16.076833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:16.082496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb48e0e-c609-4419-9840-dfec5a57d24e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:16.084025 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb48e0e-c609-4419-9840-dfec5a57d24e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ecb48e0e-c609-4419-9840-dfec5a57d24e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:16.113043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:16.114256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:16.115390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:16.115390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:16.115390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:16.115584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 383/763] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:16.122922 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb48e0e-c609-4419-9840-dfec5a57d24e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:16.166975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 381/764] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:16.260908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb48e0e-c609-4419-9840-dfec5a57d24e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:16.303535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f47312-3d7c-49ee-bbb2-b85c16381e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:16.304142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47312-3d7c-49ee-bbb2-b85c16381e4d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:16.304416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47312-3d7c-49ee-bbb2-b85c16381e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:16.304679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f47312-3d7c-49ee-bbb2-b85c16381e4d None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:16.305341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f47312-3d7c-49ee-bbb2-b85c16381e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:16.305682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f47312-3d7c-49ee-bbb2-b85c16381e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:16.307044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f47312-3d7c-49ee-bbb2-b85c16381e4d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:16.323843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 384/765] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:16.329224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d730-efc5-4979-953a-ae01f3e8d6a8 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:16.366939 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:16.453028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f47312-3d7c-49ee-bbb2-b85c16381e4d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:16.475589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d730-efc5-4979-953a-ae01f3e8d6a8 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:16.527208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:16.538724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab75b-cfc5-4f44-9101-cff1a1425e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:16.543462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab75b-cfc5-4f44-9101-cff1a1425e30 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:16.543462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab75b-cfc5-4f44-9101-cff1a1425e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:16.543462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ab75b-cfc5-4f44-9101-cff1a1425e30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:16.554561 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ab75b-cfc5-4f44-9101-cff1a1425e30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:16.556744 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ab75b-cfc5-4f44-9101-cff1a1425e30 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6f7ab75b-cfc5-4f44-9101-cff1a1425e30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:16.579791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:16.580759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:16.581710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:16.581710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:16.581710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:16.581710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:16.581710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:16.581710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:16.581710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:16.581710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:16.582221 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f47312-3d7c-49ee-bbb2-b85c16381e4d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:16.589890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 382/766] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:16.595348 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab75b-cfc5-4f44-9101-cff1a1425e30 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:16.623335 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c5f38-c324-481d-b933-4d203673f279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:16.624180 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c5f38-c324-481d-b933-4d203673f279 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:16.624459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c5f38-c324-481d-b933-4d203673f279 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:16.625108 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c5f38-c324-481d-b933-4d203673f279 None admin] PATH_INFO: `/v3/services/network` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:16.625722 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c5f38-c324-481d-b933-4d203673f279 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:16.627076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c5f38-c324-481d-b933-4d203673f279 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3b3c5f38-c324-481d-b933-4d203673f279 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:16.639807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:16.641843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:16.642887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 385/767] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:16 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:16.649467 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c5f38-c324-481d-b933-4d203673f279 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:16.759758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:16.768773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ab75b-cfc5-4f44-9101-cff1a1425e30 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:16.773895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c5f38-c324-481d-b933-4d203673f279 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:16.791916 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:16.802726 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa907bc-f673-4308-9b29-b3713738ca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:16.803423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa907bc-f673-4308-9b29-b3713738ca48 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:16.803781 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa907bc-f673-4308-9b29-b3713738ca48 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:16.804135 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa907bc-f673-4308-9b29-b3713738ca48 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:16.804908 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa907bc-f673-4308-9b29-b3713738ca48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:16.805319 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa907bc-f673-4308-9b29-b3713738ca48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:16.807411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa907bc-f673-4308-9b29-b3713738ca48 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:16.811834 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95bccf-86bb-4f39-81de-c64939963630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:16.812491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95bccf-86bb-4f39-81de-c64939963630 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:16.813361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95bccf-86bb-4f39-81de-c64939963630 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:16.813361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95bccf-86bb-4f39-81de-c64939963630 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:16.813658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95bccf-86bb-4f39-81de-c64939963630 None admin] RBAC: Adding query filter params (name=network) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:16.813995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95bccf-86bb-4f39-81de-c64939963630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:16.815355 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95bccf-86bb-4f39-81de-c64939963630 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:16.820253 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 386/768] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 03:12:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:16.822144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100dcaf-47f5-48b8-bf91-1d0c61040e36 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:16.822413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 383/769] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:16.822546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100dcaf-47f5-48b8-bf91-1d0c61040e36 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:16.822687 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100dcaf-47f5-48b8-bf91-1d0c61040e36 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:16.824071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 387/770] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:16.827890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa907bc-f673-4308-9b29-b3713738ca48 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:16.828913 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100dcaf-47f5-48b8-bf91-1d0c61040e36 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:16.931582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa907bc-f673-4308-9b29-b3713738ca48 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:16.949651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100dcaf-47f5-48b8-bf91-1d0c61040e36 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:16.968393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a92ab4-4f66-4c64-9bf2-4fbc9471a872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:16.969413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a92ab4-4f66-4c64-9bf2-4fbc9471a872 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:16.969900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a92ab4-4f66-4c64-9bf2-4fbc9471a872 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:16.970405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a92ab4-4f66-4c64-9bf2-4fbc9471a872 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:16.971389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a92ab4-4f66-4c64-9bf2-4fbc9471a872 None admin] RBAC: Adding query filter params (type=network) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:16.971894 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a92ab4-4f66-4c64-9bf2-4fbc9471a872 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:16.973538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a92ab4-4f66-4c64-9bf2-4fbc9471a872 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:16.979756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 384/771] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 03:12:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:16.981449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a5608-e5f3-4299-a4ff-67d1691fbb0a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:16.981940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a5608-e5f3-4299-a4ff-67d1691fbb0a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:16.982467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a5608-e5f3-4299-a4ff-67d1691fbb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:16.987404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b1490-16fe-40b0-bbf3-57695b3744dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:16.988003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b1490-16fe-40b0-bbf3-57695b3744dd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:16.988302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b1490-16fe-40b0-bbf3-57695b3744dd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:16.988543 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b1490-16fe-40b0-bbf3-57695b3744dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:16.989296 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b1490-16fe-40b0-bbf3-57695b3744dd None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=18e869f4ca35451583107ca7607e1861) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:16.989598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b1490-16fe-40b0-bbf3-57695b3744dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:16.994033 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b1490-16fe-40b0-bbf3-57695b3744dd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:17.000763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 388/772] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:16 2022] GET /identity/v3/role_assignments?user.id=18e869f4ca35451583107ca7607e1861&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:17.001644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b1490-16fe-40b0-bbf3-57695b3744dd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:17.004061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2f6a5608-e5f3-4299-a4ff-67d1691fbb0a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:17.005593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2f6a5608-e5f3-4299-a4ff-67d1691fbb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:17.029694 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:17.058222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:17.119462 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b1490-16fe-40b0-bbf3-57695b3744dd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:17.120320 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 385/773] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:17.181015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9a010-b39a-4a16-8432-f1df01682664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:17.181990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9a010-b39a-4a16-8432-f1df01682664 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:17.182464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9a010-b39a-4a16-8432-f1df01682664 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:17.182906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9a010-b39a-4a16-8432-f1df01682664 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:17.183780 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9a010-b39a-4a16-8432-f1df01682664 None admin] RBAC: Adding query filter params (interface=public, service_id=90952c2f2a304bf0894a1011f4cb9e49, region_id=RegionOne) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:17.184260 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9a010-b39a-4a16-8432-f1df01682664 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:17.185842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9a010-b39a-4a16-8432-f1df01682664 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:17.194586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 389/774] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 03:12:17 2022] GET /identity/v3/endpoints?service_id=90952c2f2a304bf0894a1011f4cb9e49&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:17.201302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a5608-e5f3-4299-a4ff-67d1691fbb0a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:17.357319 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a5608-e5f3-4299-a4ff-67d1691fbb0a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:17.396784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168012a-e77b-4d4e-9ebf-32cf0e70cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:17.397415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168012a-e77b-4d4e-9ebf-32cf0e70cf1e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:17.397687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168012a-e77b-4d4e-9ebf-32cf0e70cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:17.397952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168012a-e77b-4d4e-9ebf-32cf0e70cf1e None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:17.398557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168012a-e77b-4d4e-9ebf-32cf0e70cf1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:17.400444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168012a-e77b-4d4e-9ebf-32cf0e70cf1e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:17.409732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 386/775] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 03:12:17 2022] GET /identity/v3/services => generated 772 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:17.445934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9a010-b39a-4a16-8432-f1df01682664 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:17.563462 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9a010-b39a-4a16-8432-f1df01682664 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:17.574672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:17.605521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59a243-0ee4-44ef-b903-8a885e241816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:17.606561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59a243-0ee4-44ef-b903-8a885e241816 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:17.607067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59a243-0ee4-44ef-b903-8a885e241816 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:17.607585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59a243-0ee4-44ef-b903-8a885e241816 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:17.608371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59a243-0ee4-44ef-b903-8a885e241816 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:17.609962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59a243-0ee4-44ef-b903-8a885e241816 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-0a59a243-0ee4-44ef-b903-8a885e241816 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:17.619607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:17.620586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 03:12:17.621460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:17.624237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 390/776] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Sep 13 03:12:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:17.630134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168012a-e77b-4d4e-9ebf-32cf0e70cf1e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:17.643565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:17.741315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168012a-e77b-4d4e-9ebf-32cf0e70cf1e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:17.777545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d69e0e-c0ad-4996-bbfc-eaee5eebffee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:17.778159 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d69e0e-c0ad-4996-bbfc-eaee5eebffee None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:17.778405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d69e0e-c0ad-4996-bbfc-eaee5eebffee None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:17.778675 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d69e0e-c0ad-4996-bbfc-eaee5eebffee None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:17.779300 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d69e0e-c0ad-4996-bbfc-eaee5eebffee None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:17.779599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d69e0e-c0ad-4996-bbfc-eaee5eebffee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:17.780971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d69e0e-c0ad-4996-bbfc-eaee5eebffee None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:17.787223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 387/777] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 13 03:12:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:17.792443 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59a243-0ee4-44ef-b903-8a885e241816 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:18.058195 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59a243-0ee4-44ef-b903-8a885e241816 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:18.105780 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03ffce-c937-4190-904b-3bd35789e022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:18.106387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ffce-c937-4190-904b-3bd35789e022 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:18.106665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ffce-c937-4190-904b-3bd35789e022 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:18.106936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ffce-c937-4190-904b-3bd35789e022 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:18.107565 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03ffce-c937-4190-904b-3bd35789e022 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:18.107865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03ffce-c937-4190-904b-3bd35789e022 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:18.109242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03ffce-c937-4190-904b-3bd35789e022 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:18.114541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 391/778] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 13 03:12:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:18.119993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d69e0e-c0ad-4996-bbfc-eaee5eebffee None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:18.135019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1f473-4d58-46c8-99e7-6a8f8e34f2a1 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:18.135312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1f473-4d58-46c8-99e7-6a8f8e34f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:18.135574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1f473-4d58-46c8-99e7-6a8f8e34f2a1 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:18.136886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 392/779] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:12:18.146827 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fef3-322b-4875-b425-0b99df270335 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:18.147120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fef3-322b-4875-b425-0b99df270335 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:18.147372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0fef3-322b-4875-b425-0b99df270335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:18.186378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cde0fef3-322b-4875-b425-0b99df270335 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:18.187730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cde0fef3-322b-4875-b425-0b99df270335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:18.228256 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:18.247092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d69e0e-c0ad-4996-bbfc-eaee5eebffee None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:18.252738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:18.285009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 393/780] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:12:18.285378 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9c96b-da20-4edc-8916-c2ee3505a414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:18.286307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c96b-da20-4edc-8916-c2ee3505a414 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:18.286766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c96b-da20-4edc-8916-c2ee3505a414 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:18.287199 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c96b-da20-4edc-8916-c2ee3505a414 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:18.288124 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9c96b-da20-4edc-8916-c2ee3505a414 None admin] RBAC: Adding query filter params (interface=public, service_id=e56f628b00fb45a0b03b5ab6f94afb1a, region_id=RegionOne) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:18.288596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9c96b-da20-4edc-8916-c2ee3505a414 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:18.290840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9c96b-da20-4edc-8916-c2ee3505a414 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:18.299446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 388/781] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 03:12:18 2022] GET /identity/v3/endpoints?service_id=e56f628b00fb45a0b03b5ab6f94afb1a&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:18.309351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0fef3-322b-4875-b425-0b99df270335 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:18.406529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0fef3-322b-4875-b425-0b99df270335 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:18.440644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2b354-0fdd-4d7b-a0c9-94ca9364d719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:18.441250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2b354-0fdd-4d7b-a0c9-94ca9364d719 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:18.441549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2b354-0fdd-4d7b-a0c9-94ca9364d719 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:18.441820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2b354-0fdd-4d7b-a0c9-94ca9364d719 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:18.442417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2b354-0fdd-4d7b-a0c9-94ca9364d719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:18.443779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2b354-0fdd-4d7b-a0c9-94ca9364d719 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:18.453342 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 394/782] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 03:12:18 2022] GET /identity/v3/services => generated 772 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:18.737071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d595750-7fed-4988-b7b0-e00b6070e2dc None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:18.737416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2b354-0fdd-4d7b-a0c9-94ca9364d719 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:18.737854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d595750-7fed-4988-b7b0-e00b6070e2dc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:18.738304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d595750-7fed-4988-b7b0-e00b6070e2dc None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:18.739820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 389/783] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:18.745448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e197c-af75-43df-a997-2ee8d6192f1c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:18.745984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e197c-af75-43df-a997-2ee8d6192f1c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:18.746472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e197c-af75-43df-a997-2ee8d6192f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:18.773284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:18.773503 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-792e197c-af75-43df-a997-2ee8d6192f1c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:18.773503 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-792e197c-af75-43df-a997-2ee8d6192f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:18.898413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2b354-0fdd-4d7b-a0c9-94ca9364d719 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:18.901945 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 390/784] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:18.953186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92c797-32e5-475a-9e84-c42620110179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:18.953836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92c797-32e5-475a-9e84-c42620110179 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:18.954113 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92c797-32e5-475a-9e84-c42620110179 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:18.954381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92c797-32e5-475a-9e84-c42620110179 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:18.970169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92c797-32e5-475a-9e84-c42620110179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-7d92c797-32e5-475a-9e84-c42620110179 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:18.975121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:18.976045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:18.977530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:18.977530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:18.977530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:18.977530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:18.977530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:18.977530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:18.977530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:18.977530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:18.977530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:18.977530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:18.977530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:18.977530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:18.977530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 395/785] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:18.982139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e197c-af75-43df-a997-2ee8d6192f1c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:19.064893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:19.136336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e197c-af75-43df-a997-2ee8d6192f1c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:19.171613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92c797-32e5-475a-9e84-c42620110179 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:19.192311 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc1d07-1dd7-465a-9e1c-fcaa2af1915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:19.193030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc1d07-1dd7-465a-9e1c-fcaa2af1915f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:19.193329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc1d07-1dd7-465a-9e1c-fcaa2af1915f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:19.193607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc1d07-1dd7-465a-9e1c-fcaa2af1915f None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:19.194281 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc1d07-1dd7-465a-9e1c-fcaa2af1915f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:19.194587 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc1d07-1dd7-465a-9e1c-fcaa2af1915f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:19.196662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc1d07-1dd7-465a-9e1c-fcaa2af1915f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:19.213954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 391/786] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:19.222144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc1d07-1dd7-465a-9e1c-fcaa2af1915f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:19.304612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:19.321522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92c797-32e5-475a-9e84-c42620110179 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:19.392511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f739a50-db44-4a53-ba04-80bca0937e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:19.393149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f739a50-db44-4a53-ba04-80bca0937e94 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:19.393450 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f739a50-db44-4a53-ba04-80bca0937e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:19.393719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f739a50-db44-4a53-ba04-80bca0937e94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:19.406225 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f739a50-db44-4a53-ba04-80bca0937e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-2f739a50-db44-4a53-ba04-80bca0937e94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:19.411689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:19.412629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:19.413525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:19.413525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:19.413525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:19.413525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:19.413525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:19.413525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:19.413525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:19.413525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:19.413525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:19.413525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:19.413525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:19.413525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:19.415170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc1d07-1dd7-465a-9e1c-fcaa2af1915f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:19.415408 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 396/787] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:12:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:19.421918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f739a50-db44-4a53-ba04-80bca0937e94 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:19.446743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:19.453202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4354855-170d-4870-aad3-6b05c0cf5d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:19.453905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4354855-170d-4870-aad3-6b05c0cf5d7b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:19.459632 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4354855-170d-4870-aad3-6b05c0cf5d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:19.459632 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4354855-170d-4870-aad3-6b05c0cf5d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:19.467435 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4354855-170d-4870-aad3-6b05c0cf5d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:19.469072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4354855-170d-4870-aad3-6b05c0cf5d7b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b4354855-170d-4870-aad3-6b05c0cf5d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:19.486133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:19.487140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:19.488025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:19.488025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:19.488025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:19.488025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 392/788] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:19.493765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4354855-170d-4870-aad3-6b05c0cf5d7b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:19.606335 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4354855-170d-4870-aad3-6b05c0cf5d7b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:19.641952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90099c-0891-4681-b7d1-dbc0df55c8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:19.642606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90099c-0891-4681-b7d1-dbc0df55c8ef None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:19.642882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90099c-0891-4681-b7d1-dbc0df55c8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:19.643148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90099c-0891-4681-b7d1-dbc0df55c8ef None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:19.643785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90099c-0891-4681-b7d1-dbc0df55c8ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:19.644083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90099c-0891-4681-b7d1-dbc0df55c8ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:19.645461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90099c-0891-4681-b7d1-dbc0df55c8ef None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:19.658582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 393/789] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:19.660555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f739a50-db44-4a53-ba04-80bca0937e94 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:19.665311 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90099c-0891-4681-b7d1-dbc0df55c8ef None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:19.721349 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c0f44-d1f3-4907-be86-11705c243bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:19.722205 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c0f44-d1f3-4907-be86-11705c243bce None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:19.722486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c0f44-d1f3-4907-be86-11705c243bce None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:19.723703 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c0f44-d1f3-4907-be86-11705c243bce None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:19.724228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c0f44-d1f3-4907-be86-11705c243bce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:19.724535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c0f44-d1f3-4907-be86-11705c243bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:19.725926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c0f44-d1f3-4907-be86-11705c243bce None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:19.745913 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 397/790] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:12:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:19.746282 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:19.751129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c0f44-d1f3-4907-be86-11705c243bce None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:19.776927 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:19.862429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90099c-0891-4681-b7d1-dbc0df55c8ef None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:19.921911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e5606-b6f8-404f-9cdf-079cfa34ea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:19.922677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e5606-b6f8-404f-9cdf-079cfa34ea15 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:19.923122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e5606-b6f8-404f-9cdf-079cfa34ea15 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:19.923580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e5606-b6f8-404f-9cdf-079cfa34ea15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:19.929232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c0f44-d1f3-4907-be86-11705c243bce None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:19.931847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e5606-b6f8-404f-9cdf-079cfa34ea15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:19.934302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e5606-b6f8-404f-9cdf-079cfa34ea15 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-d19e5606-b6f8-404f-9cdf-079cfa34ea15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:19.948534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:19.949573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:19.950581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:19.950581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:19.950581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:19.950581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:19.950581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:19.950581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:19.950581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:19.950581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:19.950581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:12:19.950581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:19.953428 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 394/791] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 03:12:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:19.955051 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d058d-3cc9-430d-b2b5-2ef375543f7e None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:19.955562 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d058d-3cc9-430d-b2b5-2ef375543f7e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:19.956025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d058d-3cc9-430d-b2b5-2ef375543f7e None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:19.958000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 395/792] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:19.959007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d058d-3cc9-430d-b2b5-2ef375543f7e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:19.989154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9173d-4a0f-451f-a6ec-54b656d3f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:19.990182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9173d-4a0f-451f-a6ec-54b656d3f6bd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:19.990624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9173d-4a0f-451f-a6ec-54b656d3f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:19.991042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9173d-4a0f-451f-a6ec-54b656d3f6bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:20.002907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9173d-4a0f-451f-a6ec-54b656d3f6bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:20.004629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9173d-4a0f-451f-a6ec-54b656d3f6bd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-aab9173d-4a0f-451f-a6ec-54b656d3f6bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:20.020494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:20.021550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:20.022491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:20.022491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:20.022491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:20.024894 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 398/793] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:20.026326 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a51b-c6ce-429c-bd5c-81db4d304be0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:20.026772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a51b-c6ce-429c-bd5c-81db4d304be0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:20.027238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a51b-c6ce-429c-bd5c-81db4d304be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:20.045906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-add9a51b-c6ce-429c-bd5c-81db4d304be0 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:20.047413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-add9a51b-c6ce-429c-bd5c-81db4d304be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:20.092312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d058d-3cc9-430d-b2b5-2ef375543f7e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:20.094054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:20.113538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:20.129282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 399/794] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:20.129282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9a51b-c6ce-429c-bd5c-81db4d304be0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:20.136301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0eeaf-adda-4da2-b252-a8b96c89b4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:20.143640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0eeaf-adda-4da2-b252-a8b96c89b4cc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:20.143967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0eeaf-adda-4da2-b252-a8b96c89b4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:20.144252 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0eeaf-adda-4da2-b252-a8b96c89b4cc None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:20.145215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0eeaf-adda-4da2-b252-a8b96c89b4cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:20.145931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0eeaf-adda-4da2-b252-a8b96c89b4cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:20.147678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0eeaf-adda-4da2-b252-a8b96c89b4cc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:20.173603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 396/795] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 03:12:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:20.174935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fdfff-aab4-4247-88ac-1f71f16d41ba None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:20.175230 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fdfff-aab4-4247-88ac-1f71f16d41ba None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:20.175508 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fdfff-aab4-4247-88ac-1f71f16d41ba None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:20.181393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 397/796] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:20.182409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fdfff-aab4-4247-88ac-1f71f16d41ba None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:20.249693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9a51b-c6ce-429c-bd5c-81db4d304be0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:20.295635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64197f-23e0-4277-9781-0060a94632bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:20.296862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64197f-23e0-4277-9781-0060a94632bf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:20.297503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64197f-23e0-4277-9781-0060a94632bf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:20.298145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64197f-23e0-4277-9781-0060a94632bf None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:20.298855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64197f-23e0-4277-9781-0060a94632bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:20.299215 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64197f-23e0-4277-9781-0060a94632bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:20.300966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64197f-23e0-4277-9781-0060a94632bf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:20.309537 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fdfff-aab4-4247-88ac-1f71f16d41ba None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:20.314544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 400/797] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:20.314544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b299375-df22-4c15-a4f6-e2fceb4849d5 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:20.321413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b299375-df22-4c15-a4f6-e2fceb4849d5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:20.321951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b299375-df22-4c15-a4f6-e2fceb4849d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:20.347515 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2b299375-df22-4c15-a4f6-e2fceb4849d5 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:20.348806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2b299375-df22-4c15-a4f6-e2fceb4849d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:20.406949 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:20.426035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 401/798] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:20.426973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b299375-df22-4c15-a4f6-e2fceb4849d5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:20.487918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638b5f6-cfd9-41e6-94d5-3da2c62480e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:20.488713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638b5f6-cfd9-41e6-94d5-3da2c62480e9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:20.489516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638b5f6-cfd9-41e6-94d5-3da2c62480e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:20.489811 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638b5f6-cfd9-41e6-94d5-3da2c62480e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:20.528627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:20.539947 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b299375-df22-4c15-a4f6-e2fceb4849d5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:20.581291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5bcf4-4b4e-4162-aef2-c94518ca0b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:20.581946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5bcf4-4b4e-4162-aef2-c94518ca0b5d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:20.582275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5bcf4-4b4e-4162-aef2-c94518ca0b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:20.582553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5bcf4-4b4e-4162-aef2-c94518ca0b5d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:20.584992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638b5f6-cfd9-41e6-94d5-3da2c62480e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:20.587293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638b5f6-cfd9-41e6-94d5-3da2c62480e9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:20.590261 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5bcf4-4b4e-4162-aef2-c94518ca0b5d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:20.591805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5bcf4-4b4e-4162-aef2-c94518ca0b5d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-2fa5bcf4-4b4e-4162-aef2-c94518ca0b5d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:20.604337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:20.605352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:20.606317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:20.606317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:20.606317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:20.606317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:20.606317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:20.606317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:20.606317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:20.606317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:20.606317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 03:12:20.606317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:20.610378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 402/799] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:12:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:20.611365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5bcf4-4b4e-4162-aef2-c94518ca0b5d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:20.673838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:20.705228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 398/800] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:12:20.706190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638b5f6-cfd9-41e6-94d5-3da2c62480e9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:20.744764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5bcf4-4b4e-4162-aef2-c94518ca0b5d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:20.768500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:20.783524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808deeb-e192-4b53-ad62-a065a7bc9b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:20.784160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808deeb-e192-4b53-ad62-a065a7bc9b09 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:20.788362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808deeb-e192-4b53-ad62-a065a7bc9b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:20.788362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808deeb-e192-4b53-ad62-a065a7bc9b09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:20.796284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808deeb-e192-4b53-ad62-a065a7bc9b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6808deeb-e192-4b53-ad62-a065a7bc9b09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:20.802417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:20.803357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:20.804290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:20.804290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:20.804290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:20.804290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:20.804290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:20.804290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:20.804290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:20.804290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:20.804290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:20.804290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:20.804290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:20.804290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:20.804290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 403/801] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:12:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:20.806290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808deeb-e192-4b53-ad62-a065a7bc9b09 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:20.816227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638b5f6-cfd9-41e6-94d5-3da2c62480e9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:20.855313 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e1eab-ce19-4504-84fc-fd4db97e879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:20.855928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e1eab-ce19-4504-84fc-fd4db97e879c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:20.856202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e1eab-ce19-4504-84fc-fd4db97e879c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:20.856470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e1eab-ce19-4504-84fc-fd4db97e879c None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:20.857190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e1eab-ce19-4504-84fc-fd4db97e879c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:20.857524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e1eab-ce19-4504-84fc-fd4db97e879c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:20.858947 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e1eab-ce19-4504-84fc-fd4db97e879c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:20.881522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 399/802] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 13 03:12:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:20.881522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e1eab-ce19-4504-84fc-fd4db97e879c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:20.932084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808deeb-e192-4b53-ad62-a065a7bc9b09 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:20.935151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:20.965976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561a54b-ebbc-4184-9af1-8323408cb4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:20.966634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a54b-ebbc-4184-9af1-8323408cb4fa None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:20.966929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a54b-ebbc-4184-9af1-8323408cb4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:20.967203 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561a54b-ebbc-4184-9af1-8323408cb4fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:20.978062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561a54b-ebbc-4184-9af1-8323408cb4fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:20.979138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e1eab-ce19-4504-84fc-fd4db97e879c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:20.979965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561a54b-ebbc-4184-9af1-8323408cb4fa None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-d561a54b-ebbc-4184-9af1-8323408cb4fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:20.995057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:20.996043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:20.996940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:20.996940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:20.996940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:20.996940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 404/803] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:20.996940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561a54b-ebbc-4184-9af1-8323408cb4fa None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:21.001551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:21.017546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a1a1b-ad91-43d2-becf-d2c158b85499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:21.018272 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a1a1b-ad91-43d2-becf-d2c158b85499 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.018550 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a1a1b-ad91-43d2-becf-d2c158b85499 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.018835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a1a1b-ad91-43d2-becf-d2c158b85499 None admin] PATH_INFO: `/v3/services/network` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.019402 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a1a1b-ad91-43d2-becf-d2c158b85499 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:21.020758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a1a1b-ad91-43d2-becf-d2c158b85499 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-c03a1a1b-ad91-43d2-becf-d2c158b85499 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:21.029656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:21.030663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:21.031520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 400/804] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:20 2022] GET /identity/v3/services/network => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:21.032903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a1a1b-ad91-43d2-becf-d2c158b85499 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:21.108060 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561a54b-ebbc-4184-9af1-8323408cb4fa None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:21.128298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a1a1b-ad91-43d2-becf-d2c158b85499 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:21.144664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019afc4-dd3b-4c95-844f-1a99df598e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:21.145391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019afc4-dd3b-4c95-844f-1a99df598e08 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.145670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019afc4-dd3b-4c95-844f-1a99df598e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.145939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019afc4-dd3b-4c95-844f-1a99df598e08 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.146596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019afc4-dd3b-4c95-844f-1a99df598e08 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:21.146895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019afc4-dd3b-4c95-844f-1a99df598e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:21.148256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019afc4-dd3b-4c95-844f-1a99df598e08 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:21.156824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 405/805] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:12:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:21.158040 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bc99e-02a4-475f-ac6b-6e0f663a7607 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.158321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bc99e-02a4-475f-ac6b-6e0f663a7607 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.158591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bc99e-02a4-475f-ac6b-6e0f663a7607 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.159812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 406/806] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:21.160442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bc99e-02a4-475f-ac6b-6e0f663a7607 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:21.164749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c58f8-670f-4e30-9271-ccfdd7e26431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:21.166166 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c58f8-670f-4e30-9271-ccfdd7e26431 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.166707 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c58f8-670f-4e30-9271-ccfdd7e26431 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.167125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c58f8-670f-4e30-9271-ccfdd7e26431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.178588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c58f8-670f-4e30-9271-ccfdd7e26431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:21.180597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c58f8-670f-4e30-9271-ccfdd7e26431 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:21.182502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-d68c58f8-670f-4e30-9271-ccfdd7e26431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:21.194882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:21.196625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:21.197780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:21.197780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:21.197780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:21.197780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 401/807] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:21.197780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c58f8-670f-4e30-9271-ccfdd7e26431 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:21.233234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:21.269138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bc99e-02a4-475f-ac6b-6e0f663a7607 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:21.296955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c58f8-670f-4e30-9271-ccfdd7e26431 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:21.301076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284a7b5-b3e1-45bc-9178-586ed11d7b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:21.301701 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284a7b5-b3e1-45bc-9178-586ed11d7b51 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.301980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284a7b5-b3e1-45bc-9178-586ed11d7b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.302251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284a7b5-b3e1-45bc-9178-586ed11d7b51 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.302877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284a7b5-b3e1-45bc-9178-586ed11d7b51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:21.303175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284a7b5-b3e1-45bc-9178-586ed11d7b51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:21.304529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284a7b5-b3e1-45bc-9178-586ed11d7b51 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:21.316241 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 407/808] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:21.317014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284a7b5-b3e1-45bc-9178-586ed11d7b51 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:21.330173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c5841-f577-4d09-b773-63fed6fab096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:21.330779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5841-f577-4d09-b773-63fed6fab096 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.331052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5841-f577-4d09-b773-63fed6fab096 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.331321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5841-f577-4d09-b773-63fed6fab096 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.331941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c5841-f577-4d09-b773-63fed6fab096 None admin] RBAC: Adding query filter params (name=network) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:21.332243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c5841-f577-4d09-b773-63fed6fab096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:21.333637 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c5841-f577-4d09-b773-63fed6fab096 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:21.337997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 402/809] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 03:12:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:21.339162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105460-9579-49cc-a9e8-5b62cd35b703 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.339444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105460-9579-49cc-a9e8-5b62cd35b703 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.339710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105460-9579-49cc-a9e8-5b62cd35b703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.356968 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-72105460-9579-49cc-a9e8-5b62cd35b703 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:21.358188 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-72105460-9579-49cc-a9e8-5b62cd35b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:21.401878 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:21.422005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 403/810] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:21.422249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284a7b5-b3e1-45bc-9178-586ed11d7b51 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:21.422808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72105460-9579-49cc-a9e8-5b62cd35b703 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:21.450174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:21.462596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32370772-2ecb-44a4-97a1-9ff7bb2c2ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:21.463226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32370772-2ecb-44a4-97a1-9ff7bb2c2ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.463503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32370772-2ecb-44a4-97a1-9ff7bb2c2ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.463804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32370772-2ecb-44a4-97a1-9ff7bb2c2ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.474049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32370772-2ecb-44a4-97a1-9ff7bb2c2ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:21.475534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32370772-2ecb-44a4-97a1-9ff7bb2c2ef2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-32370772-2ecb-44a4-97a1-9ff7bb2c2ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:21.493434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:21.494378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:21.495258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:21.495258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:21.495258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:21.495258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 408/811] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:21.495258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32370772-2ecb-44a4-97a1-9ff7bb2c2ef2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:21.532074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72105460-9579-49cc-a9e8-5b62cd35b703 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:21.568128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972f71e-3711-4993-9f8b-5fb5fc6da690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:21.568964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972f71e-3711-4993-9f8b-5fb5fc6da690 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.569416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972f71e-3711-4993-9f8b-5fb5fc6da690 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.569826 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972f71e-3711-4993-9f8b-5fb5fc6da690 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.570595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972f71e-3711-4993-9f8b-5fb5fc6da690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:21.571541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972f71e-3711-4993-9f8b-5fb5fc6da690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:21.573143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972f71e-3711-4993-9f8b-5fb5fc6da690 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:21.585140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 404/812] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:21.586179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972f71e-3711-4993-9f8b-5fb5fc6da690 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:21.603378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32370772-2ecb-44a4-97a1-9ff7bb2c2ef2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:21.631196 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:21.637590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd0355-cf20-45a1-94df-a4f6b9b6a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:21.638385 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd0355-cf20-45a1-94df-a4f6b9b6a36a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.638649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd0355-cf20-45a1-94df-a4f6b9b6a36a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.638916 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd0355-cf20-45a1-94df-a4f6b9b6a36a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.645677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd0355-cf20-45a1-94df-a4f6b9b6a36a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:21.647163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd0355-cf20-45a1-94df-a4f6b9b6a36a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5fcd0355-cf20-45a1-94df-a4f6b9b6a36a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:21.659608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:21.660505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:21.661943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:21.661943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:21.661943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:21.661943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:21.661943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:21.661943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:21.661943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:21.661943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:21.661943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 409/813] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:21.661943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd0355-cf20-45a1-94df-a4f6b9b6a36a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:21.683979 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:21.696436 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972f71e-3711-4993-9f8b-5fb5fc6da690 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:21.729809 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc02065-dff9-4d39-9e21-d7693aa9bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:21.730413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc02065-dff9-4d39-9e21-d7693aa9bcd4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.730692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc02065-dff9-4d39-9e21-d7693aa9bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.730966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc02065-dff9-4d39-9e21-d7693aa9bcd4 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.731594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc02065-dff9-4d39-9e21-d7693aa9bcd4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:21.731897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc02065-dff9-4d39-9e21-d7693aa9bcd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:21.733285 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc02065-dff9-4d39-9e21-d7693aa9bcd4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:21.737920 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 405/814] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 03:12:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:21.738693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc02065-dff9-4d39-9e21-d7693aa9bcd4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:21.767281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd0355-cf20-45a1-94df-a4f6b9b6a36a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:21.801110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852a4a-0f12-4894-9698-192f185690c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:21.801732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852a4a-0f12-4894-9698-192f185690c7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.802008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852a4a-0f12-4894-9698-192f185690c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.802275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852a4a-0f12-4894-9698-192f185690c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.803320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19852a4a-0f12-4894-9698-192f185690c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:21.803320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19852a4a-0f12-4894-9698-192f185690c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:21.804533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19852a4a-0f12-4894-9698-192f185690c7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:21.816566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 410/815] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:21.817504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852a4a-0f12-4894-9698-192f185690c7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:21.835870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc02065-dff9-4d39-9e21-d7693aa9bcd4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:21.868808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:21.869010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ef8a2-7276-4e47-aa3f-7c89a3eceabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:21.869641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ef8a2-7276-4e47-aa3f-7c89a3eceabc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.869917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ef8a2-7276-4e47-aa3f-7c89a3eceabc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.870187 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ef8a2-7276-4e47-aa3f-7c89a3eceabc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.876605 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ef8a2-7276-4e47-aa3f-7c89a3eceabc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:21.880503 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ef8a2-7276-4e47-aa3f-7c89a3eceabc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7d2ef8a2-7276-4e47-aa3f-7c89a3eceabc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:21.889942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:21.891005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:21.892244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:21.892244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:21.892244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:21.892244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:21.892244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:21.892244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:21.892244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:21.892244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:21.892244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 406/816] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:21.892244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ef8a2-7276-4e47-aa3f-7c89a3eceabc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:21.910696 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:21.918610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852a4a-0f12-4894-9698-192f185690c7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:21.952347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47820e8-87dc-4118-81c2-dd055651c790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:21.952970 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47820e8-87dc-4118-81c2-dd055651c790 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:21.953196 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47820e8-87dc-4118-81c2-dd055651c790 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:21.953490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47820e8-87dc-4118-81c2-dd055651c790 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:21.954164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47820e8-87dc-4118-81c2-dd055651c790 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:21.954460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47820e8-87dc-4118-81c2-dd055651c790 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:21.955869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47820e8-87dc-4118-81c2-dd055651c790 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:21.966910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 411/817] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:21.967664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47820e8-87dc-4118-81c2-dd055651c790 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:21.995296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ef8a2-7276-4e47-aa3f-7c89a3eceabc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:22.028038 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06838b7-e700-45f7-8e44-2ce7bfbeedfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:22.028653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06838b7-e700-45f7-8e44-2ce7bfbeedfb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:22.028929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06838b7-e700-45f7-8e44-2ce7bfbeedfb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:22.029201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06838b7-e700-45f7-8e44-2ce7bfbeedfb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:22.029807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06838b7-e700-45f7-8e44-2ce7bfbeedfb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:22.031169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06838b7-e700-45f7-8e44-2ce7bfbeedfb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a06838b7-e700-45f7-8e44-2ce7bfbeedfb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:22.039766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:22.040895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:22.041901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 407/818] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Sep 13 03:12:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:22.042861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06838b7-e700-45f7-8e44-2ce7bfbeedfb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:22.069305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47820e8-87dc-4118-81c2-dd055651c790 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:22.079863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:22.102814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48155039-3908-4d06-8696-fd6e983f1647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:22.103406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48155039-3908-4d06-8696-fd6e983f1647 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:22.103681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48155039-3908-4d06-8696-fd6e983f1647 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:22.103951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48155039-3908-4d06-8696-fd6e983f1647 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:22.104606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48155039-3908-4d06-8696-fd6e983f1647 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:22.105980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48155039-3908-4d06-8696-fd6e983f1647 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:22.119994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:22.142747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06838b7-e700-45f7-8e44-2ce7bfbeedfb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:22.174029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1beb40-ace4-443f-8e6d-bf0308496950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:22.174643 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1beb40-ace4-443f-8e6d-bf0308496950 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:22.174916 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1beb40-ace4-443f-8e6d-bf0308496950 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:22.175184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1beb40-ace4-443f-8e6d-bf0308496950 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:22.182831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1beb40-ace4-443f-8e6d-bf0308496950 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:22.184394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1beb40-ace4-443f-8e6d-bf0308496950 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ab1beb40-ace4-443f-8e6d-bf0308496950 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:22.195161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:22.205497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:22.206661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:22.206661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:22.206661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:22.206661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:22.206661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:22.206661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:22.206661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:22.206661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:22.206661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 03:12:22.206661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:22.206661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 408/819] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 03:12:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:22.206661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1beb40-ace4-443f-8e6d-bf0308496950 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:22.229985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 412/820] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:12:21 2022] POST /identity/v3/endpoints => generated 337 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:12:22.230807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48155039-3908-4d06-8696-fd6e983f1647 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:22.304115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1beb40-ace4-443f-8e6d-bf0308496950 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:22.342261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:22.348831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5fb79-f715-49d0-9aeb-bf03950dcb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:22.349492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5fb79-f715-49d0-9aeb-bf03950dcb05 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:22.349946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5fb79-f715-49d0-9aeb-bf03950dcb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:22.350224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5fb79-f715-49d0-9aeb-bf03950dcb05 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:22.355469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5fb79-f715-49d0-9aeb-bf03950dcb05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:22.355469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5fb79-f715-49d0-9aeb-bf03950dcb05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:22.355469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5fb79-f715-49d0-9aeb-bf03950dcb05 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:22.363904 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48155039-3908-4d06-8696-fd6e983f1647 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:22.366701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 409/821] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:22.368221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5fb79-f715-49d0-9aeb-bf03950dcb05 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:22.409409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d451f-1780-44d8-be02-166eaf1753ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:22.410027 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d451f-1780-44d8-be02-166eaf1753ee None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:22.410308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d451f-1780-44d8-be02-166eaf1753ee None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:22.410575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d451f-1780-44d8-be02-166eaf1753ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:22.411298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d451f-1780-44d8-be02-166eaf1753ee None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=fcff121c9e974a6aabaa18775de65f63) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:22.411606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d451f-1780-44d8-be02-166eaf1753ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:22.413042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d451f-1780-44d8-be02-166eaf1753ee None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:22.420622 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 413/822] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:22 2022] GET /identity/v3/role_assignments?user.id=fcff121c9e974a6aabaa18775de65f63&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:22.421684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d451f-1780-44d8-be02-166eaf1753ee None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:22.463338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:22.491068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5fb79-f715-49d0-9aeb-bf03950dcb05 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:22.542932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dc1bf-1e0b-4e64-b216-3f6cc16801ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:22.543765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dc1bf-1e0b-4e64-b216-3f6cc16801ea None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:22.544448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dc1bf-1e0b-4e64-b216-3f6cc16801ea None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:22.544722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dc1bf-1e0b-4e64-b216-3f6cc16801ea None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:22.545743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dc1bf-1e0b-4e64-b216-3f6cc16801ea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:22.546201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dc1bf-1e0b-4e64-b216-3f6cc16801ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:22.547931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dc1bf-1e0b-4e64-b216-3f6cc16801ea None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:22.553327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 410/823] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 13 03:12:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:22.557321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dc1bf-1e0b-4e64-b216-3f6cc16801ea None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:22.557523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d451f-1780-44d8-be02-166eaf1753ee None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:22.597621 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d75c5-76bd-4fa7-a1bf-0fca0158f155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:22.598886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d75c5-76bd-4fa7-a1bf-0fca0158f155 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:22.598886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d75c5-76bd-4fa7-a1bf-0fca0158f155 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:22.598886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d75c5-76bd-4fa7-a1bf-0fca0158f155 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:22.599470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d75c5-76bd-4fa7-a1bf-0fca0158f155 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:22.599778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d75c5-76bd-4fa7-a1bf-0fca0158f155 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:22.601783 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d75c5-76bd-4fa7-a1bf-0fca0158f155 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:22.620576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:22.623354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 414/824] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 13 03:12:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:22.624180 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d75c5-76bd-4fa7-a1bf-0fca0158f155 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:22.672722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dc1bf-1e0b-4e64-b216-3f6cc16801ea None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:22.710150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1e521-0ff3-41ad-9359-44e521d6112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:22.710923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1e521-0ff3-41ad-9359-44e521d6112e None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:22.711743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1e521-0ff3-41ad-9359-44e521d6112e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:22.712098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1e521-0ff3-41ad-9359-44e521d6112e None admin] PATH_INFO: `/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/bd3284a5c047425d8148f178eee4069d/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:22.714110 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1e521-0ff3-41ad-9359-44e521d6112e None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad922f6e2414214abe3ba1de67fc8de, user_id=bd3284a5c047425d8148f178eee4069d, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:22.715853 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1e521-0ff3-41ad-9359-44e521d6112e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:22.718202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:22.730917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d75c5-76bd-4fa7-a1bf-0fca0158f155 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:22.765512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d34ad-ef43-44b6-a87b-1d0d68cccb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:22.766115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d34ad-ef43-44b6-a87b-1d0d68cccb23 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:22.766394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d34ad-ef43-44b6-a87b-1d0d68cccb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:22.766735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d34ad-ef43-44b6-a87b-1d0d68cccb23 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:22.767359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d34ad-ef43-44b6-a87b-1d0d68cccb23 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:22.767663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d34ad-ef43-44b6-a87b-1d0d68cccb23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:22.769039 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d34ad-ef43-44b6-a87b-1d0d68cccb23 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:22.774615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 415/825] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Sep 13 03:12:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:22.774615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d34ad-ef43-44b6-a87b-1d0d68cccb23 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:22.790200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 411/826] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:12:22 2022] PUT /identity/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/bd3284a5c047425d8148f178eee4069d/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:12:22.791211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1e521-0ff3-41ad-9359-44e521d6112e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:22.912670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d34ad-ef43-44b6-a87b-1d0d68cccb23 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:22.951801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391f458-e677-4113-8cad-54decb30dac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:22.958526 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391f458-e677-4113-8cad-54decb30dac4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:22.958526 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391f458-e677-4113-8cad-54decb30dac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:22.958526 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391f458-e677-4113-8cad-54decb30dac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:22.968365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1e521-0ff3-41ad-9359-44e521d6112e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:22.969083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391f458-e677-4113-8cad-54decb30dac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:22.972273 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391f458-e677-4113-8cad-54decb30dac4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:22.992745 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f391f458-e677-4113-8cad-54decb30dac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:22.994269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:22.995199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:22.996096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:22.996096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:22.996096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:22.996096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 416/827] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:23.003019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391f458-e677-4113-8cad-54decb30dac4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:23.007286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:23.016202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abb7c2-cd4a-4870-b148-6b385fda5994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:23.016819 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb7c2-cd4a-4870-b148-6b385fda5994 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:23.017098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb7c2-cd4a-4870-b148-6b385fda5994 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:23.017416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb7c2-cd4a-4870-b148-6b385fda5994 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:23.018087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abb7c2-cd4a-4870-b148-6b385fda5994 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:23.019465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abb7c2-cd4a-4870-b148-6b385fda5994 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:23.101371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 412/828] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:12:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:12:23.116434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391f458-e677-4113-8cad-54decb30dac4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:23.169186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b845e-26f8-48db-a109-bc1b80e3a980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:23.169758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b845e-26f8-48db-a109-bc1b80e3a980 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:23.170039 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b845e-26f8-48db-a109-bc1b80e3a980 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:23.170309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b845e-26f8-48db-a109-bc1b80e3a980 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:23.171029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b845e-26f8-48db-a109-bc1b80e3a980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:23.171330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b845e-26f8-48db-a109-bc1b80e3a980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:23.172801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b845e-26f8-48db-a109-bc1b80e3a980 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:23.187609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 417/829] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:23.193405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abb7c2-cd4a-4870-b148-6b385fda5994 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:23.309578 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abb7c2-cd4a-4870-b148-6b385fda5994 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:23.346678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bea6cf-7c9a-4733-b54e-a3192f6562a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:23.347319 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bea6cf-7c9a-4733-b54e-a3192f6562a0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:23.347601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bea6cf-7c9a-4733-b54e-a3192f6562a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:23.347875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bea6cf-7c9a-4733-b54e-a3192f6562a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:23.355161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bea6cf-7c9a-4733-b54e-a3192f6562a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:23.356640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bea6cf-7c9a-4733-b54e-a3192f6562a0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-12bea6cf-7c9a-4733-b54e-a3192f6562a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:23.370079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:23.371142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:23.372064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:23.372064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:23.372064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:23.372064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:23.372064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:23.372064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:23.372064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:23.372064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:23.372064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 413/830] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:23.379067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b845e-26f8-48db-a109-bc1b80e3a980 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:23.444690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:23.485998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b845e-26f8-48db-a109-bc1b80e3a980 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:23.521870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730420c-98c9-41dc-ab22-7831a9a4e0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:23.522471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730420c-98c9-41dc-ab22-7831a9a4e0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:23.522742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730420c-98c9-41dc-ab22-7831a9a4e0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:23.523008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730420c-98c9-41dc-ab22-7831a9a4e0c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:23.523724 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730420c-98c9-41dc-ab22-7831a9a4e0c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:23.524024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730420c-98c9-41dc-ab22-7831a9a4e0c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:23.525471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730420c-98c9-41dc-ab22-7831a9a4e0c1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:23.541369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 418/831] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:23.543421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bea6cf-7c9a-4733-b54e-a3192f6562a0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:23.577834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:23.647761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bea6cf-7c9a-4733-b54e-a3192f6562a0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:23.682382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73090a-9d4c-41d2-a0b8-1c86b701bcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:23.683097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73090a-9d4c-41d2-a0b8-1c86b701bcf3 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:23.683374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73090a-9d4c-41d2-a0b8-1c86b701bcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:23.683646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73090a-9d4c-41d2-a0b8-1c86b701bcf3 None admin] PATH_INFO: `/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/18e869f4ca35451583107ca7607e1861/roles/79cc79c433824f04b3110bccd205b2ba` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:23.699868 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73090a-9d4c-41d2-a0b8-1c86b701bcf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad922f6e2414214abe3ba1de67fc8de, user_id=18e869f4ca35451583107ca7607e1861, role_id=79cc79c433824f04b3110bccd205b2ba)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:23.701244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73090a-9d4c-41d2-a0b8-1c86b701bcf3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:23.763241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 414/832] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:12:23 2022] PUT /identity/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/18e869f4ca35451583107ca7607e1861/roles/79cc79c433824f04b3110bccd205b2ba => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:12:24.657089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77d40b-2e91-4131-a835-74b60f19bd67 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:24.657667 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77d40b-2e91-4131-a835-74b60f19bd67 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:24.657667 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77d40b-2e91-4131-a835-74b60f19bd67 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:24.659330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 419/833] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:24.665174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47218e50-cae2-4f8b-890a-d7e4de7d3535 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:24.665719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47218e50-cae2-4f8b-890a-d7e4de7d3535 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:24.665796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47218e50-cae2-4f8b-890a-d7e4de7d3535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:24.684470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-47218e50-cae2-4f8b-890a-d7e4de7d3535 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:24.685693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-47218e50-cae2-4f8b-890a-d7e4de7d3535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:24.754102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 415/834] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:25.022777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77d40b-2e91-4131-a835-74b60f19bd67 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:25.103738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f66af-fe73-4c83-af92-c5ec8e173fb8 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:25.104340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f66af-fe73-4c83-af92-c5ec8e173fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:25.104872 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f66af-fe73-4c83-af92-c5ec8e173fb8 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:25.106493 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 416/835] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:25.111857 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15566bd-7fa8-4ef8-944d-3994d891fc24 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:25.112379 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15566bd-7fa8-4ef8-944d-3994d891fc24 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:25.112860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15566bd-7fa8-4ef8-944d-3994d891fc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:25.131907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77d40b-2e91-4131-a835-74b60f19bd67 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:25.132704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d15566bd-7fa8-4ef8-944d-3994d891fc24 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:25.135187 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d15566bd-7fa8-4ef8-944d-3994d891fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:25.146678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:25.158047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:25.175693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a698c-31db-481c-ac52-76d906bb42d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:25.176352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a698c-31db-481c-ac52-76d906bb42d6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:25.176825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a698c-31db-481c-ac52-76d906bb42d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:25.177102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a698c-31db-481c-ac52-76d906bb42d6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:25.177730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a698c-31db-481c-ac52-76d906bb42d6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:25.179232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a698c-31db-481c-ac52-76d906bb42d6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ae1a698c-31db-481c-ac52-76d906bb42d6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:25.191870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:25.194788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:25.196249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 420/836] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Sep 13 03:12:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:25.200431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a698c-31db-481c-ac52-76d906bb42d6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:25.235584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 417/837] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:12:25.314572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a698c-31db-481c-ac52-76d906bb42d6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:25.349557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c87990-9b9b-4b5a-95b6-53f17c6e90a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:25.350161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c87990-9b9b-4b5a-95b6-53f17c6e90a6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:25.350441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c87990-9b9b-4b5a-95b6-53f17c6e90a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:25.350711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c87990-9b9b-4b5a-95b6-53f17c6e90a6 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:25.351331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c87990-9b9b-4b5a-95b6-53f17c6e90a6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:25.352136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c87990-9b9b-4b5a-95b6-53f17c6e90a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:25.353545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c87990-9b9b-4b5a-95b6-53f17c6e90a6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:25.358472 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 421/838] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 03:12:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:25.364024 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15566bd-7fa8-4ef8-944d-3994d891fc24 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:25.371142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3aa91-7eca-4253-b086-634cafce1f05 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:25.371423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3aa91-7eca-4253-b086-634cafce1f05 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:25.371693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3aa91-7eca-4253-b086-634cafce1f05 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:25.373348 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 422/839] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:12:25.378156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b985170-1a72-4071-ab85-5b9d51d6b4d5 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:25.378430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b985170-1a72-4071-ab85-5b9d51d6b4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:25.378696 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b985170-1a72-4071-ab85-5b9d51d6b4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:25.396572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9b985170-1a72-4071-ab85-5b9d51d6b4d5 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:25.397771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9b985170-1a72-4071-ab85-5b9d51d6b4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:25.443637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:25.473618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 423/840] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:12:25.484573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15566bd-7fa8-4ef8-944d-3994d891fc24 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:25.518040 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b985170-1a72-4071-ab85-5b9d51d6b4d5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:25.520604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d5a76-3d45-4000-9e92-1958455a41cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:25.521300 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d5a76-3d45-4000-9e92-1958455a41cc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:25.522386 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d5a76-3d45-4000-9e92-1958455a41cc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:25.522662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d5a76-3d45-4000-9e92-1958455a41cc None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:25.523302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d5a76-3d45-4000-9e92-1958455a41cc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:25.523643 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d5a76-3d45-4000-9e92-1958455a41cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:25.525020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d5a76-3d45-4000-9e92-1958455a41cc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:25.531043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 418/841] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 03:12:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:25.640747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b985170-1a72-4071-ab85-5b9d51d6b4d5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:25.680047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74145132-4a66-42c4-921e-b415d8f56658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:25.680832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74145132-4a66-42c4-921e-b415d8f56658 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:25.681000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74145132-4a66-42c4-921e-b415d8f56658 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:25.681289 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74145132-4a66-42c4-921e-b415d8f56658 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:25.693118 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74145132-4a66-42c4-921e-b415d8f56658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-74145132-4a66-42c4-921e-b415d8f56658 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:25.698258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:25.699212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:25.700077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:25.700077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:25.700077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:25.700077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:25.700077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:25.700077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:25.700077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:25.700077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:25.700077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:25.700077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:25.700077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:25.700077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:25.700077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 424/842] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:12:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:25.707299 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d5a76-3d45-4000-9e92-1958455a41cc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:25.718015 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:25.758759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74145132-4a66-42c4-921e-b415d8f56658 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:25.801376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:25.823344 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d5a76-3d45-4000-9e92-1958455a41cc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:25.859991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2a04e-0689-4815-9ead-f6a9e5065a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:25.860610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2a04e-0689-4815-9ead-f6a9e5065a6f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:25.860888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2a04e-0689-4815-9ead-f6a9e5065a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:25.861280 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2a04e-0689-4815-9ead-f6a9e5065a6f None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:25.862062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2a04e-0689-4815-9ead-f6a9e5065a6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:25.862371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2a04e-0689-4815-9ead-f6a9e5065a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:25.863798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2a04e-0689-4815-9ead-f6a9e5065a6f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:25.864921 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74145132-4a66-42c4-921e-b415d8f56658 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:25.874411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 419/843] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:12:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:25.880610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2a04e-0689-4815-9ead-f6a9e5065a6f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:25.904871 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2777a-9d2f-4633-a7e5-ffb35701f880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:25.905076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2777a-9d2f-4633-a7e5-ffb35701f880 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:25.905354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2777a-9d2f-4633-a7e5-ffb35701f880 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:25.905612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2777a-9d2f-4633-a7e5-ffb35701f880 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:25.906396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2777a-9d2f-4633-a7e5-ffb35701f880 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:25.907776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2777a-9d2f-4633-a7e5-ffb35701f880 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a3b2777a-9d2f-4633-a7e5-ffb35701f880 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:25.917741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:25.919000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 03:12:25.920041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:25.923955 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 425/844] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:12:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:25.924769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2777a-9d2f-4633-a7e5-ffb35701f880 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:25.969945 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:26.010381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2a04e-0689-4815-9ead-f6a9e5065a6f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:26.028965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2777a-9d2f-4633-a7e5-ffb35701f880 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:26.030523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:26.045645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5fcb2-21d9-4535-b54b-ff54b50e44a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:26.046555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5fcb2-21d9-4535-b54b-ff54b50e44a9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:26.046843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5fcb2-21d9-4535-b54b-ff54b50e44a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:26.047120 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5fcb2-21d9-4535-b54b-ff54b50e44a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:26.058457 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5fcb2-21d9-4535-b54b-ff54b50e44a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:26.059925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5fcb2-21d9-4535-b54b-ff54b50e44a9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:26.065139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb3a5c-6c20-479f-a04f-99f3d9d2a0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:26.067464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb3a5c-6c20-479f-a04f-99f3d9d2a0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:26.067464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb3a5c-6c20-479f-a04f-99f3d9d2a0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:26.067464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb3a5c-6c20-479f-a04f-99f3d9d2a0e3 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:26.067464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb3a5c-6c20-479f-a04f-99f3d9d2a0e3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:26.067464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb3a5c-6c20-479f-a04f-99f3d9d2a0e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:26.068515 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb3a5c-6c20-479f-a04f-99f3d9d2a0e3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:26.073743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 426/845] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:12:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-08b5fcb2-21d9-4535-b54b-ff54b50e44a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:26.076607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:26.077721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:26.079040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:26.079040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:26.079040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:26.079439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff4447-88cb-4d3d-8533-42e556ec3b0a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:26.079723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff4447-88cb-4d3d-8533-42e556ec3b0a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:26.079992 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff4447-88cb-4d3d-8533-42e556ec3b0a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:26.085430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 427/846] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:26.085430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff4447-88cb-4d3d-8533-42e556ec3b0a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:26.085616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 420/847] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:26.085616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5fcb2-21d9-4535-b54b-ff54b50e44a9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:26.189873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5fcb2-21d9-4535-b54b-ff54b50e44a9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:26.203600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff4447-88cb-4d3d-8533-42e556ec3b0a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:26.214451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:26.229318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fc2b0-4912-4736-8a6a-c5a7205dba05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:26.230290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fc2b0-4912-4736-8a6a-c5a7205dba05 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:26.234512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fc2b0-4912-4736-8a6a-c5a7205dba05 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:26.234512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fc2b0-4912-4736-8a6a-c5a7205dba05 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:26.234512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fc2b0-4912-4736-8a6a-c5a7205dba05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:26.234512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fc2b0-4912-4736-8a6a-c5a7205dba05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:26.234512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fc2b0-4912-4736-8a6a-c5a7205dba05 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:26.239008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12cfc1-84ce-456c-bce2-b6f1d35545e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:26.239609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12cfc1-84ce-456c-bce2-b6f1d35545e6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:26.239890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12cfc1-84ce-456c-bce2-b6f1d35545e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:26.240252 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12cfc1-84ce-456c-bce2-b6f1d35545e6 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:26.240875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12cfc1-84ce-456c-bce2-b6f1d35545e6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:26.241178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12cfc1-84ce-456c-bce2-b6f1d35545e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:26.242582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12cfc1-84ce-456c-bce2-b6f1d35545e6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:26.250613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 428/848] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:12:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:26.250613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0be8a-a0aa-4763-931c-769350ac2d67 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:26.250613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0be8a-a0aa-4763-931c-769350ac2d67 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:26.250613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0be8a-a0aa-4763-931c-769350ac2d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:26.251406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 421/849] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:26.252510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fc2b0-4912-4736-8a6a-c5a7205dba05 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:26.277235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-85a0be8a-a0aa-4763-931c-769350ac2d67 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:26.278502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-85a0be8a-a0aa-4763-931c-769350ac2d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:26.305594 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:26.359838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 429/850] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:26.387835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fc2b0-4912-4736-8a6a-c5a7205dba05 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:26.425497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11ecca-17f2-43bc-9a5c-94f8b0c38eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:26.426136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11ecca-17f2-43bc-9a5c-94f8b0c38eed None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:26.426412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11ecca-17f2-43bc-9a5c-94f8b0c38eed None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:26.426681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11ecca-17f2-43bc-9a5c-94f8b0c38eed None admin] PATH_INFO: `/v3/users/swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:26.436478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11ecca-17f2-43bc-9a5c-94f8b0c38eed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:26.438351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11ecca-17f2-43bc-9a5c-94f8b0c38eed None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5b11ecca-17f2-43bc-9a5c-94f8b0c38eed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:26.452889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:26.454134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:26.455271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:26.455271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:26.455271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:26.455271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:26.455271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:26.455271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:26.455271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:26.455271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:26.455271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 03:12:26.455271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:26.455271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 422/851] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:12:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:26.462378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0be8a-a0aa-4763-931c-769350ac2d67 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:26.571591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0be8a-a0aa-4763-931c-769350ac2d67 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:26.606120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10be00-12c9-46ce-9d27-f6e830e2cdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:26.606715 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10be00-12c9-46ce-9d27-f6e830e2cdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:26.606985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10be00-12c9-46ce-9d27-f6e830e2cdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:26.607252 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10be00-12c9-46ce-9d27-f6e830e2cdf1 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:26.607962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10be00-12c9-46ce-9d27-f6e830e2cdf1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:26.608262 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10be00-12c9-46ce-9d27-f6e830e2cdf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:26.609713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10be00-12c9-46ce-9d27-f6e830e2cdf1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:26.627956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 430/852] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Sep 13 03:12:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:26.634145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11ecca-17f2-43bc-9a5c-94f8b0c38eed None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:26.651610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10be00-12c9-46ce-9d27-f6e830e2cdf1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:26.671735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:26.687293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:26.750781 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11ecca-17f2-43bc-9a5c-94f8b0c38eed None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:26.768209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10be00-12c9-46ce-9d27-f6e830e2cdf1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:26.788106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bdad5-9321-439a-8fc0-375e3d51d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:26.788909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bdad5-9321-439a-8fc0-375e3d51d138 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:26.789810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bdad5-9321-439a-8fc0-375e3d51d138 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:26.790150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bdad5-9321-439a-8fc0-375e3d51d138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:26.808929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e17c9-3f4d-459e-9eb9-84f183a37e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:26.810343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e17c9-3f4d-459e-9eb9-84f183a37e18 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:26.810956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e17c9-3f4d-459e-9eb9-84f183a37e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:26.811500 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e17c9-3f4d-459e-9eb9-84f183a37e18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:26.823798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e17c9-3f4d-459e-9eb9-84f183a37e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-c32e17c9-3f4d-459e-9eb9-84f183a37e18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:26.830082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:26.831010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:26.831848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:26.831848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:26.831848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:26.831848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:26.831848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:26.831848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:26.831848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:26.831848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:26.831848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:26.831848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:26.831848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:12:26.831848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:26.839307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 431/853] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:12:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:26.840819 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e17c9-3f4d-459e-9eb9-84f183a37e18 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:26.869670 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bdad5-9321-439a-8fc0-375e3d51d138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:26.871456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bdad5-9321-439a-8fc0-375e3d51d138 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:26.916590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:26.941507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:26.965799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e17c9-3f4d-459e-9eb9-84f183a37e18 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:26.990520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 423/854] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:12:26.991423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bdad5-9321-439a-8fc0-375e3d51d138 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:27.005909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a5cb0-9d0c-4f0d-83a3-6deaafe86f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:27.007069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a5cb0-9d0c-4f0d-83a3-6deaafe86f13 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:27.007997 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a5cb0-9d0c-4f0d-83a3-6deaafe86f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:27.008719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a5cb0-9d0c-4f0d-83a3-6deaafe86f13 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:27.009878 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a5cb0-9d0c-4f0d-83a3-6deaafe86f13 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:27.010449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a5cb0-9d0c-4f0d-83a3-6deaafe86f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:27.012158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a5cb0-9d0c-4f0d-83a3-6deaafe86f13 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:27.026627 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 432/855] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:12:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:27.028894 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a5cb0-9d0c-4f0d-83a3-6deaafe86f13 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:27.109160 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bdad5-9321-439a-8fc0-375e3d51d138 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:27.145733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a5cb0-9d0c-4f0d-83a3-6deaafe86f13 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:27.145924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28773d-0ff4-4e3a-a557-357b8ee62a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:27.146424 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28773d-0ff4-4e3a-a557-357b8ee62a0c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:27.146701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28773d-0ff4-4e3a-a557-357b8ee62a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:27.146968 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28773d-0ff4-4e3a-a557-357b8ee62a0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:27.159652 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:27.162038 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28773d-0ff4-4e3a-a557-357b8ee62a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:27.163675 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28773d-0ff4-4e3a-a557-357b8ee62a0c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-bb28773d-0ff4-4e3a-a557-357b8ee62a0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:27.180662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:27.181879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:27.182792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:27.182792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:27.182792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:27.187590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 424/856] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:27.192076 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28773d-0ff4-4e3a-a557-357b8ee62a0c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:27.192226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f23909-2cda-4184-9d83-a30888c7dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:27.192226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f23909-2cda-4184-9d83-a30888c7dc99 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:27.192226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f23909-2cda-4184-9d83-a30888c7dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:27.192226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f23909-2cda-4184-9d83-a30888c7dc99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:27.205763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:27.209056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f23909-2cda-4184-9d83-a30888c7dc99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:27.210631 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f23909-2cda-4184-9d83-a30888c7dc99 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-59f23909-2cda-4184-9d83-a30888c7dc99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:27.229292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:27.230489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:27.231626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:27.231626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:27.231626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:27.233329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 433/857] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:27.238737 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f23909-2cda-4184-9d83-a30888c7dc99 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:27.308646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28773d-0ff4-4e3a-a557-357b8ee62a0c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:27.345453 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915b8c1-e4ac-4c93-9bc1-aa0462a9cd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:27.346428 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915b8c1-e4ac-4c93-9bc1-aa0462a9cd9a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:27.347021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915b8c1-e4ac-4c93-9bc1-aa0462a9cd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:27.347609 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915b8c1-e4ac-4c93-9bc1-aa0462a9cd9a None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:27.348511 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915b8c1-e4ac-4c93-9bc1-aa0462a9cd9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:27.349061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915b8c1-e4ac-4c93-9bc1-aa0462a9cd9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:27.351015 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915b8c1-e4ac-4c93-9bc1-aa0462a9cd9a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:27.353999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f23909-2cda-4184-9d83-a30888c7dc99 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:27.369523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 425/858] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:27.370761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915b8c1-e4ac-4c93-9bc1-aa0462a9cd9a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:27.392065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9b5bf-06e3-4537-9404-74081deb6d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:27.392670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b5bf-06e3-4537-9404-74081deb6d88 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:27.392944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b5bf-06e3-4537-9404-74081deb6d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:27.393210 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b5bf-06e3-4537-9404-74081deb6d88 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:27.393867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9b5bf-06e3-4537-9404-74081deb6d88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:27.394164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9b5bf-06e3-4537-9404-74081deb6d88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:27.395522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9b5bf-06e3-4537-9404-74081deb6d88 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:27.416254 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 434/859] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:27.418135 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9b5bf-06e3-4537-9404-74081deb6d88 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:27.432660 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:27.479778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:27.485756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915b8c1-e4ac-4c93-9bc1-aa0462a9cd9a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:27.524507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7505c1d-4869-4e8f-8d98-7805db4ec510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:27.525602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7505c1d-4869-4e8f-8d98-7805db4ec510 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:27.526108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7505c1d-4869-4e8f-8d98-7805db4ec510 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:27.526574 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7505c1d-4869-4e8f-8d98-7805db4ec510 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:27.533932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9b5bf-06e3-4537-9404-74081deb6d88 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:27.534640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7505c1d-4869-4e8f-8d98-7805db4ec510 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:27.536563 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7505c1d-4869-4e8f-8d98-7805db4ec510 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e7505c1d-4869-4e8f-8d98-7805db4ec510 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:27.549349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:27.550288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:27.551238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:27.551238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:27.551238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:27.551238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:27.551238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:27.551238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:27.551238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:27.551238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:27.558470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 426/860] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:27.559716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7505c1d-4869-4e8f-8d98-7805db4ec510 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:27.570146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0c14b-16d7-4fb5-9d4b-870ccb523ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:27.571298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0c14b-16d7-4fb5-9d4b-870ccb523ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:27.571573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0c14b-16d7-4fb5-9d4b-870ccb523ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:27.571849 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0c14b-16d7-4fb5-9d4b-870ccb523ac0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:27.580364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0c14b-16d7-4fb5-9d4b-870ccb523ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:27.581964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0c14b-16d7-4fb5-9d4b-870ccb523ac0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-8af0c14b-16d7-4fb5-9d4b-870ccb523ac0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:27.595982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:27.597068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:27.598069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:27.598069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:27.598069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:27.598069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:27.598069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:27.598069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:27.598069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:27.598069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:27.598069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 03:12:27.598069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:27.601334 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 435/861] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 03:12:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:27.603732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0c14b-16d7-4fb5-9d4b-870ccb523ac0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:27.680973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7505c1d-4869-4e8f-8d98-7805db4ec510 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:27.696935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:27.722111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebd30f-2aa7-4dc9-a4f4-4c99d3f456d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:27.723047 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebd30f-2aa7-4dc9-a4f4-4c99d3f456d8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:27.723588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebd30f-2aa7-4dc9-a4f4-4c99d3f456d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:27.724156 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebd30f-2aa7-4dc9-a4f4-4c99d3f456d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:27.725048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebd30f-2aa7-4dc9-a4f4-4c99d3f456d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:27.725592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebd30f-2aa7-4dc9-a4f4-4c99d3f456d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:27.727055 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0c14b-16d7-4fb5-9d4b-870ccb523ac0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:27.727500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebd30f-2aa7-4dc9-a4f4-4c99d3f456d8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:27.741212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 427/862] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:27.742938 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:27.751194 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebd30f-2aa7-4dc9-a4f4-4c99d3f456d8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:27.771054 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d156f-4260-4b32-ac5d-9cc7b060f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:27.771723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d156f-4260-4b32-ac5d-9cc7b060f353 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:27.771932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d156f-4260-4b32-ac5d-9cc7b060f353 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:27.772356 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d156f-4260-4b32-ac5d-9cc7b060f353 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:27.774326 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d156f-4260-4b32-ac5d-9cc7b060f353 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:27.774891 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d156f-4260-4b32-ac5d-9cc7b060f353 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:27.776916 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d156f-4260-4b32-ac5d-9cc7b060f353 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:27.797539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 436/863] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 13 03:12:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:27.802731 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101ed8c-dcdc-4a65-afdd-5461325f49a5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:27.803025 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101ed8c-dcdc-4a65-afdd-5461325f49a5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:27.803336 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101ed8c-dcdc-4a65-afdd-5461325f49a5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:27.804637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 437/864] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:27.805428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101ed8c-dcdc-4a65-afdd-5461325f49a5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:27.864871 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebd30f-2aa7-4dc9-a4f4-4c99d3f456d8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:27.901886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d758c0-540c-4fa3-83ce-91a938b33088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:27.902902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d758c0-540c-4fa3-83ce-91a938b33088 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:27.903384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d758c0-540c-4fa3-83ce-91a938b33088 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:27.903834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d758c0-540c-4fa3-83ce-91a938b33088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:27.904843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d758c0-540c-4fa3-83ce-91a938b33088 None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=bd3284a5c047425d8148f178eee4069d) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:27.905455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d758c0-540c-4fa3-83ce-91a938b33088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:27.907072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d758c0-540c-4fa3-83ce-91a938b33088 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:27.908848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101ed8c-dcdc-4a65-afdd-5461325f49a5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:27.925547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 428/865] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:27 2022] GET /identity/v3/role_assignments?user.id=bd3284a5c047425d8148f178eee4069d&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:27.927259 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f63e64-3457-4a23-bc71-ef81c56c82a0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:27.927741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f63e64-3457-4a23-bc71-ef81c56c82a0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:27.928087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f63e64-3457-4a23-bc71-ef81c56c82a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:27.950911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-95f63e64-3457-4a23-bc71-ef81c56c82a0 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:27.952130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-95f63e64-3457-4a23-bc71-ef81c56c82a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:27.961073 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16d83a-943b-445a-97af-f9ca9713afbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:27.961801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16d83a-943b-445a-97af-f9ca9713afbd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:27.962082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16d83a-943b-445a-97af-f9ca9713afbd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:27.962416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16d83a-943b-445a-97af-f9ca9713afbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:27.984429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:28.024518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:28.043160 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 429/866] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:28.063100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16d83a-943b-445a-97af-f9ca9713afbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:28.064963 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16d83a-943b-445a-97af-f9ca9713afbd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:28.181376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 438/867] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:12:28.186748 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f63e64-3457-4a23-bc71-ef81c56c82a0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:28.291656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f63e64-3457-4a23-bc71-ef81c56c82a0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:28.324962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16d83a-943b-445a-97af-f9ca9713afbd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:28.332582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4ce6-4ea0-4443-a48c-9f111eba339b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:28.333541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4ce6-4ea0-4443-a48c-9f111eba339b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:28.334028 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4ce6-4ea0-4443-a48c-9f111eba339b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:28.334500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4ce6-4ea0-4443-a48c-9f111eba339b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:28.347226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b4ce6-4ea0-4443-a48c-9f111eba339b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:28.349732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b4ce6-4ea0-4443-a48c-9f111eba339b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-c34b4ce6-4ea0-4443-a48c-9f111eba339b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:28.368523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:28.369586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:28.370479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:28.370479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:28.370479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:28.372890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 430/868] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:28.382525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4ce6-4ea0-4443-a48c-9f111eba339b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:28.420980 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:28.422692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:28.462985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16d83a-943b-445a-97af-f9ca9713afbd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:28.493297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4ce6-4ea0-4443-a48c-9f111eba339b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:28.502718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8666b84-a5eb-4707-a4a0-eb27aad5d71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:28.503332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8666b84-a5eb-4707-a4a0-eb27aad5d71e None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:28.503620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8666b84-a5eb-4707-a4a0-eb27aad5d71e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:28.503891 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8666b84-a5eb-4707-a4a0-eb27aad5d71e None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:28.504574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8666b84-a5eb-4707-a4a0-eb27aad5d71e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:28.505978 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8666b84-a5eb-4707-a4a0-eb27aad5d71e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:28.531155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e7e2c-8d2c-4056-a9da-aa0db1e20524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:28.531866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7e2c-8d2c-4056-a9da-aa0db1e20524 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:28.532207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7e2c-8d2c-4056-a9da-aa0db1e20524 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:28.532544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7e2c-8d2c-4056-a9da-aa0db1e20524 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:28.533287 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e7e2c-8d2c-4056-a9da-aa0db1e20524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:28.533668 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e7e2c-8d2c-4056-a9da-aa0db1e20524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:28.535097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e7e2c-8d2c-4056-a9da-aa0db1e20524 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:28.546653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 431/869] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:28.547754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f607535-7613-4a9b-93d9-c0034ec68ed1 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:28.548034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f607535-7613-4a9b-93d9-c0034ec68ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:28.548303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f607535-7613-4a9b-93d9-c0034ec68ed1 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:28.549681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 432/870] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:28.551954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f607535-7613-4a9b-93d9-c0034ec68ed1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:28.596470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 439/871] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:12:28 2022] POST /identity/v3/services => generated 269 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:12:28.598113 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46b7da-6e4f-4664-9046-3dba7ef642b4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:28.598400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46b7da-6e4f-4664-9046-3dba7ef642b4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:28.598667 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46b7da-6e4f-4664-9046-3dba7ef642b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:28.618302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7a46b7da-6e4f-4664-9046-3dba7ef642b4 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:28.619535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7a46b7da-6e4f-4664-9046-3dba7ef642b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:28.654244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:28.686611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f607535-7613-4a9b-93d9-c0034ec68ed1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:28.700943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 440/872] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:28 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:28.733501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110f04-45e8-4a83-a17c-1b5d551343ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:28.734138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110f04-45e8-4a83-a17c-1b5d551343ac None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:28.734411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110f04-45e8-4a83-a17c-1b5d551343ac None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:28.734680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110f04-45e8-4a83-a17c-1b5d551343ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:28.743330 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75110f04-45e8-4a83-a17c-1b5d551343ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:28.744870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75110f04-45e8-4a83-a17c-1b5d551343ac None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-75110f04-45e8-4a83-a17c-1b5d551343ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:28.758607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:28.760238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:28.761129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:28.761129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:28.761129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:28.761129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:28.761129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:28.761129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:28.761129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:28.761129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:28.761129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 433/873] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:28.768066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46b7da-6e4f-4664-9046-3dba7ef642b4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:28.833329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:28.875116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46b7da-6e4f-4664-9046-3dba7ef642b4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:28.912113 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb0b29-44c0-4a74-8404-3d1d73a7fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:28.913114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb0b29-44c0-4a74-8404-3d1d73a7fc28 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:28.913646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb0b29-44c0-4a74-8404-3d1d73a7fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:28.914165 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb0b29-44c0-4a74-8404-3d1d73a7fc28 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:28.915348 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb0b29-44c0-4a74-8404-3d1d73a7fc28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:28.915883 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb0b29-44c0-4a74-8404-3d1d73a7fc28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:28.917617 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb0b29-44c0-4a74-8404-3d1d73a7fc28 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:28.932291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 441/874] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:28.938540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110f04-45e8-4a83-a17c-1b5d551343ac None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:29.000179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb0b29-44c0-4a74-8404-3d1d73a7fc28 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:29.045795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110f04-45e8-4a83-a17c-1b5d551343ac None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:29.088331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105fcd39-4c7f-470a-b2de-bef5156b52e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:29.089357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fcd39-4c7f-470a-b2de-bef5156b52e7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:29.089992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fcd39-4c7f-470a-b2de-bef5156b52e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:29.090481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105fcd39-4c7f-470a-b2de-bef5156b52e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:29.091915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fcd39-4c7f-470a-b2de-bef5156b52e7 None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=18e869f4ca35451583107ca7607e1861) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:29.092434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fcd39-4c7f-470a-b2de-bef5156b52e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:29.095073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105fcd39-4c7f-470a-b2de-bef5156b52e7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:29.097654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:29.109515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 434/875] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:28 2022] GET /identity/v3/role_assignments?user.id=18e869f4ca35451583107ca7607e1861&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:29.122560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb0b29-44c0-4a74-8404-3d1d73a7fc28 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:29.148743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:29.169944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19a734-15f5-45dd-9647-5a94fd2033b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:29.170563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a734-15f5-45dd-9647-5a94fd2033b8 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:29.170842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a734-15f5-45dd-9647-5a94fd2033b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:29.171115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a734-15f5-45dd-9647-5a94fd2033b8 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:29.171793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19a734-15f5-45dd-9647-5a94fd2033b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:29.173174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19a734-15f5-45dd-9647-5a94fd2033b8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:29.276468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 442/876] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:12:28 2022] POST /identity/v3/services => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:12:30.204942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00bde-c29b-439f-8484-fe9596071c6a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:30.205514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00bde-c29b-439f-8484-fe9596071c6a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:30.205514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00bde-c29b-439f-8484-fe9596071c6a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:30.206957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 435/877] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:30.212333 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd196995-7ebe-44ed-9374-8d89f8fb177a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:30.212721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd196995-7ebe-44ed-9374-8d89f8fb177a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:30.212884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd196995-7ebe-44ed-9374-8d89f8fb177a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:30.231403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cd196995-7ebe-44ed-9374-8d89f8fb177a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:30.232592 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cd196995-7ebe-44ed-9374-8d89f8fb177a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:30.312201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 443/878] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:30.577566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e00bde-c29b-439f-8484-fe9596071c6a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:30.687482 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e00bde-c29b-439f-8484-fe9596071c6a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:30.723215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a3b2f-c12d-4aa2-b9b7-315843a01714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:30.723851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a3b2f-c12d-4aa2-b9b7-315843a01714 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:30.724132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a3b2f-c12d-4aa2-b9b7-315843a01714 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:30.724408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a3b2f-c12d-4aa2-b9b7-315843a01714 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:30.724990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a3b2f-c12d-4aa2-b9b7-315843a01714 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:30.726423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a3b2f-c12d-4aa2-b9b7-315843a01714 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-668a3b2f-c12d-4aa2-b9b7-315843a01714 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:30.735752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:30.736746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:30.737616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 436/879] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 03:12:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:30.745134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd196995-7ebe-44ed-9374-8d89f8fb177a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:30.857611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd196995-7ebe-44ed-9374-8d89f8fb177a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:30.865271 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:30.895674 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bc2da-1631-46d6-85dc-4611ff9ef93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:30.896288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bc2da-1631-46d6-85dc-4611ff9ef93a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:30.896568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bc2da-1631-46d6-85dc-4611ff9ef93a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:30.896838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bc2da-1631-46d6-85dc-4611ff9ef93a None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:30.897658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bc2da-1631-46d6-85dc-4611ff9ef93a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:30.897965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bc2da-1631-46d6-85dc-4611ff9ef93a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:30.900163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bc2da-1631-46d6-85dc-4611ff9ef93a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:30.906153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 444/880] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 03:12:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:30.914900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a3b2f-c12d-4aa2-b9b7-315843a01714 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:30.926233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362bec5-927c-462c-a46e-941eb82b3cf6 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:30.926532 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362bec5-927c-462c-a46e-941eb82b3cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:30.926783 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362bec5-927c-462c-a46e-941eb82b3cf6 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:30.928324 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 445/881] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:12:30.933412 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed8f4d-2eb3-469d-b368-49d500ef3c91 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:30.943877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed8f4d-2eb3-469d-b368-49d500ef3c91 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:30.943877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed8f4d-2eb3-469d-b368-49d500ef3c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:30.953121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a4ed8f4d-2eb3-469d-b368-49d500ef3c91 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:30.954611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a4ed8f4d-2eb3-469d-b368-49d500ef3c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:30.985765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:31.034499 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a3b2f-c12d-4aa2-b9b7-315843a01714 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:31.036142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 446/882] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:31.078381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea719cb-ee2f-4aca-bd5c-b025207f6a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:31.078999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea719cb-ee2f-4aca-bd5c-b025207f6a72 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:31.079273 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea719cb-ee2f-4aca-bd5c-b025207f6a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:31.079541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea719cb-ee2f-4aca-bd5c-b025207f6a72 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:31.080160 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea719cb-ee2f-4aca-bd5c-b025207f6a72 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:31.080459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea719cb-ee2f-4aca-bd5c-b025207f6a72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:31.081911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea719cb-ee2f-4aca-bd5c-b025207f6a72 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:31.087516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 437/883] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 03:12:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:31.314660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed8f4d-2eb3-469d-b368-49d500ef3c91 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:31.348861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d208a7a-fdca-4066-9d2d-b9990d4b1310 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:31.349388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d208a7a-fdca-4066-9d2d-b9990d4b1310 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:31.349465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d208a7a-fdca-4066-9d2d-b9990d4b1310 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:31.350989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 438/884] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:31.356178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549df92-8ecc-4ed5-9031-64d73c8be153 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:31.356452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549df92-8ecc-4ed5-9031-64d73c8be153 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:31.356719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549df92-8ecc-4ed5-9031-64d73c8be153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:31.374756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3549df92-8ecc-4ed5-9031-64d73c8be153 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:31.375933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3549df92-8ecc-4ed5-9031-64d73c8be153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:31.421814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:31.427669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed8f4d-2eb3-469d-b368-49d500ef3c91 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:31.468822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cdb66-30f0-4aaa-8f2e-ad61b79a1f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:31.469627 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cdb66-30f0-4aaa-8f2e-ad61b79a1f5c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:31.469911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cdb66-30f0-4aaa-8f2e-ad61b79a1f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:31.470178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cdb66-30f0-4aaa-8f2e-ad61b79a1f5c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:31.470768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cdb66-30f0-4aaa-8f2e-ad61b79a1f5c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:31.472288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cdb66-30f0-4aaa-8f2e-ad61b79a1f5c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f54cdb66-30f0-4aaa-8f2e-ad61b79a1f5c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:31.483009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:31.484028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:31.484943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 447/885] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Sep 13 03:12:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:31.486411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 439/886] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:12:31.492694 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cdb66-30f0-4aaa-8f2e-ad61b79a1f5c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:31.571026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66690820-aa44-4b35-8a4a-81b762f6d32e None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:31.571302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66690820-aa44-4b35-8a4a-81b762f6d32e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:31.571573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66690820-aa44-4b35-8a4a-81b762f6d32e None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:31.576728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 440/887] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:31.578152 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513507-7bb7-4e92-a509-438a223866f9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:31.578431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513507-7bb7-4e92-a509-438a223866f9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:31.578700 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513507-7bb7-4e92-a509-438a223866f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:31.597573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-18513507-7bb7-4e92-a509-438a223866f9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:31.598749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-18513507-7bb7-4e92-a509-438a223866f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:31.602667 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cdb66-30f0-4aaa-8f2e-ad61b79a1f5c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:31.647955 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd8ce2-b120-4610-a0fb-228f1381bec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:31.649143 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd8ce2-b120-4610-a0fb-228f1381bec2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:31.649593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd8ce2-b120-4610-a0fb-228f1381bec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:31.650174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd8ce2-b120-4610-a0fb-228f1381bec2 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:31.650869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:31.651010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd8ce2-b120-4610-a0fb-228f1381bec2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:31.651314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd8ce2-b120-4610-a0fb-228f1381bec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:31.653004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd8ce2-b120-4610-a0fb-228f1381bec2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:31.659428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 448/888] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 03:12:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:31.665519 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd8ce2-b120-4610-a0fb-228f1381bec2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:31.677455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 441/889] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:12:31.697422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:31.756338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18513507-7bb7-4e92-a509-438a223866f9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:31.774183 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd8ce2-b120-4610-a0fb-228f1381bec2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:31.814502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ce4c4-8e00-4f1d-95c4-9e257984efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:31.815118 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ce4c4-8e00-4f1d-95c4-9e257984efc2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:31.815401 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ce4c4-8e00-4f1d-95c4-9e257984efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:31.815674 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ce4c4-8e00-4f1d-95c4-9e257984efc2 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:31.816302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ce4c4-8e00-4f1d-95c4-9e257984efc2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:31.816605 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ce4c4-8e00-4f1d-95c4-9e257984efc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:31.818109 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ce4c4-8e00-4f1d-95c4-9e257984efc2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:31.824243 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 449/890] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 03:12:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:31.830051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ce4c4-8e00-4f1d-95c4-9e257984efc2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:31.879142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18513507-7bb7-4e92-a509-438a223866f9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:31.925634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7a77d-c189-47ef-aef8-69ff87959c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:31.927277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7a77d-c189-47ef-aef8-69ff87959c80 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:31.928099 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7a77d-c189-47ef-aef8-69ff87959c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:31.928575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7a77d-c189-47ef-aef8-69ff87959c80 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:31.930881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:31.939753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ce4c4-8e00-4f1d-95c4-9e257984efc2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:31.946425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7a77d-c189-47ef-aef8-69ff87959c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-daf7a77d-c189-47ef-aef8-69ff87959c80 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:31.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:31.953680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:31.955205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:31.955205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:31.955205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:31.955205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:31.955205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:31.955205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:31.955205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:31.955205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:31.955205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:31.955205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:31.955205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 03:12:31.955205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:31.955205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 442/891] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 13 03:12:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:31.956011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7a77d-c189-47ef-aef8-69ff87959c80 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:31.985932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ed44-884a-492e-9aad-cc9081e4c524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:31.986553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ed44-884a-492e-9aad-cc9081e4c524 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:31.986833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ed44-884a-492e-9aad-cc9081e4c524 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:31.987107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ed44-884a-492e-9aad-cc9081e4c524 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:31.987796 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7ed44-884a-492e-9aad-cc9081e4c524 None admin] RBAC: Adding query filter params (interface=public, service_id=fbfd8bffac464cb2803823f559f19176, region_id=RegionOne) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:31.988111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7ed44-884a-492e-9aad-cc9081e4c524 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:31.989512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7ed44-884a-492e-9aad-cc9081e4c524 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:31.995402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 450/892] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 03:12:31 2022] GET /identity/v3/endpoints?service_id=fbfd8bffac464cb2803823f559f19176&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:32.001052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ed44-884a-492e-9aad-cc9081e4c524 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:32.012396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:32.068066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7a77d-c189-47ef-aef8-69ff87959c80 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:32.104869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ddc87-4bf0-4fac-8318-10359f53c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:32.105512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ddc87-4bf0-4fac-8318-10359f53c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:32.105788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ddc87-4bf0-4fac-8318-10359f53c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:32.106214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ddc87-4bf0-4fac-8318-10359f53c9a3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:32.106722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ddc87-4bf0-4fac-8318-10359f53c9a3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:32.108173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ddc87-4bf0-4fac-8318-10359f53c9a3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:32.109649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ed44-884a-492e-9aad-cc9081e4c524 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b03ddc87-4bf0-4fac-8318-10359f53c9a3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:32.117852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:32.118838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:32.119705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 443/893] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:12:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:32.120521 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ddc87-4bf0-4fac-8318-10359f53c9a3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:32.152779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772b031-31e8-473a-9aff-5a619ea60715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:32.153410 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772b031-31e8-473a-9aff-5a619ea60715 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:32.153693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772b031-31e8-473a-9aff-5a619ea60715 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:32.153964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772b031-31e8-473a-9aff-5a619ea60715 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:32.154622 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772b031-31e8-473a-9aff-5a619ea60715 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:32.154920 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772b031-31e8-473a-9aff-5a619ea60715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:32.156482 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772b031-31e8-473a-9aff-5a619ea60715 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:32.165144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 451/894] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 03:12:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:32.165856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772b031-31e8-473a-9aff-5a619ea60715 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:32.184684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:32.235946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ddc87-4bf0-4fac-8318-10359f53c9a3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:32.247200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:32.267616 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772b031-31e8-473a-9aff-5a619ea60715 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:32.270778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738bdae-ff21-43d6-828e-d676a3c62377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:32.271379 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738bdae-ff21-43d6-828e-d676a3c62377 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:32.271649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738bdae-ff21-43d6-828e-d676a3c62377 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:32.271913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738bdae-ff21-43d6-828e-d676a3c62377 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:32.272508 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738bdae-ff21-43d6-828e-d676a3c62377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:32.273927 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738bdae-ff21-43d6-828e-d676a3c62377 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:32.289300 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 444/895] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 03:12:32 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:12:32.289300 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738bdae-ff21-43d6-828e-d676a3c62377 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:32.316548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b57fb2-2690-46c6-bb9c-6c7bd0a1491e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:32.317314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b57fb2-2690-46c6-bb9c-6c7bd0a1491e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:32.317665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b57fb2-2690-46c6-bb9c-6c7bd0a1491e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:32.318005 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b57fb2-2690-46c6-bb9c-6c7bd0a1491e None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:32.318739 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b57fb2-2690-46c6-bb9c-6c7bd0a1491e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:32.319111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b57fb2-2690-46c6-bb9c-6c7bd0a1491e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:32.320633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b57fb2-2690-46c6-bb9c-6c7bd0a1491e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:32.327887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 452/896] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:12:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:32.333411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b57fb2-2690-46c6-bb9c-6c7bd0a1491e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:32.428708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:32.434622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738bdae-ff21-43d6-828e-d676a3c62377 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:32.456065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b57fb2-2690-46c6-bb9c-6c7bd0a1491e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:32.474973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff836e8-e041-4030-a4b4-04276e82ac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:32.474973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff836e8-e041-4030-a4b4-04276e82ac6b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:32.474973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff836e8-e041-4030-a4b4-04276e82ac6b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:32.474973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff836e8-e041-4030-a4b4-04276e82ac6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:32.491255 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff836e8-e041-4030-a4b4-04276e82ac6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:32.492803 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff836e8-e041-4030-a4b4-04276e82ac6b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-fff836e8-e041-4030-a4b4-04276e82ac6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:32.511008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:32.511987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:32.512883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:32.512883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:32.512883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:32.512883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 445/897] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:32.521368 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff836e8-e041-4030-a4b4-04276e82ac6b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:32.522207 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05fede-df78-4d24-a9bc-94b400c77f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:32.522827 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05fede-df78-4d24-a9bc-94b400c77f55 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:32.523660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05fede-df78-4d24-a9bc-94b400c77f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:32.523941 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05fede-df78-4d24-a9bc-94b400c77f55 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:32.524575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05fede-df78-4d24-a9bc-94b400c77f55 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:32.524876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05fede-df78-4d24-a9bc-94b400c77f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:32.526287 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05fede-df78-4d24-a9bc-94b400c77f55 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:32.531898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 453/898] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:12:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:32.537650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05fede-df78-4d24-a9bc-94b400c77f55 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:32.552489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:32.645996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff836e8-e041-4030-a4b4-04276e82ac6b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:32.661969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05fede-df78-4d24-a9bc-94b400c77f55 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:32.683054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786e35d-9451-47c9-bafc-65e36bf06147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:32.683670 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786e35d-9451-47c9-bafc-65e36bf06147 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:32.683949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786e35d-9451-47c9-bafc-65e36bf06147 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:32.684223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786e35d-9451-47c9-bafc-65e36bf06147 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:32.685053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786e35d-9451-47c9-bafc-65e36bf06147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:32.685164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786e35d-9451-47c9-bafc-65e36bf06147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:32.686552 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786e35d-9451-47c9-bafc-65e36bf06147 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:32.703637 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 446/899] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:32.704651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786e35d-9451-47c9-bafc-65e36bf06147 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:32.714286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc79c1-dde8-4365-8eda-62590021d532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:32.715321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc79c1-dde8-4365-8eda-62590021d532 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:32.715806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc79c1-dde8-4365-8eda-62590021d532 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:32.716327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc79c1-dde8-4365-8eda-62590021d532 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:32.717380 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc79c1-dde8-4365-8eda-62590021d532 None admin] RBAC: Adding query filter params (interface=public, service_id=b2fac7badc804e3dacfb6e0b138e4caa, region_id=RegionOne) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:32.717911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc79c1-dde8-4365-8eda-62590021d532 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:32.719577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc79c1-dde8-4365-8eda-62590021d532 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:32.727359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 454/900] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 03:12:32 2022] GET /identity/v3/endpoints?service_id=b2fac7badc804e3dacfb6e0b138e4caa&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:32.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc79c1-dde8-4365-8eda-62590021d532 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:32.749604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:32.811801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:32.827792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786e35d-9451-47c9-bafc-65e36bf06147 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:32.864024 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a08402-ef2c-4f78-9b11-dc60f171e303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:32.865004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a08402-ef2c-4f78-9b11-dc60f171e303 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:32.865547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a08402-ef2c-4f78-9b11-dc60f171e303 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:32.866050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a08402-ef2c-4f78-9b11-dc60f171e303 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:32.867201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc79c1-dde8-4365-8eda-62590021d532 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:32.873873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a08402-ef2c-4f78-9b11-dc60f171e303 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:32.875587 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a08402-ef2c-4f78-9b11-dc60f171e303 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-52a08402-ef2c-4f78-9b11-dc60f171e303 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:32.888455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:32.889450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:32.890419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:32.890419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:32.890419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:32.890419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:32.890419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:32.890419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:32.890419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:32.890419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:32.890419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 03:12:32.890419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:32.892903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 447/901] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 03:12:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:32.899688 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a08402-ef2c-4f78-9b11-dc60f171e303 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:32.915142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895575f-ab20-4920-9ac7-fab21655a7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:32.915142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895575f-ab20-4920-9ac7-fab21655a7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:32.915142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895575f-ab20-4920-9ac7-fab21655a7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:32.915142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895575f-ab20-4920-9ac7-fab21655a7d8 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:32.915729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895575f-ab20-4920-9ac7-fab21655a7d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:32.917365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895575f-ab20-4920-9ac7-fab21655a7d8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:32.928889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 455/902] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 03:12:32 2022] GET /identity/v3/services => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:12:33.020489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a08402-ef2c-4f78-9b11-dc60f171e303 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:33.058316 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b70fbf-861b-466b-8a1e-ee995c9c0edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:33.058941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b70fbf-861b-466b-8a1e-ee995c9c0edf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:33.059287 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b70fbf-861b-466b-8a1e-ee995c9c0edf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:33.059565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b70fbf-861b-466b-8a1e-ee995c9c0edf None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:33.060374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b70fbf-861b-466b-8a1e-ee995c9c0edf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:33.060746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b70fbf-861b-466b-8a1e-ee995c9c0edf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:33.062297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b70fbf-861b-466b-8a1e-ee995c9c0edf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:33.084249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 448/903] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 13 03:12:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:33.090773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895575f-ab20-4920-9ac7-fab21655a7d8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:33.176995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:33.203758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895575f-ab20-4920-9ac7-fab21655a7d8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:33.243812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48cb28-a752-457f-b902-191aa771b6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:33.244476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cb28-a752-457f-b902-191aa771b6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:33.244760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cb28-a752-457f-b902-191aa771b6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:33.245034 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cb28-a752-457f-b902-191aa771b6a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:33.314907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94231c22-2c53-4e22-822e-358bae2f9fd8 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:33.315097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94231c22-2c53-4e22-822e-358bae2f9fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:33.315367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94231c22-2c53-4e22-822e-358bae2f9fd8 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:33.316410 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48cb28-a752-457f-b902-191aa771b6a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:33.317367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 449/904] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:33.318498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48cb28-a752-457f-b902-191aa771b6a7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:33.322915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503f99-5960-4b6d-a34e-78a1643b2ee9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:33.323200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503f99-5960-4b6d-a34e-78a1643b2ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:33.323470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503f99-5960-4b6d-a34e-78a1643b2ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:33.331092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:33.343304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-04503f99-5960-4b6d-a34e-78a1643b2ee9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:33.344638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-04503f99-5960-4b6d-a34e-78a1643b2ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:33.396192 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:33.422895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 456/906] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:33 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:12:33.423063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 450/906] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:12:33.433282 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04503f99-5960-4b6d-a34e-78a1643b2ee9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:33.531755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04503f99-5960-4b6d-a34e-78a1643b2ee9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:33.567383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3b82e-0cae-4831-9da5-62ea2ea06960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:33.567940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3b82e-0cae-4831-9da5-62ea2ea06960 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:33.568217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3b82e-0cae-4831-9da5-62ea2ea06960 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:33.568483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3b82e-0cae-4831-9da5-62ea2ea06960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:33.570919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:33.579806 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3b82e-0cae-4831-9da5-62ea2ea06960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:33.581345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3b82e-0cae-4831-9da5-62ea2ea06960 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-59f3b82e-0cae-4831-9da5-62ea2ea06960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:33.596581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:33.597651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:33.598538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:33.598538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:33.598538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:33.598538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 451/907] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:33.603627 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48cb28-a752-457f-b902-191aa771b6a7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:33.708185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48cb28-a752-457f-b902-191aa771b6a7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:33.718333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3b82e-0cae-4831-9da5-62ea2ea06960 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:33.750468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0caf6a-c35c-4fb3-8f5b-3f9f990bd589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:33.751075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0caf6a-c35c-4fb3-8f5b-3f9f990bd589 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:33.751348 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0caf6a-c35c-4fb3-8f5b-3f9f990bd589 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:33.751614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0caf6a-c35c-4fb3-8f5b-3f9f990bd589 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:33.752247 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0caf6a-c35c-4fb3-8f5b-3f9f990bd589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:33.752548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0caf6a-c35c-4fb3-8f5b-3f9f990bd589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:33.753988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0caf6a-c35c-4fb3-8f5b-3f9f990bd589 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:33.767748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 457/908] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:33.775290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0caf6a-c35c-4fb3-8f5b-3f9f990bd589 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:33.812634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:33.853558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3b82e-0cae-4831-9da5-62ea2ea06960 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:33.892275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e0dc2-cc08-40d7-beb0-0eb56a79e6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:33.893040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e0dc2-cc08-40d7-beb0-0eb56a79e6f3 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:33.893424 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e0dc2-cc08-40d7-beb0-0eb56a79e6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:33.893758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e0dc2-cc08-40d7-beb0-0eb56a79e6f3 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:33.894497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e0dc2-cc08-40d7-beb0-0eb56a79e6f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:33.896143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e0dc2-cc08-40d7-beb0-0eb56a79e6f3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:33.899090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0caf6a-c35c-4fb3-8f5b-3f9f990bd589 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:33.938143 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d580e0-d4db-4a80-b8af-0469f841af37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:33.938814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d580e0-d4db-4a80-b8af-0469f841af37 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:33.939087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d580e0-d4db-4a80-b8af-0469f841af37 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:33.939354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d580e0-d4db-4a80-b8af-0469f841af37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:33.946969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d580e0-d4db-4a80-b8af-0469f841af37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:33.948395 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d580e0-d4db-4a80-b8af-0469f841af37 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-07d580e0-d4db-4a80-b8af-0469f841af37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:33.959624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:33.960709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:33.961735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:33.961735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:33.961735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:33.961735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:33.961735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:33.961735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:33.961735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:33.961735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:33.961735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 458/909] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:33.966912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d580e0-d4db-4a80-b8af-0469f841af37 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:34.009406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 452/910] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:12:33 2022] POST /identity/v3/services => generated 241 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:12:34.086056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:34.094502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d580e0-d4db-4a80-b8af-0469f841af37 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:34.145382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336716f-ab57-4454-bf36-d893f3ef1765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:34.145382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336716f-ab57-4454-bf36-d893f3ef1765 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:34.145382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336716f-ab57-4454-bf36-d893f3ef1765 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:34.145382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336716f-ab57-4454-bf36-d893f3ef1765 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:34.147669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336716f-ab57-4454-bf36-d893f3ef1765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:34.147669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336716f-ab57-4454-bf36-d893f3ef1765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:34.147669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336716f-ab57-4454-bf36-d893f3ef1765 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:34.160439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 459/911] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:34.166759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e0dc2-cc08-40d7-beb0-0eb56a79e6f3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:34.221721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:34.279849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e0dc2-cc08-40d7-beb0-0eb56a79e6f3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:34.315881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2641a-0fa3-4a3a-86b7-3532dd5f684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:34.316487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2641a-0fa3-4a3a-86b7-3532dd5f684b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:34.316757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2641a-0fa3-4a3a-86b7-3532dd5f684b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:34.317089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2641a-0fa3-4a3a-86b7-3532dd5f684b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:34.317845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2641a-0fa3-4a3a-86b7-3532dd5f684b None admin] RBAC: Adding query filter params (role.id=616b42d92159431199afb1407a59b3b1, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=18e869f4ca35451583107ca7607e1861) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:34.318149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2641a-0fa3-4a3a-86b7-3532dd5f684b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:34.319747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2641a-0fa3-4a3a-86b7-3532dd5f684b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:34.325613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 453/912] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:34 2022] GET /identity/v3/role_assignments?user.id=18e869f4ca35451583107ca7607e1861&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=616b42d92159431199afb1407a59b3b1 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:34.561142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2ec0-8b84-4fc9-9233-2535fa05b794 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:34.561142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2ec0-8b84-4fc9-9233-2535fa05b794 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:34.561142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d2ec0-8b84-4fc9-9233-2535fa05b794 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:34.562145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 460/913] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:34.567430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1dbdb-bc53-4908-928b-774d76c4a8d9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:34.567828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1dbdb-bc53-4908-928b-774d76c4a8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:34.568005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1dbdb-bc53-4908-928b-774d76c4a8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:34.589677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0ea1dbdb-bc53-4908-928b-774d76c4a8d9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:34.591201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0ea1dbdb-bc53-4908-928b-774d76c4a8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:34.660712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 454/914] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:34.931830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d2ec0-8b84-4fc9-9233-2535fa05b794 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:35.042153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d2ec0-8b84-4fc9-9233-2535fa05b794 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:35.078116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c50770-0c0b-44cb-a668-b9d52e93b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:35.078752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c50770-0c0b-44cb-a668-b9d52e93b4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:35.079031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c50770-0c0b-44cb-a668-b9d52e93b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:35.079448 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c50770-0c0b-44cb-a668-b9d52e93b4c2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:35.080038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c50770-0c0b-44cb-a668-b9d52e93b4c2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:35.081441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c50770-0c0b-44cb-a668-b9d52e93b4c2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f2c50770-0c0b-44cb-a668-b9d52e93b4c2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:35.090394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:35.091330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:35.092222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 461/915] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Sep 13 03:12:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:35.099567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1dbdb-bc53-4908-928b-774d76c4a8d9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:35.153629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:35.214982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1dbdb-bc53-4908-928b-774d76c4a8d9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:35.254335 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02359965-53e0-44a0-9c32-bbca6da5df9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:35.255003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359965-53e0-44a0-9c32-bbca6da5df9f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:35.255274 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359965-53e0-44a0-9c32-bbca6da5df9f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:35.255541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02359965-53e0-44a0-9c32-bbca6da5df9f None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:35.256223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02359965-53e0-44a0-9c32-bbca6da5df9f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:35.256524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02359965-53e0-44a0-9c32-bbca6da5df9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:35.257975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02359965-53e0-44a0-9c32-bbca6da5df9f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:35.263452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 455/916] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 03:12:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:35.268752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6877950-1f03-4e66-a031-55af0111e1fc None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:35.269040 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6877950-1f03-4e66-a031-55af0111e1fc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:35.269352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6877950-1f03-4e66-a031-55af0111e1fc None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:35.269777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02359965-53e0-44a0-9c32-bbca6da5df9f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:35.270881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 462/917] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:35.275817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5d9f5-f4dd-4d65-b83a-6fd9f402697c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:35.276098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5d9f5-f4dd-4d65-b83a-6fd9f402697c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:35.276370 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5d9f5-f4dd-4d65-b83a-6fd9f402697c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:35.295036 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-78e5d9f5-f4dd-4d65-b83a-6fd9f402697c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:35.296643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-78e5d9f5-f4dd-4d65-b83a-6fd9f402697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:35.307905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:35.384882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02359965-53e0-44a0-9c32-bbca6da5df9f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:35.387948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:35.390023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 463/918] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:35.425017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18cb55-163b-4b89-9a5f-e682531a1271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:35.426056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18cb55-163b-4b89-9a5f-e682531a1271 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:35.426547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18cb55-163b-4b89-9a5f-e682531a1271 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:35.427057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18cb55-163b-4b89-9a5f-e682531a1271 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:35.427881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18cb55-163b-4b89-9a5f-e682531a1271 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:35.428418 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18cb55-163b-4b89-9a5f-e682531a1271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:35.430127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18cb55-163b-4b89-9a5f-e682531a1271 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:35.435577 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 456/919] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 03:12:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:35.441443 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5d9f5-f4dd-4d65-b83a-6fd9f402697c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:35.548757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5d9f5-f4dd-4d65-b83a-6fd9f402697c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:35.583161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1d5a3-f05c-4a05-883b-0c98b210b26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:35.583785 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1d5a3-f05c-4a05-883b-0c98b210b26d None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:35.584021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1d5a3-f05c-4a05-883b-0c98b210b26d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:35.584291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1d5a3-f05c-4a05-883b-0c98b210b26d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:35.585015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1d5a3-f05c-4a05-883b-0c98b210b26d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:35.587017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1d5a3-f05c-4a05-883b-0c98b210b26d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:35.665803 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18cb55-163b-4b89-9a5f-e682531a1271 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:35.676202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:35.683625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 464/920] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:12:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:12:35.805593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18cb55-163b-4b89-9a5f-e682531a1271 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:35.852084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde605c8-da76-4f87-8007-98fe40b2ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:35.853138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde605c8-da76-4f87-8007-98fe40b2ee0b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:35.853675 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde605c8-da76-4f87-8007-98fe40b2ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:35.854154 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde605c8-da76-4f87-8007-98fe40b2ee0b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:35.854967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde605c8-da76-4f87-8007-98fe40b2ee0b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:35.856787 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde605c8-da76-4f87-8007-98fe40b2ee0b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-bde605c8-da76-4f87-8007-98fe40b2ee0b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:35.867570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:35.868645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 03:12:35.869566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:35.872485 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 457/921] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:12:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:35.878574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1d5a3-f05c-4a05-883b-0c98b210b26d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:35.986123 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1d5a3-f05c-4a05-883b-0c98b210b26d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:36.023202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40dfcb-efd1-472c-b6a2-dc287fd7c6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:36.024180 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40dfcb-efd1-472c-b6a2-dc287fd7c6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:36.024668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40dfcb-efd1-472c-b6a2-dc287fd7c6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:36.025168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40dfcb-efd1-472c-b6a2-dc287fd7c6f0 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:36.026039 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40dfcb-efd1-472c-b6a2-dc287fd7c6f0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:36.026548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40dfcb-efd1-472c-b6a2-dc287fd7c6f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:36.028202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40dfcb-efd1-472c-b6a2-dc287fd7c6f0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:36.033657 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 465/922] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:12:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:36.039439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde605c8-da76-4f87-8007-98fe40b2ee0b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:36.070547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:36.164013 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde605c8-da76-4f87-8007-98fe40b2ee0b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:36.201041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c9a1d-7d27-4db6-93fb-c6f9d1841ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:36.202154 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c9a1d-7d27-4db6-93fb-c6f9d1841ede None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:36.202656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c9a1d-7d27-4db6-93fb-c6f9d1841ede None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:36.203128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c9a1d-7d27-4db6-93fb-c6f9d1841ede None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:36.203957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c9a1d-7d27-4db6-93fb-c6f9d1841ede None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:36.204458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c9a1d-7d27-4db6-93fb-c6f9d1841ede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:36.206077 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c9a1d-7d27-4db6-93fb-c6f9d1841ede None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:36.212321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 458/923] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Sep 13 03:12:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:36.218142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40dfcb-efd1-472c-b6a2-dc287fd7c6f0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:36.260216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafedd2-22c0-4e9f-a7e9-affdf575065a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:36.260539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafedd2-22c0-4e9f-a7e9-affdf575065a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:36.260762 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafedd2-22c0-4e9f-a7e9-affdf575065a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:36.263217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 459/924] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:12:36.268607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0493728-d6f9-4fad-aeb9-961b16727d67 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:36.268893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0493728-d6f9-4fad-aeb9-961b16727d67 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:36.269166 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0493728-d6f9-4fad-aeb9-961b16727d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:36.291340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d0493728-d6f9-4fad-aeb9-961b16727d67 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:36.293145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:36.294124 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d0493728-d6f9-4fad-aeb9-961b16727d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:36.339656 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40dfcb-efd1-472c-b6a2-dc287fd7c6f0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:36.382754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfd791-a487-4a43-8322-db7f6e39e55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:36.383431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfd791-a487-4a43-8322-db7f6e39e55e None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:36.383642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfd791-a487-4a43-8322-db7f6e39e55e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:36.384167 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfd791-a487-4a43-8322-db7f6e39e55e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:36.384844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfd791-a487-4a43-8322-db7f6e39e55e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:36.386460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfd791-a487-4a43-8322-db7f6e39e55e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:36.388825 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 460/925] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:12:36.504616 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 466/926] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:12:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:12:36.549740 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3ac8b-75cc-435f-b946-6da2d8381193 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:36.550057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3ac8b-75cc-435f-b946-6da2d8381193 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:36.550298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3ac8b-75cc-435f-b946-6da2d8381193 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:36.551934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 461/927] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:36.557595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73ba7d-f0de-4106-8014-49ae4629f699 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:36.557958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73ba7d-f0de-4106-8014-49ae4629f699 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:36.558160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73ba7d-f0de-4106-8014-49ae4629f699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:36.579453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4c73ba7d-f0de-4106-8014-49ae4629f699 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:36.580775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4c73ba7d-f0de-4106-8014-49ae4629f699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:36.665072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 467/928] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:36.699615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3ac8b-75cc-435f-b946-6da2d8381193 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:36.728307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:36.812996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3ac8b-75cc-435f-b946-6da2d8381193 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:36.849763 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683180b-9762-4b70-a247-f0583bea0bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:36.850762 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683180b-9762-4b70-a247-f0583bea0bee None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:36.851285 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683180b-9762-4b70-a247-f0583bea0bee None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:36.851761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683180b-9762-4b70-a247-f0583bea0bee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:36.852544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683180b-9762-4b70-a247-f0583bea0bee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:36.854327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683180b-9762-4b70-a247-f0583bea0bee None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f683180b-9762-4b70-a247-f0583bea0bee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:36.863764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:36.864860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:36.865844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:36.873479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 462/929] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 03:12:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:36.875038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73ba7d-f0de-4106-8014-49ae4629f699 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:36.931410 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:36.954406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683180b-9762-4b70-a247-f0583bea0bee None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:36.989598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73ba7d-f0de-4106-8014-49ae4629f699 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:37.028028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2f841-6693-43b0-b413-dbf420ca7a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:37.028646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2f841-6693-43b0-b413-dbf420ca7a2f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:37.028991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2f841-6693-43b0-b413-dbf420ca7a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:37.029289 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2f841-6693-43b0-b413-dbf420ca7a2f None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:37.029932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2f841-6693-43b0-b413-dbf420ca7a2f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:37.030237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2f841-6693-43b0-b413-dbf420ca7a2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:37.031609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2f841-6693-43b0-b413-dbf420ca7a2f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:37.037309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 468/930] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 03:12:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:37.043709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2f841-6693-43b0-b413-dbf420ca7a2f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:37.057899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:37.074245 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683180b-9762-4b70-a247-f0583bea0bee None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:37.111762 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc66cb-ad23-411d-8f11-5649c136c476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:37.112450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc66cb-ad23-411d-8f11-5649c136c476 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:37.112733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc66cb-ad23-411d-8f11-5649c136c476 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:37.113003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc66cb-ad23-411d-8f11-5649c136c476 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:37.127766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc66cb-ad23-411d-8f11-5649c136c476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e2cc66cb-ad23-411d-8f11-5649c136c476 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:37.136053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:37.136993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:37.142387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:37.142387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:37.142387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:37.142387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:37.142387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:37.142387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:37.142387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:37.142387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:37.142387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:37.142387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:37.142387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 03:12:37.142387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:37.142387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 463/931] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 13 03:12:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:37.145309 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc66cb-ad23-411d-8f11-5649c136c476 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:37.163797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2f841-6693-43b0-b413-dbf420ca7a2f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:37.176586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:37.203866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781edb89-db79-4b4c-a341-c5f3185450b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:37.204397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781edb89-db79-4b4c-a341-c5f3185450b8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:37.204679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781edb89-db79-4b4c-a341-c5f3185450b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:37.204948 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781edb89-db79-4b4c-a341-c5f3185450b8 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:37.205670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781edb89-db79-4b4c-a341-c5f3185450b8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:37.205966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781edb89-db79-4b4c-a341-c5f3185450b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:37.207369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781edb89-db79-4b4c-a341-c5f3185450b8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:37.218075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 469/932] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 03:12:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:37.220457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781edb89-db79-4b4c-a341-c5f3185450b8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:37.278650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc66cb-ad23-411d-8f11-5649c136c476 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:37.320274 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3708c-b370-4d48-ba7a-718be82dc93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:37.321875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3708c-b370-4d48-ba7a-718be82dc93d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:37.322613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3708c-b370-4d48-ba7a-718be82dc93d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:37.323095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3708c-b370-4d48-ba7a-718be82dc93d None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:37.324209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3708c-b370-4d48-ba7a-718be82dc93d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:37.325136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3708c-b370-4d48-ba7a-718be82dc93d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:37.327265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3708c-b370-4d48-ba7a-718be82dc93d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:37.333606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781edb89-db79-4b4c-a341-c5f3185450b8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:37.344757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 464/933] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 03:12:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:37.345914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3708c-b370-4d48-ba7a-718be82dc93d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:37.361132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:37.374053 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dad06-3c91-4e8b-86d5-f55ed8dd9ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:37.374735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dad06-3c91-4e8b-86d5-f55ed8dd9ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:37.375164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dad06-3c91-4e8b-86d5-f55ed8dd9ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:37.375558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dad06-3c91-4e8b-86d5-f55ed8dd9ad7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:37.376328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dad06-3c91-4e8b-86d5-f55ed8dd9ad7 None admin] RBAC: Adding query filter params (interface=public, service_id=d7008d4a834045aebd3caafc9000e590, region_id=RegionOne) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:37.377066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dad06-3c91-4e8b-86d5-f55ed8dd9ad7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:37.378675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dad06-3c91-4e8b-86d5-f55ed8dd9ad7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:37.390204 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 470/934] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 03:12:37 2022] GET /identity/v3/endpoints?service_id=d7008d4a834045aebd3caafc9000e590&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:37.391173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dad06-3c91-4e8b-86d5-f55ed8dd9ad7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:37.440751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:37.469615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3708c-b370-4d48-ba7a-718be82dc93d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:37.512101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dad06-3c91-4e8b-86d5-f55ed8dd9ad7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:37.513106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fe4a3-ee8b-4880-88ad-6c5d8315a512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:37.513847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fe4a3-ee8b-4880-88ad-6c5d8315a512 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:37.514211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fe4a3-ee8b-4880-88ad-6c5d8315a512 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:37.514642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fe4a3-ee8b-4880-88ad-6c5d8315a512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:37.526922 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fe4a3-ee8b-4880-88ad-6c5d8315a512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:37.528583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fe4a3-ee8b-4880-88ad-6c5d8315a512 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5a5fe4a3-ee8b-4880-88ad-6c5d8315a512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:37.545384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:37.546443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:37.547353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:37.547353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:37.547353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:37.551219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 465/935] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:37.552227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fe4a3-ee8b-4880-88ad-6c5d8315a512 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:37.556430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbacad0-85d3-41ba-bdb1-0d5af20b17d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:37.557293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbacad0-85d3-41ba-bdb1-0d5af20b17d0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:37.557734 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbacad0-85d3-41ba-bdb1-0d5af20b17d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:37.558151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbacad0-85d3-41ba-bdb1-0d5af20b17d0 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:37.558906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbacad0-85d3-41ba-bdb1-0d5af20b17d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:37.560499 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbacad0-85d3-41ba-bdb1-0d5af20b17d0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:37.573522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 471/936] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 03:12:37 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:12:37.629148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:37.682140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fe4a3-ee8b-4880-88ad-6c5d8315a512 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:37.720500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93107522-1d6b-417e-866f-cdd94400174b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:37.721998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93107522-1d6b-417e-866f-cdd94400174b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:37.722499 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93107522-1d6b-417e-866f-cdd94400174b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:37.722990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93107522-1d6b-417e-866f-cdd94400174b None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:37.723877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93107522-1d6b-417e-866f-cdd94400174b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:37.724415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93107522-1d6b-417e-866f-cdd94400174b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:37.726181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93107522-1d6b-417e-866f-cdd94400174b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:37.740329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 466/937] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:37.746449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbacad0-85d3-41ba-bdb1-0d5af20b17d0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:37.858945 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbacad0-85d3-41ba-bdb1-0d5af20b17d0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:37.861125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:37.896747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06200d0b-00ce-4b8f-af84-d3066109f920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:37.898102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06200d0b-00ce-4b8f-af84-d3066109f920 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:37.898911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06200d0b-00ce-4b8f-af84-d3066109f920 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:37.899181 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06200d0b-00ce-4b8f-af84-d3066109f920 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:37.906987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06200d0b-00ce-4b8f-af84-d3066109f920 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:37.911305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06200d0b-00ce-4b8f-af84-d3066109f920 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-06200d0b-00ce-4b8f-af84-d3066109f920 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:37.921158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:37.922383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:37.923655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:37.923655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:37.923655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:37.923655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:37.923655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:37.923655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:37.923655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:37.923655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:37.923655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 03:12:37.923655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:37.925849 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 472/938] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 03:12:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:37.933401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93107522-1d6b-417e-866f-cdd94400174b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:38.045732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93107522-1d6b-417e-866f-cdd94400174b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:38.068350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:38.068639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41f398-2070-4af3-9ee5-f97bacf39abf None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:38.068857 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41f398-2070-4af3-9ee5-f97bacf39abf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:38.069226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41f398-2070-4af3-9ee5-f97bacf39abf None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:38.070745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 473/939] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:38.075760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c3539-0576-42c8-8719-ba01524a8321 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:38.083809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c3539-0576-42c8-8719-ba01524a8321 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:38.083809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c3539-0576-42c8-8719-ba01524a8321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:38.085982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def7bd0-ce46-4cff-9770-bcb3b2e453d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:38.086588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def7bd0-ce46-4cff-9770-bcb3b2e453d6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:38.086863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def7bd0-ce46-4cff-9770-bcb3b2e453d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:38.087134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def7bd0-ce46-4cff-9770-bcb3b2e453d6 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:38.087866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def7bd0-ce46-4cff-9770-bcb3b2e453d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:38.088173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def7bd0-ce46-4cff-9770-bcb3b2e453d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:38.089622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def7bd0-ce46-4cff-9770-bcb3b2e453d6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:38.096712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-903c3539-0576-42c8-8719-ba01524a8321 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:38.098215 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-903c3539-0576-42c8-8719-ba01524a8321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:38.119132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 467/940] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 13 03:12:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:38.120896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def7bd0-ce46-4cff-9770-bcb3b2e453d6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:38.197558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 474/941] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:12:38.245404 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def7bd0-ce46-4cff-9770-bcb3b2e453d6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:38.283798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3c5d6-28bb-4897-8971-5102c3c52161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:38.284424 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3c5d6-28bb-4897-8971-5102c3c52161 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:38.284698 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3c5d6-28bb-4897-8971-5102c3c52161 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:38.284966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3c5d6-28bb-4897-8971-5102c3c52161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:38.295978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3c5d6-28bb-4897-8971-5102c3c52161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:38.297383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3c5d6-28bb-4897-8971-5102c3c52161 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-0ee3c5d6-28bb-4897-8971-5102c3c52161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:38.312963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:38.313987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:38.314875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:38.314875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:38.314875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:38.314875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 468/942] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:38.320382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c3539-0576-42c8-8719-ba01524a8321 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:38.418549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:38.427865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c3539-0576-42c8-8719-ba01524a8321 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:38.463479 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3c9e-1336-4841-998e-84830d0b143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:38.464089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3c9e-1336-4841-998e-84830d0b143a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:38.464365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3c9e-1336-4841-998e-84830d0b143a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:38.464639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3c9e-1336-4841-998e-84830d0b143a None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:38.465293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f3c9e-1336-4841-998e-84830d0b143a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:38.465602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f3c9e-1336-4841-998e-84830d0b143a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:38.466987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f3c9e-1336-4841-998e-84830d0b143a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:38.474382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3c5d6-28bb-4897-8971-5102c3c52161 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:38.484838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 475/943] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:38.486090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3c9e-1336-4841-998e-84830d0b143a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:38.507758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:38.584519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3c5d6-28bb-4897-8971-5102c3c52161 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:38.606950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3c9e-1336-4841-998e-84830d0b143a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:38.622662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e19fe-051b-4c87-b7d6-bf1999ffa0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:38.623583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e19fe-051b-4c87-b7d6-bf1999ffa0bf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:38.624080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e19fe-051b-4c87-b7d6-bf1999ffa0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:38.624568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e19fe-051b-4c87-b7d6-bf1999ffa0bf None admin] PATH_INFO: `/v3/services/compute` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:38.625408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e19fe-051b-4c87-b7d6-bf1999ffa0bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:38.626973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e19fe-051b-4c87-b7d6-bf1999ffa0bf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-554e19fe-051b-4c87-b7d6-bf1999ffa0bf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:38.636479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:38.637507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 03:12:38.638409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:38.645486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dd858-e63e-4fa0-beec-98f9e44c650b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:38.645647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dd858-e63e-4fa0-beec-98f9e44c650b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:38.645885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 469/944] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:38.645987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dd858-e63e-4fa0-beec-98f9e44c650b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:38.646157 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dd858-e63e-4fa0-beec-98f9e44c650b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:38.648207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e19fe-051b-4c87-b7d6-bf1999ffa0bf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:38.654016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dd858-e63e-4fa0-beec-98f9e44c650b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:38.655460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dd858-e63e-4fa0-beec-98f9e44c650b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-eb5dd858-e63e-4fa0-beec-98f9e44c650b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:38.668960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:38.670097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:38.671011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:38.671011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:38.671011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:38.671011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:38.671011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:38.671011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:38.671011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:38.671011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:38.675243 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 476/945] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:38.676851 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dd858-e63e-4fa0-beec-98f9e44c650b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:38.696610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:38.758783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:38.767034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e19fe-051b-4c87-b7d6-bf1999ffa0bf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:38.798754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dd858-e63e-4fa0-beec-98f9e44c650b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:38.803425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00acfac-028a-4b17-9940-3307ec5e50a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:38.804603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00acfac-028a-4b17-9940-3307ec5e50a6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:38.804883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00acfac-028a-4b17-9940-3307ec5e50a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:38.805157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00acfac-028a-4b17-9940-3307ec5e50a6 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:38.805817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00acfac-028a-4b17-9940-3307ec5e50a6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:38.806119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00acfac-028a-4b17-9940-3307ec5e50a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:38.807486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00acfac-028a-4b17-9940-3307ec5e50a6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:38.813425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 470/946] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 03:12:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:38.813425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977357-37e1-4cf6-bf55-dd4ca0cbe9c3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:38.813862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977357-37e1-4cf6-bf55-dd4ca0cbe9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:38.813972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977357-37e1-4cf6-bf55-dd4ca0cbe9c3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:38.815401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 471/947] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:38.817638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0977357-37e1-4cf6-bf55-dd4ca0cbe9c3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:38.837143 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb1e63-688c-457f-856c-1b9ef32816ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:38.838035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb1e63-688c-457f-856c-1b9ef32816ed None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:38.838458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb1e63-688c-457f-856c-1b9ef32816ed None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:38.838903 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb1e63-688c-457f-856c-1b9ef32816ed None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:38.839777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb1e63-688c-457f-856c-1b9ef32816ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:38.840077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb1e63-688c-457f-856c-1b9ef32816ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:38.841532 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb1e63-688c-457f-856c-1b9ef32816ed None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:38.861856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 477/948] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:38.861856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cf5e1-1bb0-45ea-a647-42fbb2b53856 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:38.861856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cf5e1-1bb0-45ea-a647-42fbb2b53856 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:38.861856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cf5e1-1bb0-45ea-a647-42fbb2b53856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:38.882091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f79cf5e1-1bb0-45ea-a647-42fbb2b53856 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:38.883292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f79cf5e1-1bb0-45ea-a647-42fbb2b53856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:38.921362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0977357-37e1-4cf6-bf55-dd4ca0cbe9c3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:38.957956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e43edc-6558-45fc-abeb-9f7580222ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:38.958947 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e43edc-6558-45fc-abeb-9f7580222ced None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:38.959461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e43edc-6558-45fc-abeb-9f7580222ced None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:38.959972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e43edc-6558-45fc-abeb-9f7580222ced None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:38.960767 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e43edc-6558-45fc-abeb-9f7580222ced None admin] RBAC: Adding query filter params (type=compute) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:38.961216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e43edc-6558-45fc-abeb-9f7580222ced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:38.962742 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e43edc-6558-45fc-abeb-9f7580222ced None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:38.963540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 478/949] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:38.964424 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cf5e1-1bb0-45ea-a647-42fbb2b53856 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:38.966833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:38.978161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 472/950] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 03:12:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:39.080765 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cf5e1-1bb0-45ea-a647-42fbb2b53856 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:39.120423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a602696-1019-45d2-9156-15bd7b250acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:39.121015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a602696-1019-45d2-9156-15bd7b250acf None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:39.121314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a602696-1019-45d2-9156-15bd7b250acf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:39.121589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a602696-1019-45d2-9156-15bd7b250acf None admin] PATH_INFO: `/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/18e869f4ca35451583107ca7607e1861/roles/616b42d92159431199afb1407a59b3b1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:39.123944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a602696-1019-45d2-9156-15bd7b250acf None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad922f6e2414214abe3ba1de67fc8de, user_id=18e869f4ca35451583107ca7607e1861, role_id=616b42d92159431199afb1407a59b3b1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:39.125499 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a602696-1019-45d2-9156-15bd7b250acf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:39.207300 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 479/951] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:12:38 2022] PUT /identity/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/18e869f4ca35451583107ca7607e1861/roles/616b42d92159431199afb1407a59b3b1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:12:39.251810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e43edc-6558-45fc-abeb-9f7580222ced None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:39.283701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:39.376230 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e43edc-6558-45fc-abeb-9f7580222ced None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:39.412658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84621d41-be99-4538-bdf1-403209fb7cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:39.413864 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84621d41-be99-4538-bdf1-403209fb7cc8 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:39.414147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84621d41-be99-4538-bdf1-403209fb7cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:39.414423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84621d41-be99-4538-bdf1-403209fb7cc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:39.415071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84621d41-be99-4538-bdf1-403209fb7cc8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:39.416525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84621d41-be99-4538-bdf1-403209fb7cc8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:39.419261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: WARNING keystone.server.flask.common [None req-84621d41-be99-4538-bdf1-403209fb7cc8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 03:12:39.469747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.sql.core [None req-84621d41-be99-4538-bdf1-403209fb7cc8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 03:12:39.469747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 03:12:39.469747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [parameters: {'id': 'f0f1a515201c41f5b9db42df67812ba7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 03:12:39.469747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81586) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 03:12:39.487603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-84621d41-be99-4538-bdf1-403209fb7cc8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f0f1a515201c41f5b9db42df67812ba7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f0f1a515201c41f5b9db42df67812ba7. Sep 13 03:12:39.487603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:39.487603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 03:12:39.487603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 03:12:39.487603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 03:12:39.487603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 03:12:39.487603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 03:12:39.487603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 03:12:39.487603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 03:12:39.487603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application conn.query(q) Sep 13 03:12:39.487603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 03:12:39.487603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 03:12:39.487603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application result.read() Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 03:12:39.488463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application next(self.gen) Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application yield resource Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application next(self.gen) Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise self.value Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application session.commit() Sep 13 03:12:39.489449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.session.flush() Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application compat.raise_( Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 03:12:39.491111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 03:12:39.493350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application conn.query(q) Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application result.read() Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 03:12:39.498007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [parameters: {'id': 'f0f1a515201c41f5b9db42df67812ba7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:39.498952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:39.499917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:39.501065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:39.501065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 03:12:39.501065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 03:12:39.501065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:39.501065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:39.501065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 03:12:39.501065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 03:12:39.501065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f0f1a515201c41f5b9db42df67812ba7. Sep 13 03:12:39.501065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:39.501065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 473/952] 10.222.0.48 () {60 vars in 1140 bytes} [Tue Sep 13 03:12:39 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:39.501718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a602696-1019-45d2-9156-15bd7b250acf None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:39.570230 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:39.609594 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a602696-1019-45d2-9156-15bd7b250acf None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:39.646265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6c4e2-152f-44b4-95fa-d7d18b1ebbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:39.647145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6c4e2-152f-44b4-95fa-d7d18b1ebbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:39.648184 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6c4e2-152f-44b4-95fa-d7d18b1ebbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:39.648620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6c4e2-152f-44b4-95fa-d7d18b1ebbd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:39.655885 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6c4e2-152f-44b4-95fa-d7d18b1ebbd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:39.657523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6c4e2-152f-44b4-95fa-d7d18b1ebbd3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-e8a6c4e2-152f-44b4-95fa-d7d18b1ebbd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:39.669390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:39.670477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:39.671669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:39.671669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:39.671669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:39.671669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:39.671669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:39.671669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:39.671669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:39.671669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:39.673896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 480/953] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:39.680084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84621d41-be99-4538-bdf1-403209fb7cc8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:39.768163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:39.794250 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84621d41-be99-4538-bdf1-403209fb7cc8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:39.829687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f34b17-ab94-4e13-8932-87b76967efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:39.830537 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f34b17-ab94-4e13-8932-87b76967efdc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:39.830994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f34b17-ab94-4e13-8932-87b76967efdc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:39.831425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f34b17-ab94-4e13-8932-87b76967efdc None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:39.832246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f34b17-ab94-4e13-8932-87b76967efdc None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:39.832712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f34b17-ab94-4e13-8932-87b76967efdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:39.834656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f34b17-ab94-4e13-8932-87b76967efdc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:39.856429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 474/954] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 03:12:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:39.882445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f00e9-8c45-4597-9e46-db21a388631e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:39.882981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f00e9-8c45-4597-9e46-db21a388631e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:39.883122 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f00e9-8c45-4597-9e46-db21a388631e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:39.885292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 481/955] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:39.891539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd2270-dc34-4be4-8e8b-29a8e47472ad None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:39.892081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd2270-dc34-4be4-8e8b-29a8e47472ad None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:39.892504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd2270-dc34-4be4-8e8b-29a8e47472ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:39.918468 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3efd2270-dc34-4be4-8e8b-29a8e47472ad None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:39.918468 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3efd2270-dc34-4be4-8e8b-29a8e47472ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:39.994097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 475/956] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:40.268764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f00e9-8c45-4597-9e46-db21a388631e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:40.375043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f00e9-8c45-4597-9e46-db21a388631e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:40.399075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:40.413506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7b534-4467-4f6f-a824-0bea1ac85e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:40.416248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7b534-4467-4f6f-a824-0bea1ac85e9e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:40.416248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7b534-4467-4f6f-a824-0bea1ac85e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:40.416248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7b534-4467-4f6f-a824-0bea1ac85e9e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:40.416248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7b534-4467-4f6f-a824-0bea1ac85e9e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:40.416550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7b534-4467-4f6f-a824-0bea1ac85e9e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-69a7b534-4467-4f6f-a824-0bea1ac85e9e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:40.425620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:40.426707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:40.427690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 482/957] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 03:12:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:40.435757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd2270-dc34-4be4-8e8b-29a8e47472ad None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:40.505591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:40.543458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd2270-dc34-4be4-8e8b-29a8e47472ad None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:40.579283 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856e3c-2ba8-4af1-8447-372c082b35bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:40.579895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856e3c-2ba8-4af1-8447-372c082b35bc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:40.580171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856e3c-2ba8-4af1-8447-372c082b35bc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:40.580441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856e3c-2ba8-4af1-8447-372c082b35bc None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:40.581072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856e3c-2ba8-4af1-8447-372c082b35bc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:40.581403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856e3c-2ba8-4af1-8447-372c082b35bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:40.582779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856e3c-2ba8-4af1-8447-372c082b35bc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:40.588560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 476/958] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 03:12:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:40.594260 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7b534-4467-4f6f-a824-0bea1ac85e9e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:40.700915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7b534-4467-4f6f-a824-0bea1ac85e9e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:40.735071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf542c3b-fe63-4ce4-ab55-56ef68047062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:40.735688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542c3b-fe63-4ce4-ab55-56ef68047062 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:40.735969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542c3b-fe63-4ce4-ab55-56ef68047062 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:40.736241 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542c3b-fe63-4ce4-ab55-56ef68047062 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:40.736880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf542c3b-fe63-4ce4-ab55-56ef68047062 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:40.737184 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf542c3b-fe63-4ce4-ab55-56ef68047062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:40.738588 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf542c3b-fe63-4ce4-ab55-56ef68047062 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:40.744453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 483/959] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 03:12:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:40.750092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856e3c-2ba8-4af1-8447-372c082b35bc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:40.855546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856e3c-2ba8-4af1-8447-372c082b35bc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:40.891702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:40.898434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20861990-447c-44b5-9b08-05c89c9d7cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:40.899276 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20861990-447c-44b5-9b08-05c89c9d7cba None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:40.909717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20861990-447c-44b5-9b08-05c89c9d7cba None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:40.909717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20861990-447c-44b5-9b08-05c89c9d7cba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:40.909717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20861990-447c-44b5-9b08-05c89c9d7cba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:40.909717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20861990-447c-44b5-9b08-05c89c9d7cba None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:40.971144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 477/960] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:12:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:12:41.257748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714614-8951-40e6-9bb3-4a564cf28d02 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:41.258279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714614-8951-40e6-9bb3-4a564cf28d02 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:41.258279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3714614-8951-40e6-9bb3-4a564cf28d02 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:41.260162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 484/961] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:41.265457 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0407389-471b-48ad-ba88-3f2ff51eb66d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:41.265750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0407389-471b-48ad-ba88-3f2ff51eb66d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:41.266029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0407389-471b-48ad-ba88-3f2ff51eb66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:41.285438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f0407389-471b-48ad-ba88-3f2ff51eb66d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:41.286647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f0407389-471b-48ad-ba88-3f2ff51eb66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:41.370267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 478/962] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:41.462513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c699c16-d50e-4292-a071-76774285652f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:41.462815 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c699c16-d50e-4292-a071-76774285652f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:41.463133 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c699c16-d50e-4292-a071-76774285652f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:41.464735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 485/963] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:41.470265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f28c08-04b1-492b-94cf-635117420b4b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:41.470817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f28c08-04b1-492b-94cf-635117420b4b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:41.471286 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f28c08-04b1-492b-94cf-635117420b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:41.489934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-40f28c08-04b1-492b-94cf-635117420b4b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:41.491921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-40f28c08-04b1-492b-94cf-635117420b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:41.565358 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 479/964] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:41.658117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c699c16-d50e-4292-a071-76774285652f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:41.712189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:41.765378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c699c16-d50e-4292-a071-76774285652f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:41.800500 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccefaf4-9caa-4443-a8bf-722cf53267b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:41.801114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccefaf4-9caa-4443-a8bf-722cf53267b1 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:41.801432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccefaf4-9caa-4443-a8bf-722cf53267b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:41.801816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccefaf4-9caa-4443-a8bf-722cf53267b1 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:41.802464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccefaf4-9caa-4443-a8bf-722cf53267b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:41.804441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccefaf4-9caa-4443-a8bf-722cf53267b1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:41.836576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f28c08-04b1-492b-94cf-635117420b4b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:41.882560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 486/965] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:12:41 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:12:41.890450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:41.960320 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f28c08-04b1-492b-94cf-635117420b4b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:42.009909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c627a-bfab-4d27-9e44-5f3abf56ad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:42.010974 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c627a-bfab-4d27-9e44-5f3abf56ad9e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:42.011463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c627a-bfab-4d27-9e44-5f3abf56ad9e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:42.012017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c627a-bfab-4d27-9e44-5f3abf56ad9e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:42.024747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c627a-bfab-4d27-9e44-5f3abf56ad9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-858c627a-bfab-4d27-9e44-5f3abf56ad9e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:42.031440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:42.032459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:42.033354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:42.033354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:42.033354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:42.033354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:42.033354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:42.033354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:42.033354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:42.033354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:42.033354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:42.033354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:42.033354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 03:12:42.033354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:42.036294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 480/966] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 13 03:12:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:42.043665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccefaf4-9caa-4443-a8bf-722cf53267b1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:42.160566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccefaf4-9caa-4443-a8bf-722cf53267b1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:42.167360 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda5d06-a6a2-4af2-8561-c0662a06550b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:42.168238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda5d06-a6a2-4af2-8561-c0662a06550b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:42.168517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda5d06-a6a2-4af2-8561-c0662a06550b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:42.170162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 481/967] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:42.171872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:42.175316 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb3b09-09a7-497b-a09d-33d5590dd8fb None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:42.175596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb3b09-09a7-497b-a09d-33d5590dd8fb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:42.175867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb3b09-09a7-497b-a09d-33d5590dd8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:42.195500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-66cb3b09-09a7-497b-a09d-33d5590dd8fb None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:42.196691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-66cb3b09-09a7-497b-a09d-33d5590dd8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:42.198219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e4c9-6c61-42b9-9b57-ff148e670ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:42.198827 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e4c9-6c61-42b9-9b57-ff148e670ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:42.199102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e4c9-6c61-42b9-9b57-ff148e670ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:42.200136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e4c9-6c61-42b9-9b57-ff148e670ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:42.200136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41e4c9-6c61-42b9-9b57-ff148e670ac6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:42.200802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41e4c9-6c61-42b9-9b57-ff148e670ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:42.206182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41e4c9-6c61-42b9-9b57-ff148e670ac6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:42.217698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 487/968] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 03:12:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:42.223521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e4c9-6c61-42b9-9b57-ff148e670ac6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:42.270973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 482/969] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:12:42.332649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e4c9-6c61-42b9-9b57-ff148e670ac6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:42.368391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55ea62-8dc5-4814-81b9-85600ff303fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:42.369020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55ea62-8dc5-4814-81b9-85600ff303fd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:42.369362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55ea62-8dc5-4814-81b9-85600ff303fd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:42.369642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55ea62-8dc5-4814-81b9-85600ff303fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:42.380089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55ea62-8dc5-4814-81b9-85600ff303fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:42.381577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55ea62-8dc5-4814-81b9-85600ff303fd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6b55ea62-8dc5-4814-81b9-85600ff303fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:42.396762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:42.398307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:42.399232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:42.399232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:42.399232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:42.399232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 488/970] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:42.405696 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb3b09-09a7-497b-a09d-33d5590dd8fb None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:42.437404 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:42.512334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb3b09-09a7-497b-a09d-33d5590dd8fb None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:42.551083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d43c3-ef13-4f5a-bd88-822f0751834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:42.551686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d43c3-ef13-4f5a-bd88-822f0751834f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:42.551960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d43c3-ef13-4f5a-bd88-822f0751834f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:42.552224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d43c3-ef13-4f5a-bd88-822f0751834f None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:42.552859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d43c3-ef13-4f5a-bd88-822f0751834f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:42.553155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d43c3-ef13-4f5a-bd88-822f0751834f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:42.554569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d43c3-ef13-4f5a-bd88-822f0751834f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:42.566127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 483/971] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:42.568909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55ea62-8dc5-4814-81b9-85600ff303fd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:42.572026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d43c3-ef13-4f5a-bd88-822f0751834f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:42.608569 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:42.665332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:42.675228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d43c3-ef13-4f5a-bd88-822f0751834f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:42.681637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55ea62-8dc5-4814-81b9-85600ff303fd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:42.715449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee1481-c7b4-4779-9b25-127a379b68a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:42.716226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee1481-c7b4-4779-9b25-127a379b68a7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:42.716630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee1481-c7b4-4779-9b25-127a379b68a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:42.716916 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee1481-c7b4-4779-9b25-127a379b68a7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:42.724461 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d755-6641-4102-acea-9b31c04167fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:42.725589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d755-6641-4102-acea-9b31c04167fd None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:42.726169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d755-6641-4102-acea-9b31c04167fd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:42.726629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee1481-c7b4-4779-9b25-127a379b68a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:42.726750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553d755-6641-4102-acea-9b31c04167fd None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:42.727558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553d755-6641-4102-acea-9b31c04167fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:42.728257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee1481-c7b4-4779-9b25-127a379b68a7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:42.729586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553d755-6641-4102-acea-9b31c04167fd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:42.732331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: WARNING keystone.server.flask.common [None req-6553d755-6641-4102-acea-9b31c04167fd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b6ee1481-c7b4-4779-9b25-127a379b68a7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:42.741354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:42.742322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:42.743639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:42.743639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:42.743639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:42.743639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:42.743639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:42.743639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:42.743639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:42.743639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:42.743639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 03:12:42.743639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:42.743639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 484/972] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 03:12:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:42.748057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee1481-c7b4-4779-9b25-127a379b68a7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:42.783757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.sql.core [None req-6553d755-6641-4102-acea-9b31c04167fd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 03:12:42.783757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 03:12:42.783757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [parameters: {'user_id': 'f9577d74c038424c96c972b4e9ff9000', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 03:12:42.783757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81585) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6553d755-6641-4102-acea-9b31c04167fd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Sep 13 03:12:42.791518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 03:12:42.792455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application yield resource Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise self.value Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application session.commit() Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 03:12:42.793445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.flush() Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application compat.raise_( Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 03:12:42.794398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 03:12:42.796098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 03:12:42.796964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f9577d74c038424c96c972b4e9ff9000', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:42.799002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 03:12:42.800014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 03:12:42.801193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 03:12:42.801193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 03:12:42.801193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 03:12:42.801193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 03:12:42.801193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 03:12:42.801193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:42.801193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 489/973] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Sep 13 03:12:42 2022] POST /identity/v3/users => generated 160 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:42.801193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d755-6641-4102-acea-9b31c04167fd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:42.893359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee1481-c7b4-4779-9b25-127a379b68a7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:42.913908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:42.922170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553d755-6641-4102-acea-9b31c04167fd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:42.935524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ca57-5324-4f82-8eef-d0df1b6c70f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:42.936129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ca57-5324-4f82-8eef-d0df1b6c70f3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:42.936406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ca57-5324-4f82-8eef-d0df1b6c70f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:42.936902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785ca57-5324-4f82-8eef-d0df1b6c70f3 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:42.937500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ca57-5324-4f82-8eef-d0df1b6c70f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:42.937805 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ca57-5324-4f82-8eef-d0df1b6c70f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:42.939241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785ca57-5324-4f82-8eef-d0df1b6c70f3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:42.962673 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 485/974] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Sep 13 03:12:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:42.963712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ca57-5324-4f82-8eef-d0df1b6c70f3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:42.971753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58938a-e72f-4f19-8716-61276987144d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:42.972469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58938a-e72f-4f19-8716-61276987144d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:42.978279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58938a-e72f-4f19-8716-61276987144d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:42.978279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58938a-e72f-4f19-8716-61276987144d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:42.978472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:42.980739 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58938a-e72f-4f19-8716-61276987144d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:42.982485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58938a-e72f-4f19-8716-61276987144d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5b58938a-e72f-4f19-8716-61276987144d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:42.996974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:42.998240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:42.999237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:42.999237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:42.999237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:42.999237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:42.999237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:42.999237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:42.999237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:42.999237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:42.999237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 03:12:42.999237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:43.004170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 490/975] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:12:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:43.005244 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58938a-e72f-4f19-8716-61276987144d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:43.090124 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785ca57-5324-4f82-8eef-d0df1b6c70f3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:43.127372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607d51b-3238-44ef-8e50-526d49aa9494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:43.128009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607d51b-3238-44ef-8e50-526d49aa9494 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:43.128290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607d51b-3238-44ef-8e50-526d49aa9494 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:43.128562 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607d51b-3238-44ef-8e50-526d49aa9494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:43.137611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58938a-e72f-4f19-8716-61276987144d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:43.184216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd383078-6a51-4fb3-aee5-12606884529e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:43.185485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd383078-6a51-4fb3-aee5-12606884529e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:43.186209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd383078-6a51-4fb3-aee5-12606884529e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:43.186633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd383078-6a51-4fb3-aee5-12606884529e None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:43.187635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd383078-6a51-4fb3-aee5-12606884529e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:43.188110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd383078-6a51-4fb3-aee5-12606884529e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:43.190047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd383078-6a51-4fb3-aee5-12606884529e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:43.208708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607d51b-3238-44ef-8e50-526d49aa9494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:43.210476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607d51b-3238-44ef-8e50-526d49aa9494 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:43.220933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:43.241530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 491/976] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Sep 13 03:12:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:43.243895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796faeb-4539-46ea-afe9-812052b5237e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:43.244239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796faeb-4539-46ea-afe9-812052b5237e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:43.244468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796faeb-4539-46ea-afe9-812052b5237e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:43.250577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 492/977] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:12:43.252040 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a813c-f12e-4cab-9203-7431733626da None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:43.252294 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a813c-f12e-4cab-9203-7431733626da None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:43.252578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a813c-f12e-4cab-9203-7431733626da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:43.269629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:43.272440 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bc0a813c-f12e-4cab-9203-7431733626da None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:43.274084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bc0a813c-f12e-4cab-9203-7431733626da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:43.346994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 486/978] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:42 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:12:43.348000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607d51b-3238-44ef-8e50-526d49aa9494 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:43.361631 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 493/979] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:43.455087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607d51b-3238-44ef-8e50-526d49aa9494 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:43.465285 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:43.495321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e754d52-0409-46d7-8304-86182562129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:43.496309 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754d52-0409-46d7-8304-86182562129f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:43.496794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754d52-0409-46d7-8304-86182562129f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:43.497460 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754d52-0409-46d7-8304-86182562129f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:43.508206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e754d52-0409-46d7-8304-86182562129f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:43.510179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e754d52-0409-46d7-8304-86182562129f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-0e754d52-0409-46d7-8304-86182562129f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:43.526004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:43.527198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:43.528298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:43.528298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:43.528298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:43.530284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 487/980] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:43.538870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a813c-f12e-4cab-9203-7431733626da None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:43.633623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e754d52-0409-46d7-8304-86182562129f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:43.643857 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a813c-f12e-4cab-9203-7431733626da None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:43.680203 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e92796-6bf4-49b4-8534-3a6039b6cb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:43.680806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e92796-6bf4-49b4-8534-3a6039b6cb22 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:43.681081 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e92796-6bf4-49b4-8534-3a6039b6cb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:43.681380 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e92796-6bf4-49b4-8534-3a6039b6cb22 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:43.682023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e92796-6bf4-49b4-8534-3a6039b6cb22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:43.682326 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e92796-6bf4-49b4-8534-3a6039b6cb22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:43.683690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e92796-6bf4-49b4-8534-3a6039b6cb22 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:43.685379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:43.700399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 494/981] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:43.701455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e92796-6bf4-49b4-8534-3a6039b6cb22 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:43.746737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e754d52-0409-46d7-8304-86182562129f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:43.781446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e960e06-f1b5-4210-955b-aac9fb878096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:43.782172 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e960e06-f1b5-4210-955b-aac9fb878096 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:43.782359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e960e06-f1b5-4210-955b-aac9fb878096 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:43.782635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e960e06-f1b5-4210-955b-aac9fb878096 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:43.783911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e960e06-f1b5-4210-955b-aac9fb878096 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:43.784585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e960e06-f1b5-4210-955b-aac9fb878096 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4e960e06-f1b5-4210-955b-aac9fb878096 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:43.794278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:43.795317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:43.796190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 488/982] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 03:12:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:43.801042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e960e06-f1b5-4210-955b-aac9fb878096 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:43.819084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e92796-6bf4-49b4-8534-3a6039b6cb22 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:43.828270 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:43.855647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba45fb1-084c-4cf0-831e-afb66bfea8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:43.856278 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba45fb1-084c-4cf0-831e-afb66bfea8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:43.856556 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba45fb1-084c-4cf0-831e-afb66bfea8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:43.856830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba45fb1-084c-4cf0-831e-afb66bfea8c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:43.864214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba45fb1-084c-4cf0-831e-afb66bfea8c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:43.865706 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba45fb1-084c-4cf0-831e-afb66bfea8c7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-dba45fb1-084c-4cf0-831e-afb66bfea8c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:43.877843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:43.878770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:43.879685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:43.879685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:43.879685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:43.879685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:43.879685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:43.879685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:43.879685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:43.879685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:43.884085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 495/983] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:43.884929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba45fb1-084c-4cf0-831e-afb66bfea8c7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:43.914077 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e960e06-f1b5-4210-955b-aac9fb878096 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:43.946614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:43.948059 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11180f9-2932-4922-bad0-48bb88050828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:43.948700 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11180f9-2932-4922-bad0-48bb88050828 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:43.948936 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11180f9-2932-4922-bad0-48bb88050828 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:43.949207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11180f9-2932-4922-bad0-48bb88050828 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:43.949932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11180f9-2932-4922-bad0-48bb88050828 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:43.950235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11180f9-2932-4922-bad0-48bb88050828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:43.951597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11180f9-2932-4922-bad0-48bb88050828 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:43.956456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 489/984] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 03:12:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:43.963253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11180f9-2932-4922-bad0-48bb88050828 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:43.998356 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba45fb1-084c-4cf0-831e-afb66bfea8c7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:44.034034 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47340a95-f3d6-4c3a-af78-e864e70845d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:44.034964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47340a95-f3d6-4c3a-af78-e864e70845d3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:44.035256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47340a95-f3d6-4c3a-af78-e864e70845d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:44.035733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47340a95-f3d6-4c3a-af78-e864e70845d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:44.036435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47340a95-f3d6-4c3a-af78-e864e70845d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:44.036835 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47340a95-f3d6-4c3a-af78-e864e70845d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:44.038248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47340a95-f3d6-4c3a-af78-e864e70845d3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:44.052321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 496/985] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:44.058212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47340a95-f3d6-4c3a-af78-e864e70845d3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:44.064478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:44.079210 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11180f9-2932-4922-bad0-48bb88050828 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:44.122118 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeaacb-8be0-414e-ac08-aff0552c4ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:44.123050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeaacb-8be0-414e-ac08-aff0552c4ddb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:44.123050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeaacb-8be0-414e-ac08-aff0552c4ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:44.123309 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeaacb-8be0-414e-ac08-aff0552c4ddb None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:44.123919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeaacb-8be0-414e-ac08-aff0552c4ddb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:44.124324 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeaacb-8be0-414e-ac08-aff0552c4ddb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:44.125677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeaacb-8be0-414e-ac08-aff0552c4ddb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:44.131981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 490/986] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 03:12:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:44.138171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeaacb-8be0-414e-ac08-aff0552c4ddb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:44.178460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47340a95-f3d6-4c3a-af78-e864e70845d3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:44.195760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:44.217112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590f78c-8900-491d-a9ef-2ffd775bef10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:44.217802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590f78c-8900-491d-a9ef-2ffd775bef10 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:44.218079 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590f78c-8900-491d-a9ef-2ffd775bef10 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:44.218350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590f78c-8900-491d-a9ef-2ffd775bef10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:44.219093 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590f78c-8900-491d-a9ef-2ffd775bef10 None admin] RBAC: Adding query filter params (role.id=616b42d92159431199afb1407a59b3b1, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=18e869f4ca35451583107ca7607e1861) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:44.219400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590f78c-8900-491d-a9ef-2ffd775bef10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:44.220835 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590f78c-8900-491d-a9ef-2ffd775bef10 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:44.227485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 497/987] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:44 2022] GET /identity/v3/role_assignments?user.id=18e869f4ca35451583107ca7607e1861&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=616b42d92159431199afb1407a59b3b1 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:44.228562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac68b0-2b5f-4b34-b85d-08365b23a8f5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:44.228838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac68b0-2b5f-4b34-b85d-08365b23a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:44.229110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac68b0-2b5f-4b34-b85d-08365b23a8f5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:44.230577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 498/988] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:44.235916 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbfaa5-6534-4b69-94ab-bd5a8c88310e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:44.236201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbfaa5-6534-4b69-94ab-bd5a8c88310e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:44.236479 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbfaa5-6534-4b69-94ab-bd5a8c88310e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:44.257869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-18fbfaa5-6534-4b69-94ab-bd5a8c88310e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:44.259290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-18fbfaa5-6534-4b69-94ab-bd5a8c88310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:44.267072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeaacb-8be0-414e-ac08-aff0552c4ddb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:44.306180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123bf32-7c6b-4f24-8fd8-3134c323798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:44.306813 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123bf32-7c6b-4f24-8fd8-3134c323798e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:44.307091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123bf32-7c6b-4f24-8fd8-3134c323798e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:44.307373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123bf32-7c6b-4f24-8fd8-3134c323798e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:44.308107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123bf32-7c6b-4f24-8fd8-3134c323798e None admin] RBAC: Adding query filter params (interface=admin, service_id=d7008d4a834045aebd3caafc9000e590, region_id=RegionOne) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:44.308420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123bf32-7c6b-4f24-8fd8-3134c323798e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:44.309875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123bf32-7c6b-4f24-8fd8-3134c323798e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:44.315547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 491/989] 10.222.0.48 () {56 vars in 1249 bytes} [Tue Sep 13 03:12:44 2022] GET /identity/v3/endpoints?service_id=d7008d4a834045aebd3caafc9000e590&interface=admin®ion_id=RegionOne => generated 193 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:44.322032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123bf32-7c6b-4f24-8fd8-3134c323798e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:44.341835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:44.345632 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 499/990] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:12:44.433559 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123bf32-7c6b-4f24-8fd8-3134c323798e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:44.470419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdd65e-4c52-4dca-b301-81d2f3c49821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:44.471364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdd65e-4c52-4dca-b301-81d2f3c49821 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:44.471850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdd65e-4c52-4dca-b301-81d2f3c49821 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:44.472351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdd65e-4c52-4dca-b301-81d2f3c49821 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:44.473154 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdd65e-4c52-4dca-b301-81d2f3c49821 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:44.474799 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdd65e-4c52-4dca-b301-81d2f3c49821 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:44.481888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 492/991] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 03:12:44 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:12:44.609088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbfaa5-6534-4b69-94ab-bd5a8c88310e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:44.716126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbfaa5-6534-4b69-94ab-bd5a8c88310e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:44.726954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:44.756038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aba5e6-298d-4457-a8f8-b0366a869839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:44.756707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aba5e6-298d-4457-a8f8-b0366a869839 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:44.757458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aba5e6-298d-4457-a8f8-b0366a869839 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:44.757738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aba5e6-298d-4457-a8f8-b0366a869839 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:44.758599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aba5e6-298d-4457-a8f8-b0366a869839 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:44.759959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aba5e6-298d-4457-a8f8-b0366a869839 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-53aba5e6-298d-4457-a8f8-b0366a869839 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:44.768758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:44.773402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:44.774337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 500/992] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:44.776707 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdd65e-4c52-4dca-b301-81d2f3c49821 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:44.860148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:44.879471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdd65e-4c52-4dca-b301-81d2f3c49821 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:44.914855 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47301345-6154-495f-919e-e2d29f5bbc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:44.915481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47301345-6154-495f-919e-e2d29f5bbc75 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:44.915739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47301345-6154-495f-919e-e2d29f5bbc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:44.915989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47301345-6154-495f-919e-e2d29f5bbc75 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:44.916617 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47301345-6154-495f-919e-e2d29f5bbc75 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:44.916922 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47301345-6154-495f-919e-e2d29f5bbc75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:44.918394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47301345-6154-495f-919e-e2d29f5bbc75 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:44.928019 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 493/993] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 03:12:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:44.929864 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aba5e6-298d-4457-a8f8-b0366a869839 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:45.031247 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aba5e6-298d-4457-a8f8-b0366a869839 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:45.065486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8dc3f-84d9-4fcb-9786-79aa7defeca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:45.066085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8dc3f-84d9-4fcb-9786-79aa7defeca4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:45.066363 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8dc3f-84d9-4fcb-9786-79aa7defeca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:45.066634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8dc3f-84d9-4fcb-9786-79aa7defeca4 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:45.067249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8dc3f-84d9-4fcb-9786-79aa7defeca4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:45.067547 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8dc3f-84d9-4fcb-9786-79aa7defeca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:45.068942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8dc3f-84d9-4fcb-9786-79aa7defeca4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:45.077598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 501/994] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 03:12:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:45.080081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47301345-6154-495f-919e-e2d29f5bbc75 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:45.192907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47301345-6154-495f-919e-e2d29f5bbc75 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:45.227879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e31a1-8b12-4dd6-997b-47654ade8e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:45.228536 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e31a1-8b12-4dd6-997b-47654ade8e4c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:45.228807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e31a1-8b12-4dd6-997b-47654ade8e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:45.229071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e31a1-8b12-4dd6-997b-47654ade8e4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:45.229798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e31a1-8b12-4dd6-997b-47654ade8e4c None admin] RBAC: Adding query filter params (interface=public, service_id=784c09fb0de244b8be0d0f3c2fd56ea4, region_id=RegionOne) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:45.230100 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e31a1-8b12-4dd6-997b-47654ade8e4c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:45.231452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e31a1-8b12-4dd6-997b-47654ade8e4c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:45.236861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 494/995] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 03:12:45 2022] GET /identity/v3/endpoints?service_id=784c09fb0de244b8be0d0f3c2fd56ea4&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:45.242798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8dc3f-84d9-4fcb-9786-79aa7defeca4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:45.279615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:45.344101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8dc3f-84d9-4fcb-9786-79aa7defeca4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:45.379935 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dd100-f417-4d7d-aabc-7d76411ddc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:45.380539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd100-f417-4d7d-aabc-7d76411ddc4d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:45.380811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd100-f417-4d7d-aabc-7d76411ddc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:45.381077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd100-f417-4d7d-aabc-7d76411ddc4d None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:45.382271 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dd100-f417-4d7d-aabc-7d76411ddc4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:45.383879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dd100-f417-4d7d-aabc-7d76411ddc4d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:45.397581 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 502/996] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 03:12:45 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:12:46.425488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15476b2-35b1-4f4d-a657-6a5c03e14b2d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:46.425990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15476b2-35b1-4f4d-a657-6a5c03e14b2d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:46.425990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15476b2-35b1-4f4d-a657-6a5c03e14b2d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:46.427331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 495/997] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:46.432427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584a5ce-beb4-4853-babc-20f9e1f6eaa4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:46.432805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584a5ce-beb4-4853-babc-20f9e1f6eaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:46.432996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584a5ce-beb4-4853-babc-20f9e1f6eaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:46.451579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e584a5ce-beb4-4853-babc-20f9e1f6eaa4 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:46.452756 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e584a5ce-beb4-4853-babc-20f9e1f6eaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:46.523124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 503/998] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:46.632783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efff789-969c-42f3-a66c-c583ed66e9d2 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:46.633410 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efff789-969c-42f3-a66c-c583ed66e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:46.633616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efff789-969c-42f3-a66c-c583ed66e9d2 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:46.635095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 496/999] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:46.640069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72626bbb-1a2b-4760-9960-73166322c4c3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:46.640350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72626bbb-1a2b-4760-9960-73166322c4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:46.640613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72626bbb-1a2b-4760-9960-73166322c4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:46.658474 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-72626bbb-1a2b-4760-9960-73166322c4c3 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:46.659646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-72626bbb-1a2b-4760-9960-73166322c4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:46.683398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:46.726305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 504/1000] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:46.791228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efff789-969c-42f3-a66c-c583ed66e9d2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:46.802206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:46.895452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efff789-969c-42f3-a66c-c583ed66e9d2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:46.929640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c38d9-2da7-475d-bf52-119c85038733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:46.930268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c38d9-2da7-475d-bf52-119c85038733 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:46.930545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c38d9-2da7-475d-bf52-119c85038733 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:46.930843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c38d9-2da7-475d-bf52-119c85038733 None admin] PATH_INFO: `/v3/services/image` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:46.931419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c38d9-2da7-475d-bf52-119c85038733 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:46.932811 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c38d9-2da7-475d-bf52-119c85038733 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ab1c38d9-2da7-475d-bf52-119c85038733 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:46.941954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:46.942917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:46.946363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 497/1001] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Sep 13 03:12:46 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:46.949499 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72626bbb-1a2b-4760-9960-73166322c4c3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:46.995100 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c38d9-2da7-475d-bf52-119c85038733 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:47.053799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72626bbb-1a2b-4760-9960-73166322c4c3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:47.068956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:47.090313 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462b2c2-247f-4fae-afc2-1b744e6c4b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:47.091106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462b2c2-247f-4fae-afc2-1b744e6c4b55 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:47.092205 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462b2c2-247f-4fae-afc2-1b744e6c4b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:47.092570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462b2c2-247f-4fae-afc2-1b744e6c4b55 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:47.093114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462b2c2-247f-4fae-afc2-1b744e6c4b55 None admin] RBAC: Adding query filter params (name=image) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:47.093446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462b2c2-247f-4fae-afc2-1b744e6c4b55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:47.095054 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462b2c2-247f-4fae-afc2-1b744e6c4b55 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:47.100778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c38d9-2da7-475d-bf52-119c85038733 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:47.105878 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 505/1002] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:47.106926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462b2c2-247f-4fae-afc2-1b744e6c4b55 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:47.134773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa1403-c968-448a-89fa-8fdc16a1b237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:47.135397 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa1403-c968-448a-89fa-8fdc16a1b237 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:47.135672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa1403-c968-448a-89fa-8fdc16a1b237 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:47.135777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:47.135942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa1403-c968-448a-89fa-8fdc16a1b237 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:47.136508 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa1403-c968-448a-89fa-8fdc16a1b237 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:47.140572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa1403-c968-448a-89fa-8fdc16a1b237 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-07fa1403-c968-448a-89fa-8fdc16a1b237 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:47.152647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:47.153789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:47.154634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 498/1003] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Sep 13 03:12:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:47.157291 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa1403-c968-448a-89fa-8fdc16a1b237 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:47.228807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462b2c2-247f-4fae-afc2-1b744e6c4b55 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:47.263328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa1403-c968-448a-89fa-8fdc16a1b237 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:47.264293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf763818-1a4a-4118-840d-344c94da0a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:47.265019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf763818-1a4a-4118-840d-344c94da0a32 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:47.265315 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf763818-1a4a-4118-840d-344c94da0a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:47.265704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf763818-1a4a-4118-840d-344c94da0a32 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:47.266333 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf763818-1a4a-4118-840d-344c94da0a32 None admin] RBAC: Adding query filter params (type=image) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:47.266634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf763818-1a4a-4118-840d-344c94da0a32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:47.267999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf763818-1a4a-4118-840d-344c94da0a32 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:47.277444 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 506/1004] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:47.300239 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba160b6-eca7-4c34-ae29-2fd578e8b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:47.300864 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba160b6-eca7-4c34-ae29-2fd578e8b177 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:47.301138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba160b6-eca7-4c34-ae29-2fd578e8b177 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:47.301441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba160b6-eca7-4c34-ae29-2fd578e8b177 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:47.302090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba160b6-eca7-4c34-ae29-2fd578e8b177 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:47.302389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba160b6-eca7-4c34-ae29-2fd578e8b177 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:47.304441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba160b6-eca7-4c34-ae29-2fd578e8b177 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:47.310141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 499/1005] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 03:12:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:47.313681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:47.315720 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf763818-1a4a-4118-840d-344c94da0a32 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:47.411416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:47.426513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf763818-1a4a-4118-840d-344c94da0a32 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:47.468535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f54ae3-0bed-4745-a7b9-557ae5e8c8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:47.469168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f54ae3-0bed-4745-a7b9-557ae5e8c8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:47.469466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f54ae3-0bed-4745-a7b9-557ae5e8c8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:47.469733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f54ae3-0bed-4745-a7b9-557ae5e8c8b6 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:47.470366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f54ae3-0bed-4745-a7b9-557ae5e8c8b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:47.470665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f54ae3-0bed-4745-a7b9-557ae5e8c8b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:47.472032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f54ae3-0bed-4745-a7b9-557ae5e8c8b6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:47.477777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 507/1006] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Sep 13 03:12:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:47.483694 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba160b6-eca7-4c34-ae29-2fd578e8b177 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:47.547607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bb503-00b5-4d36-82a2-8cb44a7ac8d5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:47.547877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bb503-00b5-4d36-82a2-8cb44a7ac8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:47.548146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bb503-00b5-4d36-82a2-8cb44a7ac8d5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:47.549655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 508/1007] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:12:47.554578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a40a24-0720-46e8-83f1-40620b17d8a3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:47.554863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a40a24-0720-46e8-83f1-40620b17d8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:47.555144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a40a24-0720-46e8-83f1-40620b17d8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:47.573646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-69a40a24-0720-46e8-83f1-40620b17d8a3 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:47.574844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-69a40a24-0720-46e8-83f1-40620b17d8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:47.589505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba160b6-eca7-4c34-ae29-2fd578e8b177 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:47.630156 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb2199-29a0-471b-98a5-08d68a9114cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:47.631121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb2199-29a0-471b-98a5-08d68a9114cf None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:47.632133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb2199-29a0-471b-98a5-08d68a9114cf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:47.632627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb2199-29a0-471b-98a5-08d68a9114cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:47.634035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb2199-29a0-471b-98a5-08d68a9114cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:47.636531 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb2199-29a0-471b-98a5-08d68a9114cf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:47.645984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 509/1008] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:12:47.733297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 500/1009] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:12:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:12:47.921781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a40a24-0720-46e8-83f1-40620b17d8a3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:48.002729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:48.021079 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a40a24-0720-46e8-83f1-40620b17d8a3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:48.062478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141df4af-bfd0-41cc-8431-c41ab0b2e407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:48.063108 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141df4af-bfd0-41cc-8431-c41ab0b2e407 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:48.063380 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141df4af-bfd0-41cc-8431-c41ab0b2e407 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:48.063668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141df4af-bfd0-41cc-8431-c41ab0b2e407 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:48.064235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141df4af-bfd0-41cc-8431-c41ab0b2e407 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:48.065615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141df4af-bfd0-41cc-8431-c41ab0b2e407 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-141df4af-bfd0-41cc-8431-c41ab0b2e407 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:48.074887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:48.076066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:48.076983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 510/1010] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:48.082102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb2199-29a0-471b-98a5-08d68a9114cf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:48.146187 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:48.195198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb2199-29a0-471b-98a5-08d68a9114cf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:48.228873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7fc97-aff9-47d1-a1a4-501aa384d9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:48.229508 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7fc97-aff9-47d1-a1a4-501aa384d9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:48.229789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7fc97-aff9-47d1-a1a4-501aa384d9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:48.230061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7fc97-aff9-47d1-a1a4-501aa384d9a4 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:48.230687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7fc97-aff9-47d1-a1a4-501aa384d9a4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:48.230989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7fc97-aff9-47d1-a1a4-501aa384d9a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:48.232361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7fc97-aff9-47d1-a1a4-501aa384d9a4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:48.240010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 501/1011] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 03:12:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:48.243514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141df4af-bfd0-41cc-8431-c41ab0b2e407 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:48.345463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141df4af-bfd0-41cc-8431-c41ab0b2e407 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:48.378796 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2102e-8e69-4b1d-a7f0-a7a74fb823a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:48.379394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2102e-8e69-4b1d-a7f0-a7a74fb823a7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:48.379669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2102e-8e69-4b1d-a7f0-a7a74fb823a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:48.379936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2102e-8e69-4b1d-a7f0-a7a74fb823a7 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:48.380549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2102e-8e69-4b1d-a7f0-a7a74fb823a7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:48.380849 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2102e-8e69-4b1d-a7f0-a7a74fb823a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:48.382863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2102e-8e69-4b1d-a7f0-a7a74fb823a7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:48.392725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 511/1012] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Sep 13 03:12:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:48.393741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7fc97-aff9-47d1-a1a4-501aa384d9a4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:48.494684 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7fc97-aff9-47d1-a1a4-501aa384d9a4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:48.517863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:48.528819 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044b8ec-092a-49e8-bc63-e1c64f5da018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:48.529518 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044b8ec-092a-49e8-bc63-e1c64f5da018 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:48.529799 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044b8ec-092a-49e8-bc63-e1c64f5da018 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:48.530070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044b8ec-092a-49e8-bc63-e1c64f5da018 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:48.530737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044b8ec-092a-49e8-bc63-e1c64f5da018 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:48.532101 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044b8ec-092a-49e8-bc63-e1c64f5da018 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:48.637298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 502/1013] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:12:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:12:49.448555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a9dfd-f564-4f8b-8be1-e121bf304d8b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:49.449043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a9dfd-f564-4f8b-8be1-e121bf304d8b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:49.449043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a9dfd-f564-4f8b-8be1-e121bf304d8b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:49.450426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 512/1014] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:49.455564 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb6403-3a88-4873-b81d-de462d60afb3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:49.455858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb6403-3a88-4873-b81d-de462d60afb3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:49.456132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb6403-3a88-4873-b81d-de462d60afb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:49.474198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a7fb6403-3a88-4873-b81d-de462d60afb3 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:49.475901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a7fb6403-3a88-4873-b81d-de462d60afb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:49.561666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 503/1015] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:49 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:49.824351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a9dfd-f564-4f8b-8be1-e121bf304d8b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:49.835538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:49.931986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a576e-60f4-42c3-b870-26109a442ee3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:49.932310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a576e-60f4-42c3-b870-26109a442ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:49.932544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a576e-60f4-42c3-b870-26109a442ee3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:49.934374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 504/1016] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:49.937983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a9dfd-f564-4f8b-8be1-e121bf304d8b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:49.939120 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3642b2-fcf2-4d9a-8a05-aeb41a1d6496 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:49.939596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3642b2-fcf2-4d9a-8a05-aeb41a1d6496 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:49.939722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3642b2-fcf2-4d9a-8a05-aeb41a1d6496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:49.959882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3b3642b2-fcf2-4d9a-8a05-aeb41a1d6496 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:49.961087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3b3642b2-fcf2-4d9a-8a05-aeb41a1d6496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:49.988180 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033011-1421-4d0d-9451-62eca73ca0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:49.988788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033011-1421-4d0d-9451-62eca73ca0ec None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:49.989066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033011-1421-4d0d-9451-62eca73ca0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:49.989376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033011-1421-4d0d-9451-62eca73ca0ec None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:49.990020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b033011-1421-4d0d-9451-62eca73ca0ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:49.991476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b033011-1421-4d0d-9451-62eca73ca0ec None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:50.032325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 505/1017] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:49 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:50.077434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 513/1018] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:12:49 2022] POST /identity/v3/services => generated 242 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:12:50.303673 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3642b2-fcf2-4d9a-8a05-aeb41a1d6496 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:50.339393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:50.407684 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3642b2-fcf2-4d9a-8a05-aeb41a1d6496 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:50.448575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8f17f-35d3-4ef4-a3f4-daa91cf5cae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:50.449212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8f17f-35d3-4ef4-a3f4-daa91cf5cae7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:50.449518 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8f17f-35d3-4ef4-a3f4-daa91cf5cae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:50.449791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8f17f-35d3-4ef4-a3f4-daa91cf5cae7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:50.450896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8f17f-35d3-4ef4-a3f4-daa91cf5cae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:50.452340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8f17f-35d3-4ef4-a3f4-daa91cf5cae7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:50.457291 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 506/1019] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:50.459749 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033011-1421-4d0d-9451-62eca73ca0ec None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:50.525546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:50.562752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033011-1421-4d0d-9451-62eca73ca0ec None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:50.597823 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571d66b-6409-458a-b3cc-11d859f326fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:50.598350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571d66b-6409-458a-b3cc-11d859f326fa None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:50.598652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571d66b-6409-458a-b3cc-11d859f326fa None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:50.598927 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571d66b-6409-458a-b3cc-11d859f326fa None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:50.599582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571d66b-6409-458a-b3cc-11d859f326fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:50.601040 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571d66b-6409-458a-b3cc-11d859f326fa None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:50.687232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 514/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:12:50 2022] POST /identity/v3/projects => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:12:50.894323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b441-836e-4832-b714-c45b9f3ebc46 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:50.895143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b441-836e-4832-b714-c45b9f3ebc46 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:50.895421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b441-836e-4832-b714-c45b9f3ebc46 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:50.896773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 507/1021] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:50.902160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d561e-5c75-4ae2-8632-59360c8626fa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:50.902451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d561e-5c75-4ae2-8632-59360c8626fa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:50.902733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d561e-5c75-4ae2-8632-59360c8626fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:50.921973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f44d561e-5c75-4ae2-8632-59360c8626fa None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:50.923173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f44d561e-5c75-4ae2-8632-59360c8626fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:50.995049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 515/1022] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:51.262674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904b441-836e-4832-b714-c45b9f3ebc46 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:51.361393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:51.365966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904b441-836e-4832-b714-c45b9f3ebc46 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:51.400886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac803278-3483-429c-a2c3-e6d3bd73839f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:51.401535 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac803278-3483-429c-a2c3-e6d3bd73839f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:51.401812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac803278-3483-429c-a2c3-e6d3bd73839f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:51.402082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac803278-3483-429c-a2c3-e6d3bd73839f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:51.412053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac803278-3483-429c-a2c3-e6d3bd73839f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ac803278-3483-429c-a2c3-e6d3bd73839f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:51.417301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:51.418228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:51.419129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:51.419129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:51.419129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:51.419129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:51.419129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:51.419129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:51.419129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:51.419129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:51.419129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:51.419129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:51.419129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 03:12:51.419129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:51.419129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 508/1023] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 13 03:12:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:51.426144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d561e-5c75-4ae2-8632-59360c8626fa None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:51.474275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:51.526322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d561e-5c75-4ae2-8632-59360c8626fa None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:51.560031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6adfb-00ea-4d1c-94de-edd47f528254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:51.560633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6adfb-00ea-4d1c-94de-edd47f528254 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:51.560910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6adfb-00ea-4d1c-94de-edd47f528254 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:51.561175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6adfb-00ea-4d1c-94de-edd47f528254 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:51.561861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6adfb-00ea-4d1c-94de-edd47f528254 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:51.562162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6adfb-00ea-4d1c-94de-edd47f528254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:51.563516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6adfb-00ea-4d1c-94de-edd47f528254 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:51.572109 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 516/1024] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 03:12:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:51.577759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac803278-3483-429c-a2c3-e6d3bd73839f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:51.681337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac803278-3483-429c-a2c3-e6d3bd73839f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:51.715406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87960dd-b082-4609-8586-91182156112d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:51.716025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87960dd-b082-4609-8586-91182156112d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:51.716301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87960dd-b082-4609-8586-91182156112d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:51.716568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87960dd-b082-4609-8586-91182156112d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:51.726450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87960dd-b082-4609-8586-91182156112d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:51.727888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87960dd-b082-4609-8586-91182156112d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a87960dd-b082-4609-8586-91182156112d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:51.743079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:51.744063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:51.745055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:51.745055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:51.745055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:51.745828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 509/1025] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:51.750311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6adfb-00ea-4d1c-94de-edd47f528254 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:51.850396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6adfb-00ea-4d1c-94de-edd47f528254 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:51.860849 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:51.885088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db3166-0fd4-4664-803e-3c8ec69ab810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:51.885716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db3166-0fd4-4664-803e-3c8ec69ab810 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:51.887190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db3166-0fd4-4664-803e-3c8ec69ab810 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:51.887190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db3166-0fd4-4664-803e-3c8ec69ab810 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:51.887190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db3166-0fd4-4664-803e-3c8ec69ab810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:51.887190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db3166-0fd4-4664-803e-3c8ec69ab810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:51.888562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db3166-0fd4-4664-803e-3c8ec69ab810 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:51.904973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 517/1026] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:51.909193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87960dd-b082-4609-8586-91182156112d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:51.922735 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:52.009607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87960dd-b082-4609-8586-91182156112d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:52.042457 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ee0e-c681-4460-9384-10d778626618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:52.043087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ee0e-c681-4460-9384-10d778626618 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:52.043364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ee0e-c681-4460-9384-10d778626618 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:52.043633 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ee0e-c681-4460-9384-10d778626618 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:52.051030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152ee0e-c681-4460-9384-10d778626618 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:52.052455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152ee0e-c681-4460-9384-10d778626618 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-d152ee0e-c681-4460-9384-10d778626618 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:52.063928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:52.064856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:52.066174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:52.066174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:52.066174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:52.066174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:52.066174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:52.066174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:52.066174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:52.066174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:52.066174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:12:52.066174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:52.069583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 510/1027] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 03:12:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:52.071274 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db3166-0fd4-4664-803e-3c8ec69ab810 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:52.183337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db3166-0fd4-4664-803e-3c8ec69ab810 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:52.219390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccb4cc-1f02-4157-b553-73bec3d490ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:52.219997 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccb4cc-1f02-4157-b553-73bec3d490ee None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:52.220272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccb4cc-1f02-4157-b553-73bec3d490ee None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:52.220539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccb4cc-1f02-4157-b553-73bec3d490ee None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:52.221250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccb4cc-1f02-4157-b553-73bec3d490ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:52.221576 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccb4cc-1f02-4157-b553-73bec3d490ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:52.222995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccb4cc-1f02-4157-b553-73bec3d490ee None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:52.245792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 518/1028] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 03:12:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:52.246893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ee0e-c681-4460-9384-10d778626618 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:52.282909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da7aec-da66-4ad1-bd84-d72fa1164362 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:52.283108 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da7aec-da66-4ad1-bd84-d72fa1164362 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:52.283372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da7aec-da66-4ad1-bd84-d72fa1164362 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:52.284842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 519/1029] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:12:52.290033 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b35ce-3474-4982-868b-25887fd06150 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:52.290317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b35ce-3474-4982-868b-25887fd06150 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:52.290589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b35ce-3474-4982-868b-25887fd06150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:52.309826 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-762b35ce-3474-4982-868b-25887fd06150 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:52.311463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-762b35ce-3474-4982-868b-25887fd06150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:52.319130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:52.340025 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:52.349000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ee0e-c681-4460-9384-10d778626618 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:52.385980 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1279a4d-c73d-412d-a32a-db3c9b2c2234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:52.386588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1279a4d-c73d-412d-a32a-db3c9b2c2234 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:52.386867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1279a4d-c73d-412d-a32a-db3c9b2c2234 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:52.387142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1279a4d-c73d-412d-a32a-db3c9b2c2234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:52.397295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 520/1030] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:12:52.460734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1279a4d-c73d-412d-a32a-db3c9b2c2234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:52.462208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1279a4d-c73d-412d-a32a-db3c9b2c2234 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:52.532100 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:52.567194 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 511/1031] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:52 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 03:12:52.568359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b35ce-3474-4982-868b-25887fd06150 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:52.661037 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1279a4d-c73d-412d-a32a-db3c9b2c2234 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:52.669301 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b35ce-3474-4982-868b-25887fd06150 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:52.705284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95812ebc-ddca-41bb-b2a2-9584fa360b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:52.705905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95812ebc-ddca-41bb-b2a2-9584fa360b6e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:52.706184 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95812ebc-ddca-41bb-b2a2-9584fa360b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:52.706455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95812ebc-ddca-41bb-b2a2-9584fa360b6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:52.717020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95812ebc-ddca-41bb-b2a2-9584fa360b6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:52.718572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95812ebc-ddca-41bb-b2a2-9584fa360b6e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-95812ebc-ddca-41bb-b2a2-9584fa360b6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:52.734308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:52.735327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:52.736229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:52.736229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:52.736229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:52.736229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 521/1032] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:52.740967 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95812ebc-ddca-41bb-b2a2-9584fa360b6e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:52.757561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:52.767923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1279a4d-c73d-412d-a32a-db3c9b2c2234 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:52.806084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dcd5c-c80c-40b6-b673-5b0634abab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:52.806348 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dcd5c-c80c-40b6-b673-5b0634abab5b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:52.806517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dcd5c-c80c-40b6-b673-5b0634abab5b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:52.806775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dcd5c-c80c-40b6-b673-5b0634abab5b None admin] PATH_INFO: `/v3/services/image` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:52.807372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dcd5c-c80c-40b6-b673-5b0634abab5b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:52.808779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dcd5c-c80c-40b6-b673-5b0634abab5b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b16dcd5c-c80c-40b6-b673-5b0634abab5b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:52.820374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:52.821451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 03:12:52.822325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:52.823123 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 512/1033] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Sep 13 03:12:52 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:52.828580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dcd5c-c80c-40b6-b673-5b0634abab5b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:52.862267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95812ebc-ddca-41bb-b2a2-9584fa360b6e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:52.865303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:52.903436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d3f57-2ae6-497d-a1cc-e14c68eb59ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:52.904046 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d3f57-2ae6-497d-a1cc-e14c68eb59ed None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:52.904326 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d3f57-2ae6-497d-a1cc-e14c68eb59ed None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:52.904600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d3f57-2ae6-497d-a1cc-e14c68eb59ed None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:52.905244 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d3f57-2ae6-497d-a1cc-e14c68eb59ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:52.905575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d3f57-2ae6-497d-a1cc-e14c68eb59ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:52.906946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d3f57-2ae6-497d-a1cc-e14c68eb59ed None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:52.919529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 522/1034] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:52.921354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dc2d9-6d32-4d7d-b9e0-e2b56aa8637f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:52.921642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dc2d9-6d32-4d7d-b9e0-e2b56aa8637f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:52.921911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dc2d9-6d32-4d7d-b9e0-e2b56aa8637f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:52.923125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 523/1035] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:12:52.924770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dc2d9-6d32-4d7d-b9e0-e2b56aa8637f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:52.940129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dcd5c-c80c-40b6-b673-5b0634abab5b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:52.973431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9c227-df9c-44f5-a45b-e775772fa5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:52.974030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9c227-df9c-44f5-a45b-e775772fa5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:52.974306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9c227-df9c-44f5-a45b-e775772fa5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:52.975146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9c227-df9c-44f5-a45b-e775772fa5e4 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:52.975767 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9c227-df9c-44f5-a45b-e775772fa5e4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:52.976066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9c227-df9c-44f5-a45b-e775772fa5e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:52.977485 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9c227-df9c-44f5-a45b-e775772fa5e4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:52.982236 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 513/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:52.983370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019d1d2-53c0-4572-a412-6870de72d413 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:52.983661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019d1d2-53c0-4572-a412-6870de72d413 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:52.983918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019d1d2-53c0-4572-a412-6870de72d413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:52.997049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:53.001308 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a019d1d2-53c0-4572-a412-6870de72d413 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:53.002426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a019d1d2-53c0-4572-a412-6870de72d413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:53.030029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dc2d9-6d32-4d7d-b9e0-e2b56aa8637f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:53.062904 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9735c33-64ba-466f-9afe-03f8948f6360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:53.063513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9735c33-64ba-466f-9afe-03f8948f6360 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:53.063785 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9735c33-64ba-466f-9afe-03f8948f6360 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:53.064051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9735c33-64ba-466f-9afe-03f8948f6360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:53.067488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 514/1037] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:53.068801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019d1d2-53c0-4572-a412-6870de72d413 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:53.071185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9735c33-64ba-466f-9afe-03f8948f6360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:53.072553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9735c33-64ba-466f-9afe-03f8948f6360 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-d9735c33-64ba-466f-9afe-03f8948f6360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:53.085791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:53.086721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:53.087615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:53.087615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:53.087615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:53.087615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:53.087615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:53.087615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:53.087615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:53.087615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:53.087615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 524/1038] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:53.092466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9735c33-64ba-466f-9afe-03f8948f6360 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:53.106328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:53.188327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019d1d2-53c0-4572-a412-6870de72d413 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:53.192081 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9735c33-64ba-466f-9afe-03f8948f6360 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:53.220688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:53.224739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aeb2e2-7569-40ed-9c35-1203f0983374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:53.225381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeb2e2-7569-40ed-9c35-1203f0983374 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:53.225643 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeb2e2-7569-40ed-9c35-1203f0983374 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:53.225902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeb2e2-7569-40ed-9c35-1203f0983374 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:53.226527 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aeb2e2-7569-40ed-9c35-1203f0983374 None admin] RBAC: Adding query filter params (type=image) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:53.226703 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5fed4-bf84-47ba-80fd-f7d620da5df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:53.226824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aeb2e2-7569-40ed-9c35-1203f0983374 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:53.227303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5fed4-bf84-47ba-80fd-f7d620da5df5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:53.227578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5fed4-bf84-47ba-80fd-f7d620da5df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:53.227847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5fed4-bf84-47ba-80fd-f7d620da5df5 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:53.228167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aeb2e2-7569-40ed-9c35-1203f0983374 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:53.228587 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5fed4-bf84-47ba-80fd-f7d620da5df5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:53.228895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5fed4-bf84-47ba-80fd-f7d620da5df5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:53.230330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5fed4-bf84-47ba-80fd-f7d620da5df5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:53.233423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 515/1039] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:53.239322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aeb2e2-7569-40ed-9c35-1203f0983374 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:53.245307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 525/1040] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:53.248083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5fed4-bf84-47ba-80fd-f7d620da5df5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:53.338990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:53.345479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aeb2e2-7569-40ed-9c35-1203f0983374 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:53.350749 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5fed4-bf84-47ba-80fd-f7d620da5df5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:53.379442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aad3ee-9981-451f-b166-197524ab849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:53.380047 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aad3ee-9981-451f-b166-197524ab849e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:53.380323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aad3ee-9981-451f-b166-197524ab849e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:53.380597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aad3ee-9981-451f-b166-197524ab849e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:53.381884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aad3ee-9981-451f-b166-197524ab849e None admin] RBAC: Adding query filter params (interface=public, service_id=d6b144afa45f404d8646c997c8dceba9, region_id=RegionOne) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:53.382194 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aad3ee-9981-451f-b166-197524ab849e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:53.384090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aad3ee-9981-451f-b166-197524ab849e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:53.385221 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c7076-2b93-4a2c-be30-cbd2c7d60c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:53.385839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c7076-2b93-4a2c-be30-cbd2c7d60c17 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:53.386120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c7076-2b93-4a2c-be30-cbd2c7d60c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:53.386391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c7076-2b93-4a2c-be30-cbd2c7d60c17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:53.387105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c7076-2b93-4a2c-be30-cbd2c7d60c17 None admin] RBAC: Adding query filter params (role.id=616b42d92159431199afb1407a59b3b1, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=fcff121c9e974a6aabaa18775de65f63) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:53.387409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c7076-2b93-4a2c-be30-cbd2c7d60c17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:53.388841 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c7076-2b93-4a2c-be30-cbd2c7d60c17 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:53.389383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 516/1041] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 03:12:53 2022] GET /identity/v3/endpoints?service_id=d6b144afa45f404d8646c997c8dceba9&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:53.390011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aad3ee-9981-451f-b166-197524ab849e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:53.401339 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 526/1042] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:53 2022] GET /identity/v3/role_assignments?user.id=fcff121c9e974a6aabaa18775de65f63&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=616b42d92159431199afb1407a59b3b1 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:53.401339 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c7076-2b93-4a2c-be30-cbd2c7d60c17 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:53.465646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:53.506497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aad3ee-9981-451f-b166-197524ab849e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:53.517120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c7076-2b93-4a2c-be30-cbd2c7d60c17 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:53.543383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64571115-18dc-4bf0-a9cf-e5c1e9468eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:53.544032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64571115-18dc-4bf0-a9cf-e5c1e9468eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:53.544310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64571115-18dc-4bf0-a9cf-e5c1e9468eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:53.544582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64571115-18dc-4bf0-a9cf-e5c1e9468eb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:53.545781 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64571115-18dc-4bf0-a9cf-e5c1e9468eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:53.547255 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64571115-18dc-4bf0-a9cf-e5c1e9468eb1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:53.549035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 517/1043] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:53.555200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64571115-18dc-4bf0-a9cf-e5c1e9468eb1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:53.561167 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0698a-2451-42a7-ab77-4bb4f450a32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:53.562042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0698a-2451-42a7-ab77-4bb4f450a32f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:53.562465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0698a-2451-42a7-ab77-4bb4f450a32f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:53.562875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0698a-2451-42a7-ab77-4bb4f450a32f None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:53.563635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0698a-2451-42a7-ab77-4bb4f450a32f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:53.565224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0698a-2451-42a7-ab77-4bb4f450a32f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:53.573584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 527/1044] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 03:12:53 2022] GET /identity/v3/services => generated 1957 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:12:53.588120 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:53.668424 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64571115-18dc-4bf0-a9cf-e5c1e9468eb1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:53.706087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8b0f4-be65-4342-b8e6-bc15678698f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:53.706707 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8b0f4-be65-4342-b8e6-bc15678698f0 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:53.706983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8b0f4-be65-4342-b8e6-bc15678698f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:53.707251 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8b0f4-be65-4342-b8e6-bc15678698f0 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:53.707911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8b0f4-be65-4342-b8e6-bc15678698f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:53.709441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8b0f4-be65-4342-b8e6-bc15678698f0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:53.829766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 518/1045] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:12:53 2022] POST /identity/v3/users => generated 285 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:12:55.545793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247cf9e-f35a-4d31-8cd7-6b3a58b093a8 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:55.546376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247cf9e-f35a-4d31-8cd7-6b3a58b093a8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:55.546376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247cf9e-f35a-4d31-8cd7-6b3a58b093a8 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:55.547830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 528/1046] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:55.553304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446cc4-361e-4bd5-8b1f-ca2e41f19f32 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:55.553706 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446cc4-361e-4bd5-8b1f-ca2e41f19f32 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:55.553867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446cc4-361e-4bd5-8b1f-ca2e41f19f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:55.572112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-53446cc4-361e-4bd5-8b1f-ca2e41f19f32 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:55.573317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-53446cc4-361e-4bd5-8b1f-ca2e41f19f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:55.644593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 519/1047] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:55.733000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ad90e-0351-40ff-b409-1d511988614e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:55.733336 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ad90e-0351-40ff-b409-1d511988614e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:55.733593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ad90e-0351-40ff-b409-1d511988614e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:55.735041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 529/1048] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:55.740025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e4b12-ee73-4527-80bc-a388184aa9c9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:55.740312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e4b12-ee73-4527-80bc-a388184aa9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:55.740584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e4b12-ee73-4527-80bc-a388184aa9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:55.758932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-be6e4b12-ee73-4527-80bc-a388184aa9c9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:55.760110 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-be6e4b12-ee73-4527-80bc-a388184aa9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:55.770136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:55.829717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 520/1049] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:55.910627 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ad90e-0351-40ff-b409-1d511988614e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:56.021977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ad90e-0351-40ff-b409-1d511988614e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:56.039740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:56.045773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f21284-3131-4992-a442-05b988caed45 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:56.046062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f21284-3131-4992-a442-05b988caed45 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:56.046339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f21284-3131-4992-a442-05b988caed45 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:56.047822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 521/1050] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:56.052842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4191a9f-2ed7-49c3-a786-80f2d6ac09e4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:56.053119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4191a9f-2ed7-49c3-a786-80f2d6ac09e4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:56.053483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4191a9f-2ed7-49c3-a786-80f2d6ac09e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:56.057064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084585a-32be-4a1a-9067-45e3f3302baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:56.057719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084585a-32be-4a1a-9067-45e3f3302baa None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:56.057994 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084585a-32be-4a1a-9067-45e3f3302baa None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:56.058263 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084585a-32be-4a1a-9067-45e3f3302baa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:56.069281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084585a-32be-4a1a-9067-45e3f3302baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:56.071514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b4191a9f-2ed7-49c3-a786-80f2d6ac09e4 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:56.072708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b4191a9f-2ed7-49c3-a786-80f2d6ac09e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3084585a-32be-4a1a-9067-45e3f3302baa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:56.074524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:56.077789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:56.078659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:56.078659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:56.078659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:56.078659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:56.078659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:56.078659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:56.078659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:56.078659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:56.078659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:56.078659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:56.078659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 03:12:56.078659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:56.078659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 530/1051] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 13 03:12:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:56.081630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084585a-32be-4a1a-9067-45e3f3302baa None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:56.142453 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 522/1052] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:12:56.143745 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4191a9f-2ed7-49c3-a786-80f2d6ac09e4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:56.199809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084585a-32be-4a1a-9067-45e3f3302baa None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:56.222240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:56.237672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059a422-1e9f-403c-996f-ece2ca5adb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:56.238282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059a422-1e9f-403c-996f-ece2ca5adb1e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:56.238563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059a422-1e9f-403c-996f-ece2ca5adb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:56.238838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059a422-1e9f-403c-996f-ece2ca5adb1e None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:56.239499 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059a422-1e9f-403c-996f-ece2ca5adb1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:56.239820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059a422-1e9f-403c-996f-ece2ca5adb1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:56.241200 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059a422-1e9f-403c-996f-ece2ca5adb1e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:56.249469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 531/1053] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 03:12:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:56.255098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059a422-1e9f-403c-996f-ece2ca5adb1e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:56.262433 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4191a9f-2ed7-49c3-a786-80f2d6ac09e4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:56.356717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9778e2-3bfb-42ed-8603-7369d43d3161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:56.357290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9778e2-3bfb-42ed-8603-7369d43d3161 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:56.357571 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9778e2-3bfb-42ed-8603-7369d43d3161 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:56.357843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9778e2-3bfb-42ed-8603-7369d43d3161 None admin] PATH_INFO: `/v3/services/image` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:56.358425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9778e2-3bfb-42ed-8603-7369d43d3161 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:56.359840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9778e2-3bfb-42ed-8603-7369d43d3161 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:56.368002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4d9778e2-3bfb-42ed-8603-7369d43d3161 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:56.369052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:56.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:56.370985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 523/1054] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Sep 13 03:12:56 2022] GET /identity/v3/services/image => generated 86 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:56.375992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9778e2-3bfb-42ed-8603-7369d43d3161 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:56.432776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059a422-1e9f-403c-996f-ece2ca5adb1e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:56.466316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0b585-6283-4afb-b0c8-583e2042a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:56.466966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0b585-6283-4afb-b0c8-583e2042a5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:56.467250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0b585-6283-4afb-b0c8-583e2042a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:56.467521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0b585-6283-4afb-b0c8-583e2042a5c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:56.474474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9778e2-3bfb-42ed-8603-7369d43d3161 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:56.478455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0b585-6283-4afb-b0c8-583e2042a5c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:56.479886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0b585-6283-4afb-b0c8-583e2042a5c5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-1df0b585-6283-4afb-b0c8-583e2042a5c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:56.495521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:56.496498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:56.497465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:56.497465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:56.497465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:56.497465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 532/1055] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:56.497693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0b585-6283-4afb-b0c8-583e2042a5c5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:56.516494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d51a14-b7f1-4925-b88c-687efbc6691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:56.517097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d51a14-b7f1-4925-b88c-687efbc6691e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:56.517405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d51a14-b7f1-4925-b88c-687efbc6691e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:56.517688 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d51a14-b7f1-4925-b88c-687efbc6691e None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:56.518299 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d51a14-b7f1-4925-b88c-687efbc6691e None admin] RBAC: Adding query filter params (name=image) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:56.518599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d51a14-b7f1-4925-b88c-687efbc6691e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:56.519953 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d51a14-b7f1-4925-b88c-687efbc6691e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:56.521731 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:56.525561 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 524/1056] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:56.526402 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d51a14-b7f1-4925-b88c-687efbc6691e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:56.592473 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:56.600990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0b585-6283-4afb-b0c8-583e2042a5c5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:56.628587 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d51a14-b7f1-4925-b88c-687efbc6691e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:56.635748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966f8e6-20b5-4331-839e-6fc4ab3a9320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:56.636377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966f8e6-20b5-4331-839e-6fc4ab3a9320 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:56.636653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966f8e6-20b5-4331-839e-6fc4ab3a9320 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:56.636922 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966f8e6-20b5-4331-839e-6fc4ab3a9320 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:56.647513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966f8e6-20b5-4331-839e-6fc4ab3a9320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5966f8e6-20b5-4331-839e-6fc4ab3a9320 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:12:56.652319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:56.653290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 533/1057] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:12:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:56.654156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966f8e6-20b5-4331-839e-6fc4ab3a9320 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:56.664052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffd46b-8d40-4d01-af83-3b951323c140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:56.664682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffd46b-8d40-4d01-af83-3b951323c140 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:56.664964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffd46b-8d40-4d01-af83-3b951323c140 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:56.665232 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffd46b-8d40-4d01-af83-3b951323c140 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:56.665900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffd46b-8d40-4d01-af83-3b951323c140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:56.666199 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffd46b-8d40-4d01-af83-3b951323c140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:56.667556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffd46b-8d40-4d01-af83-3b951323c140 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:56.679765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 525/1058] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:56.680556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffd46b-8d40-4d01-af83-3b951323c140 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:56.738992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:56.756356 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966f8e6-20b5-4331-839e-6fc4ab3a9320 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:56.778932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffd46b-8d40-4d01-af83-3b951323c140 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:56.790233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a517b-f874-449b-b9dc-05348be9a531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:56.790823 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a517b-f874-449b-b9dc-05348be9a531 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:56.791095 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a517b-f874-449b-b9dc-05348be9a531 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:56.791364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a517b-f874-449b-b9dc-05348be9a531 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:56.791971 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a517b-f874-449b-b9dc-05348be9a531 None admin] RBAC: Adding query filter params (type=image) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:56.792268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a517b-f874-449b-b9dc-05348be9a531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:56.793675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a517b-f874-449b-b9dc-05348be9a531 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:56.798275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 534/1059] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:56.799032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a517b-f874-449b-b9dc-05348be9a531 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:56.816163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e23c5-702e-46f0-8504-45336c9e3ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:56.816737 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:56.816862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e23c5-702e-46f0-8504-45336c9e3ffd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:56.817055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e23c5-702e-46f0-8504-45336c9e3ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:56.817308 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e23c5-702e-46f0-8504-45336c9e3ffd None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:56.817973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e23c5-702e-46f0-8504-45336c9e3ffd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:56.818263 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e23c5-702e-46f0-8504-45336c9e3ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:56.819617 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e23c5-702e-46f0-8504-45336c9e3ffd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:56.827702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 526/1060] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:56.832476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e23c5-702e-46f0-8504-45336c9e3ffd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:56.903818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a517b-f874-449b-b9dc-05348be9a531 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:56.926302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e23c5-702e-46f0-8504-45336c9e3ffd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:56.931187 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0118c-b01d-46f6-b0f5-803e9bc84d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:56.932730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0118c-b01d-46f6-b0f5-803e9bc84d20 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:56.932730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0118c-b01d-46f6-b0f5-803e9bc84d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:56.932730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0118c-b01d-46f6-b0f5-803e9bc84d20 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:56.939819 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0118c-b01d-46f6-b0f5-803e9bc84d20 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:56.941406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0118c-b01d-46f6-b0f5-803e9bc84d20 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:56.949080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b8f0118c-b01d-46f6-b0f5-803e9bc84d20 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:12:56.952555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:56.953525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:56.955062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:56.955062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:56.955062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:12:56.955062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:12:56.955062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:12:56.955062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:12:56.955062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:12:56.955062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:12:56.955062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:12:56.955062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:12:56.955062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 535/1061] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 03:12:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:56.955062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0118c-b01d-46f6-b0f5-803e9bc84d20 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:56.964265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d893b1-e618-4af4-afc1-97eae0320929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:56.964866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d893b1-e618-4af4-afc1-97eae0320929 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:56.965140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d893b1-e618-4af4-afc1-97eae0320929 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:56.965446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d893b1-e618-4af4-afc1-97eae0320929 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:56.966123 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d893b1-e618-4af4-afc1-97eae0320929 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:56.967482 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d893b1-e618-4af4-afc1-97eae0320929 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:57.028724 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:57.044520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 527/1062] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:12:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:12:57.045556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d893b1-e618-4af4-afc1-97eae0320929 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:57.052044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0118c-b01d-46f6-b0f5-803e9bc84d20 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:57.104859 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feec474-4e34-4d25-8a76-ccad9deb8b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:57.105538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feec474-4e34-4d25-8a76-ccad9deb8b52 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:57.105819 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feec474-4e34-4d25-8a76-ccad9deb8b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:57.106096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feec474-4e34-4d25-8a76-ccad9deb8b52 None admin] PATH_INFO: `/v3/users/469f5a2fb4a443928be150edaeda4900` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:57.122885 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feec474-4e34-4d25-8a76-ccad9deb8b52 None admin] RBAC: Authorizing `identity:get_user(user_id=469f5a2fb4a443928be150edaeda4900)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:57.124369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feec474-4e34-4d25-8a76-ccad9deb8b52 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:57.126149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 536/1063] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:12:56 2022] GET /identity/v3/users/469f5a2fb4a443928be150edaeda4900 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:57.135243 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feec474-4e34-4d25-8a76-ccad9deb8b52 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:57.181603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d893b1-e618-4af4-afc1-97eae0320929 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:57.223261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152a4fb-6d3c-4938-a5b1-ff3859880b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:57.223869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152a4fb-6d3c-4938-a5b1-ff3859880b68 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:57.224147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152a4fb-6d3c-4938-a5b1-ff3859880b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:57.225030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152a4fb-6d3c-4938-a5b1-ff3859880b68 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:57.225828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152a4fb-6d3c-4938-a5b1-ff3859880b68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:57.226121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152a4fb-6d3c-4938-a5b1-ff3859880b68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:57.227551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152a4fb-6d3c-4938-a5b1-ff3859880b68 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:57.245602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 528/1064] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 03:12:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:57.251479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152a4fb-6d3c-4938-a5b1-ff3859880b68 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:57.255083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feec474-4e34-4d25-8a76-ccad9deb8b52 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:57.287470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:57.289587 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:57.295190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33615-3380-4d9f-8d63-32f97d1d9179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:57.295860 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33615-3380-4d9f-8d63-32f97d1d9179 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:57.296138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33615-3380-4d9f-8d63-32f97d1d9179 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:57.296462 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b33615-3380-4d9f-8d63-32f97d1d9179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:57.355321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152a4fb-6d3c-4938-a5b1-ff3859880b68 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:57.367108 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b33615-3380-4d9f-8d63-32f97d1d9179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:57.368563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b33615-3380-4d9f-8d63-32f97d1d9179 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:57.391358 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25136ac9-e173-4d3d-86a3-71cdb848d1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:57.391994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25136ac9-e173-4d3d-86a3-71cdb848d1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:57.392277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25136ac9-e173-4d3d-86a3-71cdb848d1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:57.392551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25136ac9-e173-4d3d-86a3-71cdb848d1e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:57.403188 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25136ac9-e173-4d3d-86a3-71cdb848d1e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:57.404633 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25136ac9-e173-4d3d-86a3-71cdb848d1e4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-25136ac9-e173-4d3d-86a3-71cdb848d1e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:12:57.419802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:57.420773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:12:57.422064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:12:57.422064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:12:57.422064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:57.422064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 529/1065] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:12:57.426342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25136ac9-e173-4d3d-86a3-71cdb848d1e4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:57.479821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 537/1066] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:12:57.485782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33615-3380-4d9f-8d63-32f97d1d9179 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:57.516013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:57.519134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:57.531610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25136ac9-e173-4d3d-86a3-71cdb848d1e4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:57.567568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26171600-e47f-4a44-ae39-7dcea6acbd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:57.568736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26171600-e47f-4a44-ae39-7dcea6acbd9d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:57.569657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26171600-e47f-4a44-ae39-7dcea6acbd9d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:57.570418 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26171600-e47f-4a44-ae39-7dcea6acbd9d None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:57.572416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26171600-e47f-4a44-ae39-7dcea6acbd9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:57.572721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26171600-e47f-4a44-ae39-7dcea6acbd9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:57.574139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26171600-e47f-4a44-ae39-7dcea6acbd9d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:57.591048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 530/1067] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:57.591933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26171600-e47f-4a44-ae39-7dcea6acbd9d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:57.594522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b33615-3380-4d9f-8d63-32f97d1d9179 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:57.634173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b58b6-2457-43a1-86ad-5fa4fc22fe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:57.634797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b58b6-2457-43a1-86ad-5fa4fc22fe4f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:57.635070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b58b6-2457-43a1-86ad-5fa4fc22fe4f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:57.635423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b58b6-2457-43a1-86ad-5fa4fc22fe4f None admin] PATH_INFO: `/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:57.636432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b58b6-2457-43a1-86ad-5fa4fc22fe4f None admin] RBAC: Authorizing `identity:get_project(project_id=9f1bc5155deb4cf0bd473ad2c3a0edbf)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:57.637889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b58b6-2457-43a1-86ad-5fa4fc22fe4f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:57.644633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 538/1068] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:12:57 2022] GET /identity/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:57.645409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b58b6-2457-43a1-86ad-5fa4fc22fe4f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:57.702057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26171600-e47f-4a44-ae39-7dcea6acbd9d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:57.738850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2fbdf-a826-4e9a-9f14-50af1b543215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:57.739734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2fbdf-a826-4e9a-9f14-50af1b543215 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:57.740164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2fbdf-a826-4e9a-9f14-50af1b543215 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:57.740431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2fbdf-a826-4e9a-9f14-50af1b543215 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:57.744288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:57.747253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2fbdf-a826-4e9a-9f14-50af1b543215 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:57.748598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b58b6-2457-43a1-86ad-5fa4fc22fe4f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:57.748769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2fbdf-a826-4e9a-9f14-50af1b543215 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-2fb2fbdf-a826-4e9a-9f14-50af1b543215 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:12:57.760703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:12:57.761691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:12:57.762625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:12:57.762625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:12:57.762625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:12:57.762625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:12:57.762625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:12:57.762625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:12:57.762625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:12:57.762625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:12:57.762625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 531/1069] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:12:57.767615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2fbdf-a826-4e9a-9f14-50af1b543215 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:57.779573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:57.790935 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36aede1-31fc-4131-9f34-80f94e2d9abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:57.791591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aede1-31fc-4131-9f34-80f94e2d9abd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:57.791873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aede1-31fc-4131-9f34-80f94e2d9abd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:57.792148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aede1-31fc-4131-9f34-80f94e2d9abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:57.792872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36aede1-31fc-4131-9f34-80f94e2d9abd None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=9f1bc5155deb4cf0bd473ad2c3a0edbf, user.id=469f5a2fb4a443928be150edaeda4900) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:57.793180 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36aede1-31fc-4131-9f34-80f94e2d9abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:57.794626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36aede1-31fc-4131-9f34-80f94e2d9abd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:57.800442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 539/1070] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:12:57 2022] GET /identity/v3/role_assignments?user.id=469f5a2fb4a443928be150edaeda4900&scope.project.id=9f1bc5155deb4cf0bd473ad2c3a0edbf&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:12:57.884546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2fbdf-a826-4e9a-9f14-50af1b543215 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:57.920492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6b07e-172e-4405-81f4-2fe7b04fd853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:57.921106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b07e-172e-4405-81f4-2fe7b04fd853 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:57.921428 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b07e-172e-4405-81f4-2fe7b04fd853 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:57.921697 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b07e-172e-4405-81f4-2fe7b04fd853 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:57.922395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6b07e-172e-4405-81f4-2fe7b04fd853 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:12:57.922695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6b07e-172e-4405-81f4-2fe7b04fd853 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:57.924141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6b07e-172e-4405-81f4-2fe7b04fd853 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:57.941622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 532/1071] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:12:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:12:57.945739 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36aede1-31fc-4131-9f34-80f94e2d9abd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:58.050378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36aede1-31fc-4131-9f34-80f94e2d9abd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:58.085654 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bd384-fd75-481b-8bba-607f550f399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:58.086580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd384-fd75-481b-8bba-607f550f399b None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:58.087007 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd384-fd75-481b-8bba-607f550f399b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:58.087470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd384-fd75-481b-8bba-607f550f399b None admin] PATH_INFO: `/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/fcff121c9e974a6aabaa18775de65f63/roles/616b42d92159431199afb1407a59b3b1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:58.089794 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bd384-fd75-481b-8bba-607f550f399b None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad922f6e2414214abe3ba1de67fc8de, user_id=fcff121c9e974a6aabaa18775de65f63, role_id=616b42d92159431199afb1407a59b3b1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:58.091366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bd384-fd75-481b-8bba-607f550f399b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:58.161143 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 540/1072] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:12:57 2022] PUT /identity/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/fcff121c9e974a6aabaa18775de65f63/roles/616b42d92159431199afb1407a59b3b1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:12:59.228361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd9720-fc7c-4747-bf05-1cf0256a8730 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:59.228862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd9720-fc7c-4747-bf05-1cf0256a8730 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:59.228938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd9720-fc7c-4747-bf05-1cf0256a8730 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:59.230409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 533/1073] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:12:59.235343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e20a3-6442-4535-8c87-700f48b0c583 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:59.235711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e20a3-6442-4535-8c87-700f48b0c583 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:59.235890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e20a3-6442-4535-8c87-700f48b0c583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:59.254305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ff9e20a3-6442-4535-8c87-700f48b0c583 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:12:59.255511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ff9e20a3-6442-4535-8c87-700f48b0c583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:12:59.271789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:59.321117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 541/1074] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:12:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:12:59.586210 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd9720-fc7c-4747-bf05-1cf0256a8730 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:12:59.655752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:59.689304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd9720-fc7c-4747-bf05-1cf0256a8730 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:12:59.723859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b81905-c6af-43ca-88cb-cf106802f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:12:59.725009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b81905-c6af-43ca-88cb-cf106802f669 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:12:59.725309 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b81905-c6af-43ca-88cb-cf106802f669 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:12:59.725586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b81905-c6af-43ca-88cb-cf106802f669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:12:59.792146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b81905-c6af-43ca-88cb-cf106802f669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:12:59.793621 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b81905-c6af-43ca-88cb-cf106802f669 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:12:59.858539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:12:59.895120 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 534/1075] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:12:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:12:59.901597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e20a3-6442-4535-8c87-700f48b0c583 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:00.000923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e20a3-6442-4535-8c87-700f48b0c583 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:00.008175 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b621d-2047-4c60-bde6-1fc310fb2ee3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:00.008452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b621d-2047-4c60-bde6-1fc310fb2ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:00.008725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b621d-2047-4c60-bde6-1fc310fb2ee3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:00.010239 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 535/1076] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:00.015131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405418c-a3cf-4af1-8bea-2c156c0e57ba None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:00.015417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405418c-a3cf-4af1-8bea-2c156c0e57ba None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:00.015691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405418c-a3cf-4af1-8bea-2c156c0e57ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:00.034339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e405418c-a3cf-4af1-8bea-2c156c0e57ba None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:00.035520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e405418c-a3cf-4af1-8bea-2c156c0e57ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:00.041584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ed4fe-2ed8-44a8-bcee-aaad6a51f3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:00.042223 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ed4fe-2ed8-44a8-bcee-aaad6a51f3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:00.042503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ed4fe-2ed8-44a8-bcee-aaad6a51f3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:00.042776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ed4fe-2ed8-44a8-bcee-aaad6a51f3f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:00.053981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ed4fe-2ed8-44a8-bcee-aaad6a51f3f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:00.055541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ed4fe-2ed8-44a8-bcee-aaad6a51f3f0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-fb5ed4fe-2ed8-44a8-bcee-aaad6a51f3f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:13:00.073284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:00.074284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:13:00.075744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:13:00.075744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:13:00.075744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:13:00.075744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 542/1077] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:13:00.080177 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ed4fe-2ed8-44a8-bcee-aaad6a51f3f0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:00.085077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:00.113063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 536/1078] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:13:00.202539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ed4fe-2ed8-44a8-bcee-aaad6a51f3f0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:00.236753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7db773-2f60-4732-a229-7549cf33fc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:00.237486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7db773-2f60-4732-a229-7549cf33fc0a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:00.237659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7db773-2f60-4732-a229-7549cf33fc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:00.237917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7db773-2f60-4732-a229-7549cf33fc0a None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:00.238553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7db773-2f60-4732-a229-7549cf33fc0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:00.238854 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7db773-2f60-4732-a229-7549cf33fc0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:00.240733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7db773-2f60-4732-a229-7549cf33fc0a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:00.252914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 543/1079] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:13:00.282808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447d29a-da08-4f0a-83d5-c1e2a6407aa4 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:00.283339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447d29a-da08-4f0a-83d5-c1e2a6407aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:00.283339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447d29a-da08-4f0a-83d5-c1e2a6407aa4 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:00.285063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 537/1080] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:00.290769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418fca4-5d3d-42ec-95a1-640c66ac2775 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:00.291062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418fca4-5d3d-42ec-95a1-640c66ac2775 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:00.291322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418fca4-5d3d-42ec-95a1-640c66ac2775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:00.311077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3418fca4-5d3d-42ec-95a1-640c66ac2775 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:00.312305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3418fca4-5d3d-42ec-95a1-640c66ac2775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:00.377245 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:00.388495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447d29a-da08-4f0a-83d5-c1e2a6407aa4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:00.389005 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 544/1081] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:00.498576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:00.504030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447d29a-da08-4f0a-83d5-c1e2a6407aa4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:00.539894 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c6f84-6724-45b6-be83-cd99a77bc880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:00.540532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c6f84-6724-45b6-be83-cd99a77bc880 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:00.540808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c6f84-6724-45b6-be83-cd99a77bc880 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:00.541082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c6f84-6724-45b6-be83-cd99a77bc880 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:00.553156 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c6f84-6724-45b6-be83-cd99a77bc880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a25c6f84-6724-45b6-be83-cd99a77bc880 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:13:00.558060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:00.558972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:00.559846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:00.559846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:00.559846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:00.559846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:00.559846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:13:00.559846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:13:00.559846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:13:00.559846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:13:00.559846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:13:00.559846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:13:00.559846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:00.559846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:13:00.559846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 538/1082] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:13:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:13:00.565513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418fca4-5d3d-42ec-95a1-640c66ac2775 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:00.651679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c6f84-6724-45b6-be83-cd99a77bc880 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:00.665198 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418fca4-5d3d-42ec-95a1-640c66ac2775 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:00.699462 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053d56-f186-4cd0-8ea7-2326297bf0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:00.700063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053d56-f186-4cd0-8ea7-2326297bf0ed None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:00.700343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053d56-f186-4cd0-8ea7-2326297bf0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:00.700677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053d56-f186-4cd0-8ea7-2326297bf0ed None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:00.701369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d053d56-f186-4cd0-8ea7-2326297bf0ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:00.701725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d053d56-f186-4cd0-8ea7-2326297bf0ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:00.703128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d053d56-f186-4cd0-8ea7-2326297bf0ed None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:00.711621 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 545/1083] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:13:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:00.717492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053d56-f186-4cd0-8ea7-2326297bf0ed None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:00.750988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c6f84-6724-45b6-be83-cd99a77bc880 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:00.773560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:00.785421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3220a36-8d0a-47b5-a597-af8311dddae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:00.786044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3220a36-8d0a-47b5-a597-af8311dddae8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:00.789510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3220a36-8d0a-47b5-a597-af8311dddae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:00.789510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3220a36-8d0a-47b5-a597-af8311dddae8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:00.797942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3220a36-8d0a-47b5-a597-af8311dddae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b3220a36-8d0a-47b5-a597-af8311dddae8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:13:00.803569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:00.804589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:00.805549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:00.805549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:00.805549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:00.805549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:00.805549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:13:00.805549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:13:00.805549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:13:00.805549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:13:00.805549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:13:00.805549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:13:00.805549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 03:13:00.805549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:13:00.805549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 539/1084] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Sep 13 03:13:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:13:00.810679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3220a36-8d0a-47b5-a597-af8311dddae8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:00.819647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053d56-f186-4cd0-8ea7-2326297bf0ed None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:00.829622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:00.853766 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22370a-9ca6-4232-877d-eb266a79c335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:00.854418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22370a-9ca6-4232-877d-eb266a79c335 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:00.854702 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22370a-9ca6-4232-877d-eb266a79c335 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:00.854974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22370a-9ca6-4232-877d-eb266a79c335 None admin] PATH_INFO: `/v3/users/469f5a2fb4a443928be150edaeda4900` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:00.856099 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22370a-9ca6-4232-877d-eb266a79c335 None admin] RBAC: Authorizing `identity:get_user(user_id=469f5a2fb4a443928be150edaeda4900)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:00.857563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22370a-9ca6-4232-877d-eb266a79c335 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:00.859143 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 546/1085] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:00 2022] GET /identity/v3/users/469f5a2fb4a443928be150edaeda4900 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:13:00.864718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22370a-9ca6-4232-877d-eb266a79c335 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:00.908719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3220a36-8d0a-47b5-a597-af8311dddae8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:00.941173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac931fb-0259-4014-ac96-235bfbf2def0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:00.941807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac931fb-0259-4014-ac96-235bfbf2def0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:00.942090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac931fb-0259-4014-ac96-235bfbf2def0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:00.942367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac931fb-0259-4014-ac96-235bfbf2def0 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:00.943305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac931fb-0259-4014-ac96-235bfbf2def0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:00.943612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac931fb-0259-4014-ac96-235bfbf2def0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:00.944981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac931fb-0259-4014-ac96-235bfbf2def0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:00.952747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 540/1086] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 03:13:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:13:00.959096 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac931fb-0259-4014-ac96-235bfbf2def0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:00.965072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22370a-9ca6-4232-877d-eb266a79c335 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:00.988666 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:00.999214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06e23a-c394-44fa-9d83-b373a1d8bf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:00.999828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e23a-c394-44fa-9d83-b373a1d8bf6f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:01.000102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e23a-c394-44fa-9d83-b373a1d8bf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:01.000370 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e23a-c394-44fa-9d83-b373a1d8bf6f None admin] PATH_INFO: `/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:01.001490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06e23a-c394-44fa-9d83-b373a1d8bf6f None admin] RBAC: Authorizing `identity:get_project(project_id=9f1bc5155deb4cf0bd473ad2c3a0edbf)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:01.002968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06e23a-c394-44fa-9d83-b373a1d8bf6f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:01.004746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 547/1087] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:13:00 2022] GET /identity/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:01.010699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06e23a-c394-44fa-9d83-b373a1d8bf6f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:01.043106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:01.061294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac931fb-0259-4014-ac96-235bfbf2def0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:01.095174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ae0fa-0a8f-4a56-b26b-5b727ea77700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:01.095796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ae0fa-0a8f-4a56-b26b-5b727ea77700 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:01.096098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ae0fa-0a8f-4a56-b26b-5b727ea77700 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:01.096367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ae0fa-0a8f-4a56-b26b-5b727ea77700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:01.107094 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ae0fa-0a8f-4a56-b26b-5b727ea77700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:01.108534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ae0fa-0a8f-4a56-b26b-5b727ea77700 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:01.109060 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06e23a-c394-44fa-9d83-b373a1d8bf6f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f49ae0fa-0a8f-4a56-b26b-5b727ea77700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:13:01.122407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:01.123475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:13:01.124383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:13:01.124383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:13:01.124383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:13:01.124383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 541/1088] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:13:01.129356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ae0fa-0a8f-4a56-b26b-5b727ea77700 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:01.142450 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd07519-8e3d-4f63-ba1f-052565aac644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:01.143118 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd07519-8e3d-4f63-ba1f-052565aac644 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:01.143399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd07519-8e3d-4f63-ba1f-052565aac644 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:01.143673 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd07519-8e3d-4f63-ba1f-052565aac644 None admin] PATH_INFO: `/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf/users/469f5a2fb4a443928be150edaeda4900/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:01.145606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd07519-8e3d-4f63-ba1f-052565aac644 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f1bc5155deb4cf0bd473ad2c3a0edbf, user_id=469f5a2fb4a443928be150edaeda4900, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:01.147533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd07519-8e3d-4f63-ba1f-052565aac644 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:01.222423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 548/1089] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:13:01 2022] PUT /identity/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf/users/469f5a2fb4a443928be150edaeda4900/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:13:01.231878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ae0fa-0a8f-4a56-b26b-5b727ea77700 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:01.264171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:01.270206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4e5b5-07ef-40d0-b5c7-23e0970adf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:01.271558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4e5b5-07ef-40d0-b5c7-23e0970adf47 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:01.271893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4e5b5-07ef-40d0-b5c7-23e0970adf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:01.272173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4e5b5-07ef-40d0-b5c7-23e0970adf47 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:01.272839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4e5b5-07ef-40d0-b5c7-23e0970adf47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:01.273147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4e5b5-07ef-40d0-b5c7-23e0970adf47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:01.274639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4e5b5-07ef-40d0-b5c7-23e0970adf47 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:01.288028 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 542/1090] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:13:01.293904 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd07519-8e3d-4f63-ba1f-052565aac644 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:01.350065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:01.402117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd07519-8e3d-4f63-ba1f-052565aac644 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:01.434696 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12a00f-90dd-4442-96a2-98c824ebf873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:01.435316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12a00f-90dd-4442-96a2-98c824ebf873 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:01.435588 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12a00f-90dd-4442-96a2-98c824ebf873 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:01.435853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12a00f-90dd-4442-96a2-98c824ebf873 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:01.443585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12a00f-90dd-4442-96a2-98c824ebf873 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:01.445006 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12a00f-90dd-4442-96a2-98c824ebf873 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6a12a00f-90dd-4442-96a2-98c824ebf873 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:13:01.455698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:01.456640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:01.457650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:01.457650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:01.457650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:13:01.457650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:13:01.457650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:13:01.457650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:13:01.457650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:13:01.457650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:13:01.457650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 03:13:01.457650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:13:01.457650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 549/1091] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Sep 13 03:13:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:13:01.463043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4e5b5-07ef-40d0-b5c7-23e0970adf47 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:01.561072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4e5b5-07ef-40d0-b5c7-23e0970adf47 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:01.595302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449fad9-fcfb-4541-b08a-873ca373e11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:01.595905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449fad9-fcfb-4541-b08a-873ca373e11e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:01.596181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449fad9-fcfb-4541-b08a-873ca373e11e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:01.596450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449fad9-fcfb-4541-b08a-873ca373e11e None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:01.597171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449fad9-fcfb-4541-b08a-873ca373e11e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:01.597500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449fad9-fcfb-4541-b08a-873ca373e11e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:01.598920 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449fad9-fcfb-4541-b08a-873ca373e11e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:01.616040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 543/1092] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Sep 13 03:13:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:01.621700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12a00f-90dd-4442-96a2-98c824ebf873 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:01.719676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12a00f-90dd-4442-96a2-98c824ebf873 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:01.731977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:01.752637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d283658-e007-4f5e-9a49-2bfc7ec02278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:01.753306 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d283658-e007-4f5e-9a49-2bfc7ec02278 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:01.753585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d283658-e007-4f5e-9a49-2bfc7ec02278 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:01.753856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d283658-e007-4f5e-9a49-2bfc7ec02278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:01.820446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d283658-e007-4f5e-9a49-2bfc7ec02278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:01.821849 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d283658-e007-4f5e-9a49-2bfc7ec02278 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:01.916352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 550/1093] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:13:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:13:01.922088 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449fad9-fcfb-4541-b08a-873ca373e11e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:01.971979 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:02.021450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449fad9-fcfb-4541-b08a-873ca373e11e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:02.055052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bef28-fc98-48e1-b6c4-55866c895446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:02.055674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bef28-fc98-48e1-b6c4-55866c895446 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:02.055951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bef28-fc98-48e1-b6c4-55866c895446 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:02.056223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bef28-fc98-48e1-b6c4-55866c895446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:02.065840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bef28-fc98-48e1-b6c4-55866c895446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:02.067278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bef28-fc98-48e1-b6c4-55866c895446 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-634bef28-fc98-48e1-b6c4-55866c895446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:13:02.081489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:02.082607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:13:02.083788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:13:02.083788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:13:02.083788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:13:02.085590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 544/1094] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:13:02.088373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d283658-e007-4f5e-9a49-2bfc7ec02278 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:02.103708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:02.189338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d283658-e007-4f5e-9a49-2bfc7ec02278 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:02.221189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6d6bd-c441-477a-8343-efa2cc0c6ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:02.221803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d6bd-c441-477a-8343-efa2cc0c6ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:02.222078 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d6bd-c441-477a-8343-efa2cc0c6ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:02.222345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d6bd-c441-477a-8343-efa2cc0c6ee9 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:02.222969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6d6bd-c441-477a-8343-efa2cc0c6ee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:02.223264 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6d6bd-c441-477a-8343-efa2cc0c6ee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:02.225105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6d6bd-c441-477a-8343-efa2cc0c6ee9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:02.235816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 551/1095] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:02.242046 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bef28-fc98-48e1-b6c4-55866c895446 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:02.338956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bef28-fc98-48e1-b6c4-55866c895446 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:02.340430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:02.371812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a8a80-068b-407e-bcf4-27734f84833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:02.372425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a8a80-068b-407e-bcf4-27734f84833b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:02.372698 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a8a80-068b-407e-bcf4-27734f84833b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:02.372964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a8a80-068b-407e-bcf4-27734f84833b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:02.379581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a8a80-068b-407e-bcf4-27734f84833b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:02.380996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a8a80-068b-407e-bcf4-27734f84833b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-0d8a8a80-068b-407e-bcf4-27734f84833b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:13:02.392202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:02.393084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:02.394122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:13:02.394122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:13:02.394122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:13:02.394122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:13:02.394122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:13:02.394122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:13:02.394122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:13:02.394122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:13:02.397417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 545/1096] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:13:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:13:02.399665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6d6bd-c441-477a-8343-efa2cc0c6ee9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:02.468239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:02.497531 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6d6bd-c441-477a-8343-efa2cc0c6ee9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:02.530927 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00ba36-7aec-466c-bc6b-e0a5d3ad7da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:02.531529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ba36-7aec-466c-bc6b-e0a5d3ad7da5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:02.531808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ba36-7aec-466c-bc6b-e0a5d3ad7da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:02.532076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ba36-7aec-466c-bc6b-e0a5d3ad7da5 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:02.532759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00ba36-7aec-466c-bc6b-e0a5d3ad7da5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:02.533062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00ba36-7aec-466c-bc6b-e0a5d3ad7da5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:02.534524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00ba36-7aec-466c-bc6b-e0a5d3ad7da5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:02.547608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 552/1097] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:02.553467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a8a80-068b-407e-bcf4-27734f84833b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:02.651367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a8a80-068b-407e-bcf4-27734f84833b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:02.683960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d62651-e6a8-40fc-811f-52ae4f280c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:02.684553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d62651-e6a8-40fc-811f-52ae4f280c1c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:02.684829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d62651-e6a8-40fc-811f-52ae4f280c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:02.685099 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d62651-e6a8-40fc-811f-52ae4f280c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:02.685843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d62651-e6a8-40fc-811f-52ae4f280c1c None admin] RBAC: Adding query filter params (role.id=616b42d92159431199afb1407a59b3b1, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=fcff121c9e974a6aabaa18775de65f63) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:02.686152 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d62651-e6a8-40fc-811f-52ae4f280c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:02.687575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d62651-e6a8-40fc-811f-52ae4f280c1c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:02.693403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 546/1098] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:13:02 2022] GET /identity/v3/role_assignments?user.id=fcff121c9e974a6aabaa18775de65f63&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=616b42d92159431199afb1407a59b3b1 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:03.375692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8680c3-eec1-402e-b2ac-5e61d3657dd5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:03.375983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8680c3-eec1-402e-b2ac-5e61d3657dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:03.376258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8680c3-eec1-402e-b2ac-5e61d3657dd5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:03.377754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 553/1099] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:03.383974 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f98763-9d72-415b-a0a3-219d57139a16 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:03.384407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f98763-9d72-415b-a0a3-219d57139a16 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:03.384519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f98763-9d72-415b-a0a3-219d57139a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:03.402532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e7f98763-9d72-415b-a0a3-219d57139a16 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:03.403699 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e7f98763-9d72-415b-a0a3-219d57139a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:03.423957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:03.473427 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 547/1100] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:03.743603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8680c3-eec1-402e-b2ac-5e61d3657dd5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:03.842184 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8680c3-eec1-402e-b2ac-5e61d3657dd5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:03.870434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:03.875114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e501da3-0264-48d1-a85e-f5db8e9130b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:03.875736 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501da3-0264-48d1-a85e-f5db8e9130b9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:03.876011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501da3-0264-48d1-a85e-f5db8e9130b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:03.876281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501da3-0264-48d1-a85e-f5db8e9130b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:03.886201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e501da3-0264-48d1-a85e-f5db8e9130b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-7e501da3-0264-48d1-a85e-f5db8e9130b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:13:03.891037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:03.891996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:03.892847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:03.892847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:03.892847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:03.892847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:03.892847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:13:03.892847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:13:03.892847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:13:03.892847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:13:03.892847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:13:03.892847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:13:03.892847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:03.892847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:13:03.892847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 554/1101] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:13:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:13:03.898631 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f98763-9d72-415b-a0a3-219d57139a16 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:03.994642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f98763-9d72-415b-a0a3-219d57139a16 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:04.026971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bb0ce-103e-469c-85fa-84f3be4e4bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:04.027556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bb0ce-103e-469c-85fa-84f3be4e4bea None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:04.027829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bb0ce-103e-469c-85fa-84f3be4e4bea None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:04.028096 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bb0ce-103e-469c-85fa-84f3be4e4bea None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:04.028745 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bb0ce-103e-469c-85fa-84f3be4e4bea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:04.029042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bb0ce-103e-469c-85fa-84f3be4e4bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:04.030423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bb0ce-103e-469c-85fa-84f3be4e4bea None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:04.038533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 548/1102] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:13:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:04.044321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e501da3-0264-48d1-a85e-f5db8e9130b9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:04.139740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e501da3-0264-48d1-a85e-f5db8e9130b9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:04.173526 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105859f-ae98-42ed-8368-cdf9ca8522c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:04.174168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105859f-ae98-42ed-8368-cdf9ca8522c4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:04.174444 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105859f-ae98-42ed-8368-cdf9ca8522c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:04.174713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105859f-ae98-42ed-8368-cdf9ca8522c4 None admin] PATH_INFO: `/v3/users/469f5a2fb4a443928be150edaeda4900` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:04.175810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105859f-ae98-42ed-8368-cdf9ca8522c4 None admin] RBAC: Authorizing `identity:get_user(user_id=469f5a2fb4a443928be150edaeda4900)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:04.177313 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105859f-ae98-42ed-8368-cdf9ca8522c4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:04.178878 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 555/1103] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:04 2022] GET /identity/v3/users/469f5a2fb4a443928be150edaeda4900 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:04.184541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bb0ce-103e-469c-85fa-84f3be4e4bea None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:04.203150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:04.281966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bb0ce-103e-469c-85fa-84f3be4e4bea None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:04.313426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6e05e-8ef7-497f-bb09-1f44f438e6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:04.314012 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6e05e-8ef7-497f-bb09-1f44f438e6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:04.314284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6e05e-8ef7-497f-bb09-1f44f438e6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:04.314551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6e05e-8ef7-497f-bb09-1f44f438e6c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:04.378009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6e05e-8ef7-497f-bb09-1f44f438e6c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:04.379449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6e05e-8ef7-497f-bb09-1f44f438e6c6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:04.397440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:04.474455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 549/1104] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:13:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:13:04.480210 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105859f-ae98-42ed-8368-cdf9ca8522c4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:04.537251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:04.575806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105859f-ae98-42ed-8368-cdf9ca8522c4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:04.607865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610066c-13d3-4a98-8002-fa418b757ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:04.608471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610066c-13d3-4a98-8002-fa418b757ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:04.608743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610066c-13d3-4a98-8002-fa418b757ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:04.609015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610066c-13d3-4a98-8002-fa418b757ce3 None admin] PATH_INFO: `/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:04.610123 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610066c-13d3-4a98-8002-fa418b757ce3 None admin] RBAC: Authorizing `identity:get_project(project_id=9f1bc5155deb4cf0bd473ad2c3a0edbf)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:04.611530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610066c-13d3-4a98-8002-fa418b757ce3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:04.613105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 556/1105] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:13:04 2022] GET /identity/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:04.619633 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6e05e-8ef7-497f-bb09-1f44f438e6c6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:04.714100 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6e05e-8ef7-497f-bb09-1f44f438e6c6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:04.730450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:04.746921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97848aec-9a58-4c47-88c3-81c28e43c970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:04.747505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97848aec-9a58-4c47-88c3-81c28e43c970 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:04.747780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97848aec-9a58-4c47-88c3-81c28e43c970 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:04.748048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97848aec-9a58-4c47-88c3-81c28e43c970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:04.748756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97848aec-9a58-4c47-88c3-81c28e43c970 None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=9f1bc5155deb4cf0bd473ad2c3a0edbf, user.id=469f5a2fb4a443928be150edaeda4900) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:04.749060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97848aec-9a58-4c47-88c3-81c28e43c970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:04.750515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97848aec-9a58-4c47-88c3-81c28e43c970 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:04.756600 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 550/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:13:04 2022] GET /identity/v3/role_assignments?user.id=469f5a2fb4a443928be150edaeda4900&scope.project.id=9f1bc5155deb4cf0bd473ad2c3a0edbf&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:06.904748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ba7e-0350-48e3-a88b-2ff4a839aba1 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:06.905303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ba7e-0350-48e3-a88b-2ff4a839aba1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:06.909130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ba7e-0350-48e3-a88b-2ff4a839aba1 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:06.909130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 557/1107] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:06.912421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768766-a8b1-45e5-b3e8-497079022461 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:06.912838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768766-a8b1-45e5-b3e8-497079022461 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:06.912987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768766-a8b1-45e5-b3e8-497079022461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:06.930751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cd768766-a8b1-45e5-b3e8-497079022461 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:06.931936 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cd768766-a8b1-45e5-b3e8-497079022461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:06.996409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 551/1108] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:07.266291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ba7e-0350-48e3-a88b-2ff4a839aba1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:07.363829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ba7e-0350-48e3-a88b-2ff4a839aba1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:07.389483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:07.396830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cca56-527c-4128-ac19-2b0e68c5f0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:07.397460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cca56-527c-4128-ac19-2b0e68c5f0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:07.397740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cca56-527c-4128-ac19-2b0e68c5f0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:07.398010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cca56-527c-4128-ac19-2b0e68c5f0f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:07.399102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cca56-527c-4128-ac19-2b0e68c5f0f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:07.400783 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cca56-527c-4128-ac19-2b0e68c5f0f0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:07.402064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 558/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:13:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:07.407861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd768766-a8b1-45e5-b3e8-497079022461 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:07.502549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd768766-a8b1-45e5-b3e8-497079022461 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:07.516584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:07.541679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2cf511-f091-4631-bd21-616eb0db6c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:07.542493 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf511-f091-4631-bd21-616eb0db6c8c None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:07.542825 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf511-f091-4631-bd21-616eb0db6c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:07.543183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cf511-f091-4631-bd21-616eb0db6c8c None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:07.543926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cf511-f091-4631-bd21-616eb0db6c8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:07.545737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cf511-f091-4631-bd21-616eb0db6c8c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:07.643209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 552/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:13:07 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:13:09.803466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58c6b-b76a-4d26-924a-e233c4031b97 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:09.804030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58c6b-b76a-4d26-924a-e233c4031b97 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:09.804030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58c6b-b76a-4d26-924a-e233c4031b97 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:09.805337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 559/1111] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:09.810574 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a2792-4beb-4d13-9b9b-a02f3e6624c6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:09.810939 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a2792-4beb-4d13-9b9b-a02f3e6624c6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:09.811125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a2792-4beb-4d13-9b9b-a02f3e6624c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:09.828842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-372a2792-4beb-4d13-9b9b-a02f3e6624c6 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:09.830056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-372a2792-4beb-4d13-9b9b-a02f3e6624c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:09.894482 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 553/1112] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:10.160005 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc58c6b-b76a-4d26-924a-e233c4031b97 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:10.258023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc58c6b-b76a-4d26-924a-e233c4031b97 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:10.290129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654945-b85a-4470-8ad9-64139d011a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:10.290729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654945-b85a-4470-8ad9-64139d011a5b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:10.291003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654945-b85a-4470-8ad9-64139d011a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:10.291269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654945-b85a-4470-8ad9-64139d011a5b None admin] PATH_INFO: `/v3/roles/e577106295c544bfbe1944b178cb95e5` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:10.292611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76654945-b85a-4470-8ad9-64139d011a5b None admin] RBAC: Authorizing `identity:get_role(role_id=e577106295c544bfbe1944b178cb95e5)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:10.293990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76654945-b85a-4470-8ad9-64139d011a5b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:10.295270 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 560/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:10 2022] GET /identity/v3/roles/e577106295c544bfbe1944b178cb95e5 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:10.300897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a2792-4beb-4d13-9b9b-a02f3e6624c6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:10.392614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:10.396656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a2792-4beb-4d13-9b9b-a02f3e6624c6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:10.428976 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8e186-f8ee-4455-b2a8-3154c7f8f0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:10.429567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8e186-f8ee-4455-b2a8-3154c7f8f0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:10.429844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8e186-f8ee-4455-b2a8-3154c7f8f0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:10.430114 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8e186-f8ee-4455-b2a8-3154c7f8f0e2 None admin] PATH_INFO: `/v3/users/ab85d05e489b4b9595cc4f8b9a9c2981` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:10.443062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8e186-f8ee-4455-b2a8-3154c7f8f0e2 None admin] RBAC: Authorizing `identity:get_user(user_id=ab85d05e489b4b9595cc4f8b9a9c2981)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:10.444518 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8e186-f8ee-4455-b2a8-3154c7f8f0e2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:10.446109 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 554/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:10 2022] GET /identity/v3/users/ab85d05e489b4b9595cc4f8b9a9c2981 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:10.451693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654945-b85a-4470-8ad9-64139d011a5b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:10.512221 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:10.547740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654945-b85a-4470-8ad9-64139d011a5b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:10.579828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8a5f0-5311-4044-ac75-eeec922030e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:10.580392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8a5f0-5311-4044-ac75-eeec922030e1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:10.580665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8a5f0-5311-4044-ac75-eeec922030e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:10.580931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8a5f0-5311-4044-ac75-eeec922030e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:10.645492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8a5f0-5311-4044-ac75-eeec922030e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:10.646926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8a5f0-5311-4044-ac75-eeec922030e1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:10.703782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:10.740527 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 561/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:13:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:13:10.746434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8e186-f8ee-4455-b2a8-3154c7f8f0e2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:10.842759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8e186-f8ee-4455-b2a8-3154c7f8f0e2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:10.875064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514d60d-698d-4418-acad-4b803719cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:10.875670 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514d60d-698d-4418-acad-4b803719cab5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:10.875942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514d60d-698d-4418-acad-4b803719cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:10.876208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514d60d-698d-4418-acad-4b803719cab5 None admin] PATH_INFO: `/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:10.877322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514d60d-698d-4418-acad-4b803719cab5 None admin] RBAC: Authorizing `identity:get_project(project_id=9f1bc5155deb4cf0bd473ad2c3a0edbf)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:10.878739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514d60d-698d-4418-acad-4b803719cab5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:10.881153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 555/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:13:10 2022] GET /identity/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:10.887361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8a5f0-5311-4044-ac75-eeec922030e1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:10.981617 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8a5f0-5311-4044-ac75-eeec922030e1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:11.014054 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416678f1-5a68-4a11-b769-2bfa48e6c213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:11.014633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416678f1-5a68-4a11-b769-2bfa48e6c213 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:11.014909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416678f1-5a68-4a11-b769-2bfa48e6c213 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:11.015172 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416678f1-5a68-4a11-b769-2bfa48e6c213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:11.015874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416678f1-5a68-4a11-b769-2bfa48e6c213 None admin] RBAC: Adding query filter params (role.id=e577106295c544bfbe1944b178cb95e5, scope.project.id=9f1bc5155deb4cf0bd473ad2c3a0edbf, user.id=ab85d05e489b4b9595cc4f8b9a9c2981) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:11.016174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416678f1-5a68-4a11-b769-2bfa48e6c213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:11.017600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416678f1-5a68-4a11-b769-2bfa48e6c213 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:11.022732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 562/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:13:10 2022] GET /identity/v3/role_assignments?user.id=ab85d05e489b4b9595cc4f8b9a9c2981&scope.project.id=9f1bc5155deb4cf0bd473ad2c3a0edbf&role.id=e577106295c544bfbe1944b178cb95e5 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:13.116683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0180d9-0af0-4522-882d-24847499ba87 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:13.117247 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0180d9-0af0-4522-882d-24847499ba87 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:13.117247 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0180d9-0af0-4522-882d-24847499ba87 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:13.118582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 556/1118] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:13.123700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bd404-fb02-49f4-b723-d4d7f427c1fc None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:13.124085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bd404-fb02-49f4-b723-d4d7f427c1fc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:13.124242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bd404-fb02-49f4-b723-d4d7f427c1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:13.142825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4d0bd404-fb02-49f4-b723-d4d7f427c1fc None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:13.143983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4d0bd404-fb02-49f4-b723-d4d7f427c1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:13.166085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:13.208773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 563/1119] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:13.477964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0180d9-0af0-4522-882d-24847499ba87 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:13.502755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:13.575794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0180d9-0af0-4522-882d-24847499ba87 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:13.610700 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b986eb3-9bdc-4df4-b71a-7b548b27cd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:13.611447 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b986eb3-9bdc-4df4-b71a-7b548b27cd63 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:13.611726 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b986eb3-9bdc-4df4-b71a-7b548b27cd63 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:13.612045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b986eb3-9bdc-4df4-b71a-7b548b27cd63 None admin] PATH_INFO: `/v3/roles/e577106295c544bfbe1944b178cb95e5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:13.613475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b986eb3-9bdc-4df4-b71a-7b548b27cd63 None admin] RBAC: Authorizing `identity:get_role(role_id=e577106295c544bfbe1944b178cb95e5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:13.614871 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b986eb3-9bdc-4df4-b71a-7b548b27cd63 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:13.616148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 557/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:13 2022] GET /identity/v3/roles/e577106295c544bfbe1944b178cb95e5 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:13.621936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bd404-fb02-49f4-b723-d4d7f427c1fc None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:13.716850 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bd404-fb02-49f4-b723-d4d7f427c1fc None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:13.749460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3013bf-79a0-40c7-9045-5e1e9b015fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:13.750008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3013bf-79a0-40c7-9045-5e1e9b015fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:13.750286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3013bf-79a0-40c7-9045-5e1e9b015fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:13.750557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3013bf-79a0-40c7-9045-5e1e9b015fd7 None admin] PATH_INFO: `/v3/users/ab85d05e489b4b9595cc4f8b9a9c2981` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:13.751662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3013bf-79a0-40c7-9045-5e1e9b015fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=ab85d05e489b4b9595cc4f8b9a9c2981)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:13.753072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3013bf-79a0-40c7-9045-5e1e9b015fd7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:13.754675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 564/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:13 2022] GET /identity/v3/users/ab85d05e489b4b9595cc4f8b9a9c2981 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:13.760362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b986eb3-9bdc-4df4-b71a-7b548b27cd63 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:13.847020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:13.855851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b986eb3-9bdc-4df4-b71a-7b548b27cd63 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:13.888232 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986034d-9bf7-4f08-a1be-63e0584fc2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:13.888831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986034d-9bf7-4f08-a1be-63e0584fc2cb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:13.889102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986034d-9bf7-4f08-a1be-63e0584fc2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:13.889399 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986034d-9bf7-4f08-a1be-63e0584fc2cb None admin] PATH_INFO: `/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:13.890488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986034d-9bf7-4f08-a1be-63e0584fc2cb None admin] RBAC: Authorizing `identity:get_project(project_id=9f1bc5155deb4cf0bd473ad2c3a0edbf)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:13.891892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986034d-9bf7-4f08-a1be-63e0584fc2cb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:13.893494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 558/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:13:13 2022] GET /identity/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:13.899750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3013bf-79a0-40c7-9045-5e1e9b015fd7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:13.926607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:13.996344 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3013bf-79a0-40c7-9045-5e1e9b015fd7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:14.030360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d64b0e-8c2f-4101-b26e-ef38168aaa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:14.030934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d64b0e-8c2f-4101-b26e-ef38168aaa07 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:14.031209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d64b0e-8c2f-4101-b26e-ef38168aaa07 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:14.031477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d64b0e-8c2f-4101-b26e-ef38168aaa07 None admin] PATH_INFO: `/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf/users/ab85d05e489b4b9595cc4f8b9a9c2981/roles/e577106295c544bfbe1944b178cb95e5` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:14.033598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d64b0e-8c2f-4101-b26e-ef38168aaa07 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f1bc5155deb4cf0bd473ad2c3a0edbf, user_id=ab85d05e489b4b9595cc4f8b9a9c2981, role_id=e577106295c544bfbe1944b178cb95e5)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:14.035013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d64b0e-8c2f-4101-b26e-ef38168aaa07 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:14.106560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 565/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:13:13 2022] PUT /identity/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf/users/ab85d05e489b4b9595cc4f8b9a9c2981/roles/e577106295c544bfbe1944b178cb95e5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:13:16.189940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d4be-11bc-4123-a32a-68446ead9cc7 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:16.190377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d4be-11bc-4123-a32a-68446ead9cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:16.190466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d4be-11bc-4123-a32a-68446ead9cc7 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:16.191795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 559/1124] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:16.197083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097445ff-1698-46be-9140-de5b6f011d28 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:16.197536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097445ff-1698-46be-9140-de5b6f011d28 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:16.197658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097445ff-1698-46be-9140-de5b6f011d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:16.215732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-097445ff-1698-46be-9140-de5b6f011d28 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:16.216902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-097445ff-1698-46be-9140-de5b6f011d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:16.281739 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 566/1125] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:16.546040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d4be-11bc-4123-a32a-68446ead9cc7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:16.642991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d4be-11bc-4123-a32a-68446ead9cc7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:16.674757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0096e2c-c9eb-4516-8f54-85b8e093f485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:16.675362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0096e2c-c9eb-4516-8f54-85b8e093f485 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:16.675635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0096e2c-c9eb-4516-8f54-85b8e093f485 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:16.676423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0096e2c-c9eb-4516-8f54-85b8e093f485 None admin] PATH_INFO: `/v3/roles/e577106295c544bfbe1944b178cb95e5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:16.677813 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0096e2c-c9eb-4516-8f54-85b8e093f485 None admin] RBAC: Authorizing `identity:get_role(role_id=e577106295c544bfbe1944b178cb95e5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:16.679157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0096e2c-c9eb-4516-8f54-85b8e093f485 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:16.680434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 560/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:16 2022] GET /identity/v3/roles/e577106295c544bfbe1944b178cb95e5 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:16.686047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097445ff-1698-46be-9140-de5b6f011d28 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:16.703640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:16.781925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097445ff-1698-46be-9140-de5b6f011d28 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:16.814279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e10cc-39a6-4295-8008-2b6316ed17a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:16.814835 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e10cc-39a6-4295-8008-2b6316ed17a3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:16.815108 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e10cc-39a6-4295-8008-2b6316ed17a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:16.815374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e10cc-39a6-4295-8008-2b6316ed17a3 None admin] PATH_INFO: `/v3/users/ab85d05e489b4b9595cc4f8b9a9c2981` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:16.816501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e10cc-39a6-4295-8008-2b6316ed17a3 None admin] RBAC: Authorizing `identity:get_user(user_id=ab85d05e489b4b9595cc4f8b9a9c2981)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:16.818484 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e10cc-39a6-4295-8008-2b6316ed17a3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:16.820032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 567/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:16 2022] GET /identity/v3/users/ab85d05e489b4b9595cc4f8b9a9c2981 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:16.825776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0096e2c-c9eb-4516-8f54-85b8e093f485 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:16.853100 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:16.923033 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0096e2c-c9eb-4516-8f54-85b8e093f485 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:16.956517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1193cfb-6523-4521-a482-584afed73254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:16.957109 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1193cfb-6523-4521-a482-584afed73254 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:16.957418 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1193cfb-6523-4521-a482-584afed73254 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:16.957692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1193cfb-6523-4521-a482-584afed73254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:17.022613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1193cfb-6523-4521-a482-584afed73254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:17.024051 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1193cfb-6523-4521-a482-584afed73254 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:17.049736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:17.119368 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 561/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:13:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:13:17.125134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e10cc-39a6-4295-8008-2b6316ed17a3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:17.206891 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:17.222048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e10cc-39a6-4295-8008-2b6316ed17a3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:17.256366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6224ecf-f0f5-44c0-9e4f-b1a3742252ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:17.256985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6224ecf-f0f5-44c0-9e4f-b1a3742252ef None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:17.257285 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6224ecf-f0f5-44c0-9e4f-b1a3742252ef None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:17.257557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6224ecf-f0f5-44c0-9e4f-b1a3742252ef None admin] PATH_INFO: `/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:17.258658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6224ecf-f0f5-44c0-9e4f-b1a3742252ef None admin] RBAC: Authorizing `identity:get_project(project_id=9f1bc5155deb4cf0bd473ad2c3a0edbf)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:17.260112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6224ecf-f0f5-44c0-9e4f-b1a3742252ef None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:17.261768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 568/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:13:17 2022] GET /identity/v3/projects/9f1bc5155deb4cf0bd473ad2c3a0edbf => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:13:17.268892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1193cfb-6523-4521-a482-584afed73254 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:17.364121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1193cfb-6523-4521-a482-584afed73254 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:17.389456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:17.397378 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237cee7-250f-4acd-b2e9-b8a333dc0338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:17.397969 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237cee7-250f-4acd-b2e9-b8a333dc0338 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:17.398242 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237cee7-250f-4acd-b2e9-b8a333dc0338 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:17.398510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237cee7-250f-4acd-b2e9-b8a333dc0338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:17.399218 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237cee7-250f-4acd-b2e9-b8a333dc0338 None admin] RBAC: Adding query filter params (role.id=e577106295c544bfbe1944b178cb95e5, scope.project.id=9f1bc5155deb4cf0bd473ad2c3a0edbf, user.id=ab85d05e489b4b9595cc4f8b9a9c2981) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:17.399520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237cee7-250f-4acd-b2e9-b8a333dc0338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:17.400916 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237cee7-250f-4acd-b2e9-b8a333dc0338 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:17.406373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 562/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:13:17 2022] GET /identity/v3/role_assignments?user.id=ab85d05e489b4b9595cc4f8b9a9c2981&scope.project.id=9f1bc5155deb4cf0bd473ad2c3a0edbf&role.id=e577106295c544bfbe1944b178cb95e5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:19.521089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a827f51-8382-425f-9d9e-8981c4077737 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:19.521662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a827f51-8382-425f-9d9e-8981c4077737 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:19.521662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a827f51-8382-425f-9d9e-8981c4077737 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:19.523020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 569/1131] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:19.528361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811fe55-c157-4c7a-93ac-146e334a6065 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:19.528772 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811fe55-c157-4c7a-93ac-146e334a6065 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:19.528908 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811fe55-c157-4c7a-93ac-146e334a6065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:19.547137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e811fe55-c157-4c7a-93ac-146e334a6065 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:19.548301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e811fe55-c157-4c7a-93ac-146e334a6065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:19.612316 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 563/1132] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:19.882015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a827f51-8382-425f-9d9e-8981c4077737 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:19.982323 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a827f51-8382-425f-9d9e-8981c4077737 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:20.015677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a09729-db7b-43f5-9ad1-da62aa3d9561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:20.016288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a09729-db7b-43f5-9ad1-da62aa3d9561 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:20.016566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a09729-db7b-43f5-9ad1-da62aa3d9561 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:20.016840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a09729-db7b-43f5-9ad1-da62aa3d9561 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:20.018080 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a09729-db7b-43f5-9ad1-da62aa3d9561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:20.020137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a09729-db7b-43f5-9ad1-da62aa3d9561 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:20.021713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 570/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:13:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:20.027409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811fe55-c157-4c7a-93ac-146e334a6065 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:20.120551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811fe55-c157-4c7a-93ac-146e334a6065 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:20.142596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:20.154406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af5fce-49b6-4c95-aab1-66c4caaa06ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:20.162201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5fce-49b6-4c95-aab1-66c4caaa06ea None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:20.162201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5fce-49b6-4c95-aab1-66c4caaa06ea None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:20.162201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5fce-49b6-4c95-aab1-66c4caaa06ea None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:20.162201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af5fce-49b6-4c95-aab1-66c4caaa06ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:20.162201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af5fce-49b6-4c95-aab1-66c4caaa06ea None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:20.250491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 564/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:13:20 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:13:22.405136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea69466-7c51-4808-b2e8-e4fcc16dc292 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:22.405685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea69466-7c51-4808-b2e8-e4fcc16dc292 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:22.405685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea69466-7c51-4808-b2e8-e4fcc16dc292 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:22.406950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 571/1135] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:22.412559 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22e310-3699-4491-ba33-6492fc4c66c4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:22.412975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22e310-3699-4491-ba33-6492fc4c66c4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:22.413112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22e310-3699-4491-ba33-6492fc4c66c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:22.431405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ea22e310-3699-4491-ba33-6492fc4c66c4 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:22.432985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ea22e310-3699-4491-ba33-6492fc4c66c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:22.497227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 565/1136] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:22.767982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea69466-7c51-4808-b2e8-e4fcc16dc292 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:22.789153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:22.865930 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea69466-7c51-4808-b2e8-e4fcc16dc292 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:22.899306 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb235c-8c68-4780-a012-d3b9eca93cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:22.908907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb235c-8c68-4780-a012-d3b9eca93cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:22.908907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb235c-8c68-4780-a012-d3b9eca93cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:22.908907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb235c-8c68-4780-a012-d3b9eca93cf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:22.908907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb235c-8c68-4780-a012-d3b9eca93cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:22.908907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb235c-8c68-4780-a012-d3b9eca93cf0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:22.908907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 572/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:13:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:22.910056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22e310-3699-4491-ba33-6492fc4c66c4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:23.011001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22e310-3699-4491-ba33-6492fc4c66c4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:23.013318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:23.043728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c1858-d4ef-4700-b20e-f377edf8fb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:23.044269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c1858-d4ef-4700-b20e-f377edf8fb90 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:23.044557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c1858-d4ef-4700-b20e-f377edf8fb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:23.044825 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c1858-d4ef-4700-b20e-f377edf8fb90 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:23.045503 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c1858-d4ef-4700-b20e-f377edf8fb90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:23.046940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c1858-d4ef-4700-b20e-f377edf8fb90 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:23.144935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 566/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:13:22 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:13:25.309242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24036d6a-56b2-41bb-adea-3836f26321cf None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:25.309810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24036d6a-56b2-41bb-adea-3836f26321cf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:25.309810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24036d6a-56b2-41bb-adea-3836f26321cf None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:25.311160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 573/1139] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:25.316868 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaedb3-54b5-47ff-a983-38b6d4ee3cf1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:25.317248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaedb3-54b5-47ff-a983-38b6d4ee3cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:25.317451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaaedb3-54b5-47ff-a983-38b6d4ee3cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:25.336411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ceaaedb3-54b5-47ff-a983-38b6d4ee3cf1 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:25.337607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ceaaedb3-54b5-47ff-a983-38b6d4ee3cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:25.402003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 567/1140] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:25.668245 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24036d6a-56b2-41bb-adea-3836f26321cf None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:25.754285 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:25.766852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24036d6a-56b2-41bb-adea-3836f26321cf None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:25.799533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a2c29-8a9d-4027-9164-af0c0da6cc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:25.800669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a2c29-8a9d-4027-9164-af0c0da6cc0c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:25.800947 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a2c29-8a9d-4027-9164-af0c0da6cc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:25.801227 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a2c29-8a9d-4027-9164-af0c0da6cc0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:25.811490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a2c29-8a9d-4027-9164-af0c0da6cc0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-4b0a2c29-8a9d-4027-9164-af0c0da6cc0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:13:25.816764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:25.821403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:25.822583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:25.822583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:25.822583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:25.822583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:25.822583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:13:25.822583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:13:25.822583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:13:25.822583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:13:25.822583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:13:25.822583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:13:25.822583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:25.822583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:13:25.822583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 574/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:13:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:13:25.823804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaedb3-54b5-47ff-a983-38b6d4ee3cf1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:25.908735 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:25.918011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaaedb3-54b5-47ff-a983-38b6d4ee3cf1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:25.950852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164b3d1-6fd6-4f96-99e0-952b50fc3537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:25.951412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164b3d1-6fd6-4f96-99e0-952b50fc3537 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:25.951690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164b3d1-6fd6-4f96-99e0-952b50fc3537 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:25.952157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164b3d1-6fd6-4f96-99e0-952b50fc3537 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:25.952958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164b3d1-6fd6-4f96-99e0-952b50fc3537 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:25.953588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164b3d1-6fd6-4f96-99e0-952b50fc3537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:25.962558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164b3d1-6fd6-4f96-99e0-952b50fc3537 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:25.962717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 568/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:13:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:25.968476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a2c29-8a9d-4027-9164-af0c0da6cc0c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:26.067410 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a2c29-8a9d-4027-9164-af0c0da6cc0c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:26.099615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7fbb-c3c7-4c0d-a9f7-9f6057cce9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:26.100227 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7fbb-c3c7-4c0d-a9f7-9f6057cce9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:26.100503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7fbb-c3c7-4c0d-a9f7-9f6057cce9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:26.100772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7fbb-c3c7-4c0d-a9f7-9f6057cce9d2 None admin] PATH_INFO: `/v3/users/75a0095da9d84b80935db6d18d0facc2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:26.113993 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec7fbb-c3c7-4c0d-a9f7-9f6057cce9d2 None admin] RBAC: Authorizing `identity:get_user(user_id=75a0095da9d84b80935db6d18d0facc2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:26.115417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec7fbb-c3c7-4c0d-a9f7-9f6057cce9d2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:26.117028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 575/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:25 2022] GET /identity/v3/users/75a0095da9d84b80935db6d18d0facc2 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:26.122875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164b3d1-6fd6-4f96-99e0-952b50fc3537 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:26.219811 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164b3d1-6fd6-4f96-99e0-952b50fc3537 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:26.252722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f9595-287a-4a1f-819d-3a455f4a3c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:26.253360 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f9595-287a-4a1f-819d-3a455f4a3c04 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:26.253637 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f9595-287a-4a1f-819d-3a455f4a3c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:26.253902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f9595-287a-4a1f-819d-3a455f4a3c04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:26.274089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:26.317935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f9595-287a-4a1f-819d-3a455f4a3c04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:26.319377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f9595-287a-4a1f-819d-3a455f4a3c04 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:26.412813 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 569/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:13:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:13:26.418840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7fbb-c3c7-4c0d-a9f7-9f6057cce9d2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:26.427385 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:26.514731 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7fbb-c3c7-4c0d-a9f7-9f6057cce9d2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:26.547551 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58707c9-6cda-47a7-a491-01120e5e84f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:26.548169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58707c9-6cda-47a7-a491-01120e5e84f4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:26.548442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58707c9-6cda-47a7-a491-01120e5e84f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:26.548711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58707c9-6cda-47a7-a491-01120e5e84f4 None admin] PATH_INFO: `/v3/projects/318656617e224bec98e0264262b132c8` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:26.549856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58707c9-6cda-47a7-a491-01120e5e84f4 None admin] RBAC: Authorizing `identity:get_project(project_id=318656617e224bec98e0264262b132c8)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:26.551382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58707c9-6cda-47a7-a491-01120e5e84f4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:26.552977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 576/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:13:26 2022] GET /identity/v3/projects/318656617e224bec98e0264262b132c8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:26.559069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f9595-287a-4a1f-819d-3a455f4a3c04 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:26.610552 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:26.658094 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f9595-287a-4a1f-819d-3a455f4a3c04 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:26.694910 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cb536-223e-4e04-bead-912e8a5e82e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:26.695508 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cb536-223e-4e04-bead-912e8a5e82e5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:26.695787 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cb536-223e-4e04-bead-912e8a5e82e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:26.696061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cb536-223e-4e04-bead-912e8a5e82e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:26.696775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cb536-223e-4e04-bead-912e8a5e82e5 None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=318656617e224bec98e0264262b132c8, user.id=75a0095da9d84b80935db6d18d0facc2) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:26.697082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cb536-223e-4e04-bead-912e8a5e82e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:26.698539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cb536-223e-4e04-bead-912e8a5e82e5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:26.703797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 570/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:13:26 2022] GET /identity/v3/role_assignments?user.id=75a0095da9d84b80935db6d18d0facc2&scope.project.id=318656617e224bec98e0264262b132c8&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:28.812617 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e358e-95d3-46e6-b071-76648f29f16b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:28.813168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e358e-95d3-46e6-b071-76648f29f16b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:28.813168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e358e-95d3-46e6-b071-76648f29f16b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:28.814510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 577/1147] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:28.820127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6435cb0-4fb3-4b09-9c09-5294f495b06a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:28.820572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6435cb0-4fb3-4b09-9c09-5294f495b06a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:28.820679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6435cb0-4fb3-4b09-9c09-5294f495b06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:28.838389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d6435cb0-4fb3-4b09-9c09-5294f495b06a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:28.839566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d6435cb0-4fb3-4b09-9c09-5294f495b06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:28.905055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 571/1148] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:29.179266 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e358e-95d3-46e6-b071-76648f29f16b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:29.252055 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:29.276542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e358e-95d3-46e6-b071-76648f29f16b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:29.310075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d79ee-3204-4502-a80a-7b4bfb6bf783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:29.310678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d79ee-3204-4502-a80a-7b4bfb6bf783 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:29.310952 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d79ee-3204-4502-a80a-7b4bfb6bf783 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:29.311218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d79ee-3204-4502-a80a-7b4bfb6bf783 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:29.321076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d79ee-3204-4502-a80a-7b4bfb6bf783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-de1d79ee-3204-4502-a80a-7b4bfb6bf783 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:13:29.325822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:29.326957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:29.328176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:29.328176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:29.328176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:29.328176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:29.328176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:13:29.328176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:13:29.328176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:13:29.328176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:13:29.328176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:13:29.328176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:13:29.328176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:29.328176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:13:29.328176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 578/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:13:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:13:29.333384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6435cb0-4fb3-4b09-9c09-5294f495b06a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:29.379271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:29.431483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6435cb0-4fb3-4b09-9c09-5294f495b06a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:29.464141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b573efa-debd-4487-9c1d-854ca59a942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:29.464734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b573efa-debd-4487-9c1d-854ca59a942c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:29.465012 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b573efa-debd-4487-9c1d-854ca59a942c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:29.465303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b573efa-debd-4487-9c1d-854ca59a942c None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:29.465966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b573efa-debd-4487-9c1d-854ca59a942c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:29.466268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b573efa-debd-4487-9c1d-854ca59a942c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:29.467638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b573efa-debd-4487-9c1d-854ca59a942c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:29.475921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 572/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:13:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:29.481550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d79ee-3204-4502-a80a-7b4bfb6bf783 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:29.576820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d79ee-3204-4502-a80a-7b4bfb6bf783 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:29.610461 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa708a-c491-4601-94a2-9d3ce2e8fccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:29.611074 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa708a-c491-4601-94a2-9d3ce2e8fccb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:29.611354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa708a-c491-4601-94a2-9d3ce2e8fccb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:29.611630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa708a-c491-4601-94a2-9d3ce2e8fccb None admin] PATH_INFO: `/v3/users/75a0095da9d84b80935db6d18d0facc2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:29.612759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa708a-c491-4601-94a2-9d3ce2e8fccb None admin] RBAC: Authorizing `identity:get_user(user_id=75a0095da9d84b80935db6d18d0facc2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:29.614285 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa708a-c491-4601-94a2-9d3ce2e8fccb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:29.615838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 579/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:29 2022] GET /identity/v3/users/75a0095da9d84b80935db6d18d0facc2 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:29.621483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b573efa-debd-4487-9c1d-854ca59a942c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:29.717011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b573efa-debd-4487-9c1d-854ca59a942c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:29.725968 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:29.749196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d4983-d62a-484e-8d82-bb89282a0de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:29.749875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4983-d62a-484e-8d82-bb89282a0de2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:29.750155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4983-d62a-484e-8d82-bb89282a0de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:29.750428 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4983-d62a-484e-8d82-bb89282a0de2 None admin] PATH_INFO: `/v3/projects/318656617e224bec98e0264262b132c8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:29.751534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d4983-d62a-484e-8d82-bb89282a0de2 None admin] RBAC: Authorizing `identity:get_project(project_id=318656617e224bec98e0264262b132c8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:29.753495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d4983-d62a-484e-8d82-bb89282a0de2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:29.755083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 573/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:13:29 2022] GET /identity/v3/projects/318656617e224bec98e0264262b132c8 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:29.761226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa708a-c491-4601-94a2-9d3ce2e8fccb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:29.764123 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:29.858585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa708a-c491-4601-94a2-9d3ce2e8fccb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:29.891323 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7fe49-17cb-4b0b-b435-eae81f509428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:29.891961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7fe49-17cb-4b0b-b435-eae81f509428 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:29.892239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7fe49-17cb-4b0b-b435-eae81f509428 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:29.892518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7fe49-17cb-4b0b-b435-eae81f509428 None admin] PATH_INFO: `/v3/projects/318656617e224bec98e0264262b132c8/users/75a0095da9d84b80935db6d18d0facc2/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:29.894964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7fe49-17cb-4b0b-b435-eae81f509428 None admin] RBAC: Authorizing `identity:create_grant(project_id=318656617e224bec98e0264262b132c8, user_id=75a0095da9d84b80935db6d18d0facc2, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:29.896385 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7fe49-17cb-4b0b-b435-eae81f509428 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:29.980570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 580/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:13:29 2022] PUT /identity/v3/projects/318656617e224bec98e0264262b132c8/users/75a0095da9d84b80935db6d18d0facc2/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:13:32.089167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e284e-c8c3-4b2b-91e7-02472e5c7023 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:32.089738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e284e-c8c3-4b2b-91e7-02472e5c7023 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:32.089738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e284e-c8c3-4b2b-91e7-02472e5c7023 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:32.091074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 574/1154] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:32.096703 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c716-4070-4dc7-888e-71059f808c02 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:32.097131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c716-4070-4dc7-888e-71059f808c02 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:32.097274 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2c716-4070-4dc7-888e-71059f808c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:32.115827 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e7c2c716-4070-4dc7-888e-71059f808c02 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:32.116993 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e7c2c716-4070-4dc7-888e-71059f808c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:32.171499 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:32.181881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 581/1155] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:32.446279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e284e-c8c3-4b2b-91e7-02472e5c7023 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:32.544905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e284e-c8c3-4b2b-91e7-02472e5c7023 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:32.576249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf89208-dfdf-47f6-9833-9376c657187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:32.576849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf89208-dfdf-47f6-9833-9376c657187f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:32.577122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf89208-dfdf-47f6-9833-9376c657187f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:32.577421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf89208-dfdf-47f6-9833-9376c657187f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:32.588035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf89208-dfdf-47f6-9833-9376c657187f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-abf89208-dfdf-47f6-9833-9376c657187f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:13:32.592730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:32.593907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:32.595066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:32.595066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:32.595066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:32.595066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:32.595066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:13:32.595066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:13:32.595066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:13:32.595066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:13:32.595066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:13:32.595066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:13:32.595066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:32.595066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:13:32.595066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 575/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:13:32.600301 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2c716-4070-4dc7-888e-71059f808c02 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:32.693472 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2c716-4070-4dc7-888e-71059f808c02 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:32.726476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd64c2d-3341-4c62-ad1c-615de447eb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:32.727066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd64c2d-3341-4c62-ad1c-615de447eb66 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:32.727342 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd64c2d-3341-4c62-ad1c-615de447eb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:32.727612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd64c2d-3341-4c62-ad1c-615de447eb66 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:32.728267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd64c2d-3341-4c62-ad1c-615de447eb66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:32.728570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd64c2d-3341-4c62-ad1c-615de447eb66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:32.729977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd64c2d-3341-4c62-ad1c-615de447eb66 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:32.737781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 582/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:13:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:32.743426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf89208-dfdf-47f6-9833-9376c657187f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:32.777934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:32.839123 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf89208-dfdf-47f6-9833-9376c657187f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:32.870534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961498a5-0059-436b-a8f7-914cb6af1232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:32.871145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961498a5-0059-436b-a8f7-914cb6af1232 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:32.871419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961498a5-0059-436b-a8f7-914cb6af1232 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:32.871688 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961498a5-0059-436b-a8f7-914cb6af1232 None admin] PATH_INFO: `/v3/users/75a0095da9d84b80935db6d18d0facc2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:32.872777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961498a5-0059-436b-a8f7-914cb6af1232 None admin] RBAC: Authorizing `identity:get_user(user_id=75a0095da9d84b80935db6d18d0facc2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:32.874226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961498a5-0059-436b-a8f7-914cb6af1232 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:32.875749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 576/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:32 2022] GET /identity/v3/users/75a0095da9d84b80935db6d18d0facc2 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:32.882173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd64c2d-3341-4c62-ad1c-615de447eb66 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:32.936549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:32.981149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd64c2d-3341-4c62-ad1c-615de447eb66 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:33.014496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeb4a0-7c5b-46b2-922f-31874104108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:33.015086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb4a0-7c5b-46b2-922f-31874104108e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:33.015361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb4a0-7c5b-46b2-922f-31874104108e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:33.015628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb4a0-7c5b-46b2-922f-31874104108e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:33.080198 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeb4a0-7c5b-46b2-922f-31874104108e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:33.082331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeb4a0-7c5b-46b2-922f-31874104108e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:33.133649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:33.177395 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 583/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:13:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:13:33.183267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961498a5-0059-436b-a8f7-914cb6af1232 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:33.278562 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961498a5-0059-436b-a8f7-914cb6af1232 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:33.280718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:33.310356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec29329-2b9f-4acb-aa00-bab1f468d49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:33.311028 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec29329-2b9f-4acb-aa00-bab1f468d49b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:33.311307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec29329-2b9f-4acb-aa00-bab1f468d49b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:33.311769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec29329-2b9f-4acb-aa00-bab1f468d49b None admin] PATH_INFO: `/v3/projects/318656617e224bec98e0264262b132c8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:33.313211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec29329-2b9f-4acb-aa00-bab1f468d49b None admin] RBAC: Authorizing `identity:get_project(project_id=318656617e224bec98e0264262b132c8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:33.314655 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec29329-2b9f-4acb-aa00-bab1f468d49b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:33.316820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 577/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:13:33 2022] GET /identity/v3/projects/318656617e224bec98e0264262b132c8 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:33.322802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeb4a0-7c5b-46b2-922f-31874104108e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:33.418009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeb4a0-7c5b-46b2-922f-31874104108e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:33.451227 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d58e45-be82-446f-8ffa-df623dc5e4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:33.451810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d58e45-be82-446f-8ffa-df623dc5e4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:33.452087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d58e45-be82-446f-8ffa-df623dc5e4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:33.452358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d58e45-be82-446f-8ffa-df623dc5e4f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:33.453065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d58e45-be82-446f-8ffa-df623dc5e4f7 None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=318656617e224bec98e0264262b132c8, user.id=75a0095da9d84b80935db6d18d0facc2) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:33.453399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d58e45-be82-446f-8ffa-df623dc5e4f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:33.454825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d58e45-be82-446f-8ffa-df623dc5e4f7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:33.460472 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 584/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:13:33 2022] GET /identity/v3/role_assignments?user.id=75a0095da9d84b80935db6d18d0facc2&scope.project.id=318656617e224bec98e0264262b132c8&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:35.601061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb3767-29fe-4aab-bd6d-f26c57c1a36c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:35.601609 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb3767-29fe-4aab-bd6d-f26c57c1a36c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:35.601768 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb3767-29fe-4aab-bd6d-f26c57c1a36c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:35.603115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 578/1162] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:35.608323 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4b5e6-3e3a-4ff6-9be8-929002dfd0c1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:35.608725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4b5e6-3e3a-4ff6-9be8-929002dfd0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:35.608873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4b5e6-3e3a-4ff6-9be8-929002dfd0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:35.627445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4ba4b5e6-3e3a-4ff6-9be8-929002dfd0c1 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:35.628622 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4ba4b5e6-3e3a-4ff6-9be8-929002dfd0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:35.641697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:35.693587 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 585/1163] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:35.960369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb3767-29fe-4aab-bd6d-f26c57c1a36c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:36.059795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb3767-29fe-4aab-bd6d-f26c57c1a36c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:36.092758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a24643-3018-4d00-9d19-043d3f24109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:36.093374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a24643-3018-4d00-9d19-043d3f24109e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:36.093655 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a24643-3018-4d00-9d19-043d3f24109e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:36.093929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a24643-3018-4d00-9d19-043d3f24109e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:36.134063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:36.160673 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a24643-3018-4d00-9d19-043d3f24109e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:36.162165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a24643-3018-4d00-9d19-043d3f24109e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:36.258440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 579/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:13:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:13:36.264301 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4b5e6-3e3a-4ff6-9be8-929002dfd0c1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:36.358357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4b5e6-3e3a-4ff6-9be8-929002dfd0c1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:36.391364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8f09f-f201-4c32-81ef-776eede113ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:36.391974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8f09f-f201-4c32-81ef-776eede113ac None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:36.392246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8f09f-f201-4c32-81ef-776eede113ac None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:36.392509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8f09f-f201-4c32-81ef-776eede113ac None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:36.398863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8f09f-f201-4c32-81ef-776eede113ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:36.400284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8f09f-f201-4c32-81ef-776eede113ac None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-36e8f09f-f201-4c32-81ef-776eede113ac None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:36.411338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:36.412377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:13:36.413374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 586/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 03:13:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:13:36.418145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a24643-3018-4d00-9d19-043d3f24109e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:36.485739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:36.515294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a24643-3018-4d00-9d19-043d3f24109e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:36.548491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a96088-72a7-4684-bf70-65a820fc890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:36.549718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a96088-72a7-4684-bf70-65a820fc890c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:36.550000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a96088-72a7-4684-bf70-65a820fc890c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:36.550274 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a96088-72a7-4684-bf70-65a820fc890c None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:36.550908 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a96088-72a7-4684-bf70-65a820fc890c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:36.551211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a96088-72a7-4684-bf70-65a820fc890c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:36.552579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a96088-72a7-4684-bf70-65a820fc890c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:36.559593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 580/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Sep 13 03:13:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:38.675464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475edd3-64dd-43ac-96c4-f94e4708916e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:38.676096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475edd3-64dd-43ac-96c4-f94e4708916e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:38.676096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475edd3-64dd-43ac-96c4-f94e4708916e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:38.677351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 587/1167] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:38.682584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca108569-1e38-4411-b32e-6953829a91a9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:38.682993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca108569-1e38-4411-b32e-6953829a91a9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:38.683133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca108569-1e38-4411-b32e-6953829a91a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:38.700819 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ca108569-1e38-4411-b32e-6953829a91a9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:38.702027 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ca108569-1e38-4411-b32e-6953829a91a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:38.766122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 581/1168] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:39.035828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475edd3-64dd-43ac-96c4-f94e4708916e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:39.046688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:39.133710 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475edd3-64dd-43ac-96c4-f94e4708916e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:39.165821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527206bb-a4cf-4441-83d0-026965b67879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:39.166414 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527206bb-a4cf-4441-83d0-026965b67879 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:39.166688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527206bb-a4cf-4441-83d0-026965b67879 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:39.166955 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527206bb-a4cf-4441-83d0-026965b67879 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:39.167600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527206bb-a4cf-4441-83d0-026965b67879 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:39.168953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527206bb-a4cf-4441-83d0-026965b67879 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:39.230232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 588/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Tue Sep 13 03:13:39 2022] POST /identity/v3/domains => generated 267 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:13:41.366884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb818f-0fbe-4765-a460-241cc435834e None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:41.367421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb818f-0fbe-4765-a460-241cc435834e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:41.367421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb818f-0fbe-4765-a460-241cc435834e None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:41.368765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 582/1170] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:41.374058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e5258-bf71-4600-8816-23a89f958c40 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:41.374470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e5258-bf71-4600-8816-23a89f958c40 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:41.374613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e5258-bf71-4600-8816-23a89f958c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:41.393058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-264e5258-bf71-4600-8816-23a89f958c40 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:41.394280 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-264e5258-bf71-4600-8816-23a89f958c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:41.453327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:41.458890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 589/1171] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:41.731098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb818f-0fbe-4765-a460-241cc435834e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:41.795599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:41.829079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb818f-0fbe-4765-a460-241cc435834e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:41.862532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037ffb4-82ff-48cb-8412-0dfb3a6763be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:41.863147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037ffb4-82ff-48cb-8412-0dfb3a6763be None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:41.863421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037ffb4-82ff-48cb-8412-0dfb3a6763be None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:41.863691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037ffb4-82ff-48cb-8412-0dfb3a6763be None admin] PATH_INFO: `/v3/domains/c8d17e3acff0417f9ea34e2d72435955` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:41.873621 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037ffb4-82ff-48cb-8412-0dfb3a6763be None admin] RBAC: Authorizing `identity:get_domain(domain_id=c8d17e3acff0417f9ea34e2d72435955)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:41.875065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037ffb4-82ff-48cb-8412-0dfb3a6763be None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:41.876620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 583/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Tue Sep 13 03:13:41 2022] GET /identity/v3/domains/c8d17e3acff0417f9ea34e2d72435955 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:41.882625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e5258-bf71-4600-8816-23a89f958c40 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:41.978637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e5258-bf71-4600-8816-23a89f958c40 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:42.012124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea346c9-0f36-4a87-ab52-bd37076864d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:42.012657 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea346c9-0f36-4a87-ab52-bd37076864d9 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:42.012936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea346c9-0f36-4a87-ab52-bd37076864d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:42.013207 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea346c9-0f36-4a87-ab52-bd37076864d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:42.013883 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea346c9-0f36-4a87-ab52-bd37076864d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:42.015305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea346c9-0f36-4a87-ab52-bd37076864d9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:42.094897 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 590/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:13:41 2022] POST /identity/v3/projects => generated 361 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:13:44.236644 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdf7a0-bcd5-40d9-94c3-a2a700808dce None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:44.237124 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdf7a0-bcd5-40d9-94c3-a2a700808dce None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:44.237223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdf7a0-bcd5-40d9-94c3-a2a700808dce None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:44.238541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 584/1174] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:44.243751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d6e6-c4b9-4340-82fb-61ece4235008 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:44.244188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d6e6-c4b9-4340-82fb-61ece4235008 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:44.244288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d6e6-c4b9-4340-82fb-61ece4235008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:44.262385 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a8d2d6e6-c4b9-4340-82fb-61ece4235008 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:44.263555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a8d2d6e6-c4b9-4340-82fb-61ece4235008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:44.308873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:44.328078 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 591/1175] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:44.592933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdf7a0-bcd5-40d9-94c3-a2a700808dce None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:44.691269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdf7a0-bcd5-40d9-94c3-a2a700808dce None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:44.715201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:44.723874 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb8826-396b-4bb0-8316-565ed2b088c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:44.728179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb8826-396b-4bb0-8316-565ed2b088c1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:44.728179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb8826-396b-4bb0-8316-565ed2b088c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:44.728179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb8826-396b-4bb0-8316-565ed2b088c1 None admin] PATH_INFO: `/v3/domains/c8d17e3acff0417f9ea34e2d72435955` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:44.728179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb8826-396b-4bb0-8316-565ed2b088c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c8d17e3acff0417f9ea34e2d72435955)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:44.728179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb8826-396b-4bb0-8316-565ed2b088c1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:44.729085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 585/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Tue Sep 13 03:13:44 2022] GET /identity/v3/domains/c8d17e3acff0417f9ea34e2d72435955 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:44.734918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2d6e6-c4b9-4340-82fb-61ece4235008 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:44.830744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2d6e6-c4b9-4340-82fb-61ece4235008 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:44.862667 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e500a-e940-47d9-aee9-3ec130195c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:44.863202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e500a-e940-47d9-aee9-3ec130195c7a None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:44.863479 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e500a-e940-47d9-aee9-3ec130195c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:44.863747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e500a-e940-47d9-aee9-3ec130195c7a None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:44.864377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e500a-e940-47d9-aee9-3ec130195c7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:44.865838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e500a-e940-47d9-aee9-3ec130195c7a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:44.940559 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 592/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:13:44 2022] POST /identity/v3/users => generated 311 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:13:47.088694 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd1b23-40a8-49a9-9d04-d30e000eed09 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:47.089249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd1b23-40a8-49a9-9d04-d30e000eed09 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:47.089249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd1b23-40a8-49a9-9d04-d30e000eed09 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:47.090588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 586/1178] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:47.096340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80482a-d2bc-45ce-ac68-5145cd97b76e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:47.096722 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80482a-d2bc-45ce-ac68-5145cd97b76e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:47.096888 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80482a-d2bc-45ce-ac68-5145cd97b76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:47.115393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0e80482a-d2bc-45ce-ac68-5145cd97b76e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:47.116578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0e80482a-d2bc-45ce-ac68-5145cd97b76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:47.144635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:47.182289 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 593/1179] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:47.448468 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd1b23-40a8-49a9-9d04-d30e000eed09 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:47.547996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd1b23-40a8-49a9-9d04-d30e000eed09 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:47.579092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e0c2b-ff3c-452d-a69e-5cb8a25ceb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:47.580220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e0c2b-ff3c-452d-a69e-5cb8a25ceb1d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:47.580491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e0c2b-ff3c-452d-a69e-5cb8a25ceb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:47.580757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e0c2b-ff3c-452d-a69e-5cb8a25ceb1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:47.591127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e0c2b-ff3c-452d-a69e-5cb8a25ceb1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e02e0c2b-ff3c-452d-a69e-5cb8a25ceb1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:13:47.596430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:47.597634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:47.598765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:47.598765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:47.598765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:47.598765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:47.598765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:13:47.598765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:13:47.598765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:13:47.598765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:13:47.598765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:13:47.598765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:13:47.598765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:47.598765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:13:47.598765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 587/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:13:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:13:47.603373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80482a-d2bc-45ce-ac68-5145cd97b76e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:47.697160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80482a-d2bc-45ce-ac68-5145cd97b76e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:47.729821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34943a-b09e-4de4-8d99-227e4a8aefe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:47.730428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34943a-b09e-4de4-8d99-227e4a8aefe9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:47.730698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34943a-b09e-4de4-8d99-227e4a8aefe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:47.730962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34943a-b09e-4de4-8d99-227e4a8aefe9 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:47.731602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34943a-b09e-4de4-8d99-227e4a8aefe9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:47.731988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34943a-b09e-4de4-8d99-227e4a8aefe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:47.733354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34943a-b09e-4de4-8d99-227e4a8aefe9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:47.740977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 594/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:13:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:47.746683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e0c2b-ff3c-452d-a69e-5cb8a25ceb1d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:47.800439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:47.844403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e0c2b-ff3c-452d-a69e-5cb8a25ceb1d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:47.876883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67efd2-2b4f-4086-9476-a0c4905dba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:47.877521 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67efd2-2b4f-4086-9476-a0c4905dba1e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:47.877803 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67efd2-2b4f-4086-9476-a0c4905dba1e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:47.878076 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67efd2-2b4f-4086-9476-a0c4905dba1e None admin] PATH_INFO: `/v3/users/b5f2d6fea430411b96b6c5aeb0ad64a0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:47.890803 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67efd2-2b4f-4086-9476-a0c4905dba1e None admin] RBAC: Authorizing `identity:get_user(user_id=b5f2d6fea430411b96b6c5aeb0ad64a0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:47.892847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67efd2-2b4f-4086-9476-a0c4905dba1e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:47.894451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 588/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:47 2022] GET /identity/v3/users/b5f2d6fea430411b96b6c5aeb0ad64a0 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:47.900049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34943a-b09e-4de4-8d99-227e4a8aefe9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:47.928044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:47.997630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34943a-b09e-4de4-8d99-227e4a8aefe9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:48.030495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68585190-a02f-439e-93d9-4dd060081898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:48.031083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68585190-a02f-439e-93d9-4dd060081898 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:48.031359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68585190-a02f-439e-93d9-4dd060081898 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:48.031629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68585190-a02f-439e-93d9-4dd060081898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:48.096767 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68585190-a02f-439e-93d9-4dd060081898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:48.098237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68585190-a02f-439e-93d9-4dd060081898 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:48.123967 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:48.194476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 595/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:13:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:13:48.200377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67efd2-2b4f-4086-9476-a0c4905dba1e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:48.295783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67efd2-2b4f-4086-9476-a0c4905dba1e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:48.308686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:48.329361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe3cd5-b73f-4051-bc14-3da5c7999223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:48.329975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe3cd5-b73f-4051-bc14-3da5c7999223 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:48.330252 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe3cd5-b73f-4051-bc14-3da5c7999223 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:48.330522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe3cd5-b73f-4051-bc14-3da5c7999223 None admin] PATH_INFO: `/v3/projects/3c42fbaef19846b380938d44e5d3b249` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:48.331623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe3cd5-b73f-4051-bc14-3da5c7999223 None admin] RBAC: Authorizing `identity:get_project(project_id=3c42fbaef19846b380938d44e5d3b249)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:48.333044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe3cd5-b73f-4051-bc14-3da5c7999223 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:48.334680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 589/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:13:48 2022] GET /identity/v3/projects/3c42fbaef19846b380938d44e5d3b249 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:48.340738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68585190-a02f-439e-93d9-4dd060081898 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:48.437486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68585190-a02f-439e-93d9-4dd060081898 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:48.463033 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:48.471202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67777411-8cfe-4e36-af3b-d3a3463321d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:48.476751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67777411-8cfe-4e36-af3b-d3a3463321d7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:48.476751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67777411-8cfe-4e36-af3b-d3a3463321d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:48.476751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67777411-8cfe-4e36-af3b-d3a3463321d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:48.476751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67777411-8cfe-4e36-af3b-d3a3463321d7 None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=3c42fbaef19846b380938d44e5d3b249, user.id=b5f2d6fea430411b96b6c5aeb0ad64a0) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:48.476751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67777411-8cfe-4e36-af3b-d3a3463321d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:48.476751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67777411-8cfe-4e36-af3b-d3a3463321d7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:48.479924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 596/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:13:48 2022] GET /identity/v3/role_assignments?user.id=b5f2d6fea430411b96b6c5aeb0ad64a0&scope.project.id=3c42fbaef19846b380938d44e5d3b249&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:50.588891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47308f-7ea0-494b-b3f1-43c0c4dfed9f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:50.589445 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47308f-7ea0-494b-b3f1-43c0c4dfed9f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:50.589445 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47308f-7ea0-494b-b3f1-43c0c4dfed9f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:50.590803 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 590/1186] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:50.595957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9b651-7b56-4a67-9d46-8d056fb8e35c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:50.596377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9b651-7b56-4a67-9d46-8d056fb8e35c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:50.596502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9b651-7b56-4a67-9d46-8d056fb8e35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:50.614671 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bbf9b651-7b56-4a67-9d46-8d056fb8e35c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:50.615844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bbf9b651-7b56-4a67-9d46-8d056fb8e35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:50.680643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 597/1187] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:50.947284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47308f-7ea0-494b-b3f1-43c0c4dfed9f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:51.045472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47308f-7ea0-494b-b3f1-43c0c4dfed9f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:51.078115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a4c1c-038b-40a1-b2f9-31b92289632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:51.078724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a4c1c-038b-40a1-b2f9-31b92289632e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:51.079527 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a4c1c-038b-40a1-b2f9-31b92289632e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:51.079801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a4c1c-038b-40a1-b2f9-31b92289632e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:51.089591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a4c1c-038b-40a1-b2f9-31b92289632e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-be9a4c1c-038b-40a1-b2f9-31b92289632e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:13:51.094356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:51.096136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:51.097185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:51.097185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:51.097185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:51.097185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:51.097185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:13:51.097185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:13:51.097185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:13:51.097185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:13:51.097185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:13:51.097185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:13:51.097185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:51.097185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:13:51.097185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 591/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:13:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:13:51.101943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9b651-7b56-4a67-9d46-8d056fb8e35c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:51.199397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9b651-7b56-4a67-9d46-8d056fb8e35c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:51.221925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:51.232794 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bff86-a182-462c-811f-6a970cb8ef2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:51.233412 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bff86-a182-462c-811f-6a970cb8ef2c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:51.233688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bff86-a182-462c-811f-6a970cb8ef2c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:51.233955 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bff86-a182-462c-811f-6a970cb8ef2c None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:51.234609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bff86-a182-462c-811f-6a970cb8ef2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:51.234904 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bff86-a182-462c-811f-6a970cb8ef2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:51.236330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bff86-a182-462c-811f-6a970cb8ef2c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:51.243973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 598/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:13:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:51.250671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a4c1c-038b-40a1-b2f9-31b92289632e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:51.292273 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:51.347784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a4c1c-038b-40a1-b2f9-31b92289632e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:51.379683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385eb5e-30ef-42bf-ba36-d03307771579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:51.380288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385eb5e-30ef-42bf-ba36-d03307771579 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:51.380557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385eb5e-30ef-42bf-ba36-d03307771579 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:51.380822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385eb5e-30ef-42bf-ba36-d03307771579 None admin] PATH_INFO: `/v3/users/b5f2d6fea430411b96b6c5aeb0ad64a0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:51.381895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385eb5e-30ef-42bf-ba36-d03307771579 None admin] RBAC: Authorizing `identity:get_user(user_id=b5f2d6fea430411b96b6c5aeb0ad64a0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:51.383305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385eb5e-30ef-42bf-ba36-d03307771579 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:51.384831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 592/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:51 2022] GET /identity/v3/users/b5f2d6fea430411b96b6c5aeb0ad64a0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:51.390446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bff86-a182-462c-811f-6a970cb8ef2c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:51.486688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bff86-a182-462c-811f-6a970cb8ef2c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:51.519797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1d44b-e685-4e55-bea6-04017f653acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:51.520404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1d44b-e685-4e55-bea6-04017f653acc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:51.520684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1d44b-e685-4e55-bea6-04017f653acc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:51.520956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1d44b-e685-4e55-bea6-04017f653acc None admin] PATH_INFO: `/v3/projects/3c42fbaef19846b380938d44e5d3b249` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:51.522094 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1d44b-e685-4e55-bea6-04017f653acc None admin] RBAC: Authorizing `identity:get_project(project_id=3c42fbaef19846b380938d44e5d3b249)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:51.523519 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1d44b-e685-4e55-bea6-04017f653acc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:51.525121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 599/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:13:51 2022] GET /identity/v3/projects/3c42fbaef19846b380938d44e5d3b249 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:51.530860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385eb5e-30ef-42bf-ba36-d03307771579 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:51.626510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385eb5e-30ef-42bf-ba36-d03307771579 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:51.635619 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:51.659570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492f228-8e4c-40e4-897a-8f599428124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:51.660211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492f228-8e4c-40e4-897a-8f599428124e None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:51.660487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492f228-8e4c-40e4-897a-8f599428124e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:51.660758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492f228-8e4c-40e4-897a-8f599428124e None admin] PATH_INFO: `/v3/projects/3c42fbaef19846b380938d44e5d3b249/users/b5f2d6fea430411b96b6c5aeb0ad64a0/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:51.662666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492f228-8e4c-40e4-897a-8f599428124e None admin] RBAC: Authorizing `identity:create_grant(project_id=3c42fbaef19846b380938d44e5d3b249, user_id=b5f2d6fea430411b96b6c5aeb0ad64a0, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:51.664085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492f228-8e4c-40e4-897a-8f599428124e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:51.725482 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 593/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:13:51 2022] PUT /identity/v3/projects/3c42fbaef19846b380938d44e5d3b249/users/b5f2d6fea430411b96b6c5aeb0ad64a0/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:13:53.817582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e91e1-080a-4552-8e27-6314d49569a0 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:53.818107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e91e1-080a-4552-8e27-6314d49569a0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:53.818107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e91e1-080a-4552-8e27-6314d49569a0 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:53.819458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 600/1193] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:13:53.824517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008a0f6-c2a7-45a3-9cb3-84c74a89438f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:53.824930 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008a0f6-c2a7-45a3-9cb3-84c74a89438f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:53.825064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008a0f6-c2a7-45a3-9cb3-84c74a89438f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:53.843372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e008a0f6-c2a7-45a3-9cb3-84c74a89438f None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:13:53.844547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e008a0f6-c2a7-45a3-9cb3-84c74a89438f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:13:53.908378 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 594/1194] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:13:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:13:54.175620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e91e1-080a-4552-8e27-6314d49569a0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:54.227379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:54.274269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e91e1-080a-4552-8e27-6314d49569a0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:54.308332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3271eff-bc48-4f4d-b856-8014a7d5da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:54.308936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3271eff-bc48-4f4d-b856-8014a7d5da63 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:54.309208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3271eff-bc48-4f4d-b856-8014a7d5da63 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:54.309502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3271eff-bc48-4f4d-b856-8014a7d5da63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:54.320126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3271eff-bc48-4f4d-b856-8014a7d5da63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f3271eff-bc48-4f4d-b856-8014a7d5da63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:13:54.324858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:13:54.325951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:13:54.326954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:13:54.326954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:13:54.326954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:13:54.326954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:13:54.326954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:13:54.326954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:13:54.326954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:13:54.326954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:13:54.326954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:13:54.326954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:13:54.326954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:13:54.326954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:13:54.326954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 601/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:13:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:13:54.331848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008a0f6-c2a7-45a3-9cb3-84c74a89438f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:54.422347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:54.426704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008a0f6-c2a7-45a3-9cb3-84c74a89438f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:54.459765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3c7f9-3e86-4908-b066-93f9f6394bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:54.460355 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3c7f9-3e86-4908-b066-93f9f6394bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:54.460631 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3c7f9-3e86-4908-b066-93f9f6394bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:54.460900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3c7f9-3e86-4908-b066-93f9f6394bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:54.461592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3c7f9-3e86-4908-b066-93f9f6394bc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:54.461895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3c7f9-3e86-4908-b066-93f9f6394bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:54.463255 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3c7f9-3e86-4908-b066-93f9f6394bc7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:54.471411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 595/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:13:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:54.477413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3271eff-bc48-4f4d-b856-8014a7d5da63 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:54.573660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3271eff-bc48-4f4d-b856-8014a7d5da63 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:54.585702 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:54.605400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc50d05-7205-48ad-b1f4-b58dd13b07c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:54.606879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc50d05-7205-48ad-b1f4-b58dd13b07c2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:54.606879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc50d05-7205-48ad-b1f4-b58dd13b07c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:54.606879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc50d05-7205-48ad-b1f4-b58dd13b07c2 None admin] PATH_INFO: `/v3/users/b5f2d6fea430411b96b6c5aeb0ad64a0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:54.607633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc50d05-7205-48ad-b1f4-b58dd13b07c2 None admin] RBAC: Authorizing `identity:get_user(user_id=b5f2d6fea430411b96b6c5aeb0ad64a0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:54.609038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc50d05-7205-48ad-b1f4-b58dd13b07c2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:54.611231 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 602/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Sep 13 03:13:54 2022] GET /identity/v3/users/b5f2d6fea430411b96b6c5aeb0ad64a0 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:54.616877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3c7f9-3e86-4908-b066-93f9f6394bc7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:54.712516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3c7f9-3e86-4908-b066-93f9f6394bc7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:54.744992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405a0d2-9c19-4783-a5f1-3b7373f4b978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:54.745607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405a0d2-9c19-4783-a5f1-3b7373f4b978 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:54.745885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405a0d2-9c19-4783-a5f1-3b7373f4b978 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:54.746154 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405a0d2-9c19-4783-a5f1-3b7373f4b978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:54.772339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:54.810743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405a0d2-9c19-4783-a5f1-3b7373f4b978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:54.812174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405a0d2-9c19-4783-a5f1-3b7373f4b978 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:54.906315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 596/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:13:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:13:54.912637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc50d05-7205-48ad-b1f4-b58dd13b07c2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:55.008061 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc50d05-7205-48ad-b1f4-b58dd13b07c2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:55.040162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09182e-a1f8-4386-8c75-402aee13bd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:55.040763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09182e-a1f8-4386-8c75-402aee13bd79 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:55.041035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09182e-a1f8-4386-8c75-402aee13bd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:55.041325 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09182e-a1f8-4386-8c75-402aee13bd79 None admin] PATH_INFO: `/v3/projects/3c42fbaef19846b380938d44e5d3b249` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:55.042401 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09182e-a1f8-4386-8c75-402aee13bd79 None admin] RBAC: Authorizing `identity:get_project(project_id=3c42fbaef19846b380938d44e5d3b249)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:55.043805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09182e-a1f8-4386-8c75-402aee13bd79 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:55.045385 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 603/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Sep 13 03:13:54 2022] GET /identity/v3/projects/3c42fbaef19846b380938d44e5d3b249 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:13:55.051335 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405a0d2-9c19-4783-a5f1-3b7373f4b978 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:13:55.107680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:13:55.146634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405a0d2-9c19-4783-a5f1-3b7373f4b978 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:13:55.180348 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ababa-5a5d-48ce-a28a-003c0aad8e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:13:55.180935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ababa-5a5d-48ce-a28a-003c0aad8e2d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:13:55.181206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ababa-5a5d-48ce-a28a-003c0aad8e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:13:55.181497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ababa-5a5d-48ce-a28a-003c0aad8e2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:13:55.182202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ababa-5a5d-48ce-a28a-003c0aad8e2d None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=3c42fbaef19846b380938d44e5d3b249, user.id=b5f2d6fea430411b96b6c5aeb0ad64a0) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:13:55.182504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ababa-5a5d-48ce-a28a-003c0aad8e2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:13:55.183947 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ababa-5a5d-48ce-a28a-003c0aad8e2d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:13:55.189490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 597/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:13:55 2022] GET /identity/v3/role_assignments?user.id=b5f2d6fea430411b96b6c5aeb0ad64a0&scope.project.id=3c42fbaef19846b380938d44e5d3b249&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:14:05.036204 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=76 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:14:05.186961 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=38 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:07.199122 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e1f59-6d1b-4df7-878b-afb9153edaa8 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:07.199684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e1f59-6d1b-4df7-878b-afb9153edaa8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:07.199684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e1f59-6d1b-4df7-878b-afb9153edaa8 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:07.201034 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 604/1201] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:15:07.206849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbec5ce-4e32-440a-ba8d-87204ea93a17 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:07.207286 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbec5ce-4e32-440a-ba8d-87204ea93a17 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:07.207389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbec5ce-4e32-440a-ba8d-87204ea93a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:07.225081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dbbec5ce-4e32-440a-ba8d-87204ea93a17 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:15:07.226294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dbbec5ce-4e32-440a-ba8d-87204ea93a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:15:07.290668 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 598/1202] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:15:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:15:07.564181 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e1f59-6d1b-4df7-878b-afb9153edaa8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:07.664304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e1f59-6d1b-4df7-878b-afb9153edaa8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:07.698190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e71a6-6213-4529-9341-6078f7073cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:07.698814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e71a6-6213-4529-9341-6078f7073cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:07.699138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e71a6-6213-4529-9341-6078f7073cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:07.699408 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e71a6-6213-4529-9341-6078f7073cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:07.709479 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e71a6-6213-4529-9341-6078f7073cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:07.710956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e71a6-6213-4529-9341-6078f7073cb5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-677e71a6-6213-4529-9341-6078f7073cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:15:07.724573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:07.725786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:15:07.726926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:15:07.726926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:07.726926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:07.726926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 605/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:07.731867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbec5ce-4e32-440a-ba8d-87204ea93a17 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:07.830019 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbec5ce-4e32-440a-ba8d-87204ea93a17 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:07.858227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:07.864473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6ca21-7151-429c-bb51-bbb6deedc3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:07.865094 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6ca21-7151-429c-bb51-bbb6deedc3db None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:07.865406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6ca21-7151-429c-bb51-bbb6deedc3db None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:07.865760 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6ca21-7151-429c-bb51-bbb6deedc3db None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:07.866402 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6ca21-7151-429c-bb51-bbb6deedc3db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:07.866705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6ca21-7151-429c-bb51-bbb6deedc3db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:07.868070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6ca21-7151-429c-bb51-bbb6deedc3db None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:07.879277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 599/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:07.885163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e71a6-6213-4529-9341-6078f7073cb5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:07.936853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:07.989944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e71a6-6213-4529-9341-6078f7073cb5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:08.022349 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad4c25-3a1b-429d-8e1a-425923300000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:08.022936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad4c25-3a1b-429d-8e1a-425923300000 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:08.023210 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad4c25-3a1b-429d-8e1a-425923300000 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:08.023476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad4c25-3a1b-429d-8e1a-425923300000 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:08.024112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad4c25-3a1b-429d-8e1a-425923300000 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:08.025623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad4c25-3a1b-429d-8e1a-425923300000 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:08.103565 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 606/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Sep 13 03:15:07 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:15:10.240327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b8632-c68b-4705-a7d5-2888ea68bb90 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:10.240843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b8632-c68b-4705-a7d5-2888ea68bb90 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:10.240972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b8632-c68b-4705-a7d5-2888ea68bb90 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:10.242244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 600/1206] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:15:10.247547 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19493f6-484a-4690-bdab-9dd9ed8ae0f5 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:10.256456 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19493f6-484a-4690-bdab-9dd9ed8ae0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:10.256456 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19493f6-484a-4690-bdab-9dd9ed8ae0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:10.266455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f19493f6-484a-4690-bdab-9dd9ed8ae0f5 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:15:10.267630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f19493f6-484a-4690-bdab-9dd9ed8ae0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:15:10.331834 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 607/1207] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:15:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:15:10.596374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b8632-c68b-4705-a7d5-2888ea68bb90 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:10.696554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b8632-c68b-4705-a7d5-2888ea68bb90 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:10.729649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923bcc9-27f5-42b1-ab80-61dcd744e2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:10.730257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923bcc9-27f5-42b1-ab80-61dcd744e2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:10.730530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923bcc9-27f5-42b1-ab80-61dcd744e2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:10.730794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923bcc9-27f5-42b1-ab80-61dcd744e2f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:10.740972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923bcc9-27f5-42b1-ab80-61dcd744e2f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f923bcc9-27f5-42b1-ab80-61dcd744e2f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:15:10.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:10.746989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:10.748332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:10.748332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:10.748332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:10.748332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:10.748332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:15:10.748332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:15:10.748332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:15:10.748332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:15:10.748332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:15:10.748332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:15:10.748332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:15:10.748332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:10.748332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 601/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:15:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:10.753162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19493f6-484a-4690-bdab-9dd9ed8ae0f5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:10.791965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:10.851788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19493f6-484a-4690-bdab-9dd9ed8ae0f5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:10.884805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828cf07-a5cf-4e52-a6c2-0b4c68533c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:10.885439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828cf07-a5cf-4e52-a6c2-0b4c68533c71 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:10.885721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828cf07-a5cf-4e52-a6c2-0b4c68533c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:10.885992 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828cf07-a5cf-4e52-a6c2-0b4c68533c71 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:10.886642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828cf07-a5cf-4e52-a6c2-0b4c68533c71 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:10.886948 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828cf07-a5cf-4e52-a6c2-0b4c68533c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:10.888416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828cf07-a5cf-4e52-a6c2-0b4c68533c71 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:10.897392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 608/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:15:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:10.903263 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923bcc9-27f5-42b1-ab80-61dcd744e2f2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:10.951967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:11.001517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923bcc9-27f5-42b1-ab80-61dcd744e2f2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:11.034293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee374aac-88d6-438f-a4bb-5c2e8069784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:11.034914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee374aac-88d6-438f-a4bb-5c2e8069784d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:11.035186 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee374aac-88d6-438f-a4bb-5c2e8069784d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:11.035450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee374aac-88d6-438f-a4bb-5c2e8069784d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:11.046767 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee374aac-88d6-438f-a4bb-5c2e8069784d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:11.048270 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee374aac-88d6-438f-a4bb-5c2e8069784d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ee374aac-88d6-438f-a4bb-5c2e8069784d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:15:11.062443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:11.063616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:15:11.064718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:15:11.064718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:11.064718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:11.064718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 602/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:11.069295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828cf07-a5cf-4e52-a6c2-0b4c68533c71 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:11.165687 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:11.168692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828cf07-a5cf-4e52-a6c2-0b4c68533c71 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:11.202708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf8079-b25f-4724-8911-5461e8f302e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:11.203310 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf8079-b25f-4724-8911-5461e8f302e3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:11.203587 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf8079-b25f-4724-8911-5461e8f302e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:11.203857 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf8079-b25f-4724-8911-5461e8f302e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:11.204486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf8079-b25f-4724-8911-5461e8f302e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:11.204837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf8079-b25f-4724-8911-5461e8f302e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:11.206226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf8079-b25f-4724-8911-5461e8f302e3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:11.218166 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 609/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:11.224932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee374aac-88d6-438f-a4bb-5c2e8069784d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:11.323471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee374aac-88d6-438f-a4bb-5c2e8069784d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:11.325022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:11.356216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529cfec-14e4-400b-9884-c22ee7d90da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:11.356838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529cfec-14e4-400b-9884-c22ee7d90da1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:11.357116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529cfec-14e4-400b-9884-c22ee7d90da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:11.357421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529cfec-14e4-400b-9884-c22ee7d90da1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:11.365631 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529cfec-14e4-400b-9884-c22ee7d90da1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:11.367070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529cfec-14e4-400b-9884-c22ee7d90da1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7529cfec-14e4-400b-9884-c22ee7d90da1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:15:11.379155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:11.380296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:11.381520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:11.381520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:11.381520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:15:11.381520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:15:11.381520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:15:11.381520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:15:11.381520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:15:11.381520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:15:11.381520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 03:15:11.381520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:11.381520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 603/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:11.386109 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf8079-b25f-4724-8911-5461e8f302e3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:11.481977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf8079-b25f-4724-8911-5461e8f302e3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:11.515724 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ca578-0722-403f-b431-76c908bc0e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:11.516311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ca578-0722-403f-b431-76c908bc0e94 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:11.516587 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ca578-0722-403f-b431-76c908bc0e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:11.516853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ca578-0722-403f-b431-76c908bc0e94 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:11.517589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ca578-0722-403f-b431-76c908bc0e94 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:11.517891 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ca578-0722-403f-b431-76c908bc0e94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:11.519303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ca578-0722-403f-b431-76c908bc0e94 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:11.535770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 610/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 13 03:15:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:11.541722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529cfec-14e4-400b-9884-c22ee7d90da1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:11.637820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529cfec-14e4-400b-9884-c22ee7d90da1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:11.669813 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77a088-f1d8-40de-94a1-fe4eaa6c5a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:11.670397 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77a088-f1d8-40de-94a1-fe4eaa6c5a02 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:11.670670 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77a088-f1d8-40de-94a1-fe4eaa6c5a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:11.671553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77a088-f1d8-40de-94a1-fe4eaa6c5a02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:11.699779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:11.736346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77a088-f1d8-40de-94a1-fe4eaa6c5a02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:11.737753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77a088-f1d8-40de-94a1-fe4eaa6c5a02 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:11.832987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 604/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:15:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:15:11.841747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ca578-0722-403f-b431-76c908bc0e94 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:11.861468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:11.936719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ca578-0722-403f-b431-76c908bc0e94 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:11.969179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106b268-e4d9-4852-873b-a02f667fb012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:11.969816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106b268-e4d9-4852-873b-a02f667fb012 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:11.970089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106b268-e4d9-4852-873b-a02f667fb012 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:11.970355 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106b268-e4d9-4852-873b-a02f667fb012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:11.979826 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106b268-e4d9-4852-873b-a02f667fb012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:11.982442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106b268-e4d9-4852-873b-a02f667fb012 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b106b268-e4d9-4852-873b-a02f667fb012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:15:11.995292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:11.996393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:15:11.997485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:15:11.997485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:11.997485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:11.997485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 611/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:12.002920 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77a088-f1d8-40de-94a1-fe4eaa6c5a02 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:12.062423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:12.099933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77a088-f1d8-40de-94a1-fe4eaa6c5a02 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:12.132020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d36d5-55fe-4183-a8d8-e9432bb3ddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:12.132616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d36d5-55fe-4183-a8d8-e9432bb3ddcb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:12.132896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d36d5-55fe-4183-a8d8-e9432bb3ddcb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:12.133164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d36d5-55fe-4183-a8d8-e9432bb3ddcb None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:12.133832 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d36d5-55fe-4183-a8d8-e9432bb3ddcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:12.134133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d36d5-55fe-4183-a8d8-e9432bb3ddcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:12.135493 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d36d5-55fe-4183-a8d8-e9432bb3ddcb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:12.147026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 605/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:15:12.152766 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106b268-e4d9-4852-873b-a02f667fb012 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:12.222155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:12.251262 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106b268-e4d9-4852-873b-a02f667fb012 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:12.284088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12a7b3-8e5d-4243-85f8-3a2e28d22a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:12.284707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12a7b3-8e5d-4243-85f8-3a2e28d22a1e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:12.284985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12a7b3-8e5d-4243-85f8-3a2e28d22a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:12.285283 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12a7b3-8e5d-4243-85f8-3a2e28d22a1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:12.291843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12a7b3-8e5d-4243-85f8-3a2e28d22a1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:12.293379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12a7b3-8e5d-4243-85f8-3a2e28d22a1e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-0f12a7b3-8e5d-4243-85f8-3a2e28d22a1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:15:12.304508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:12.307361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:12.308530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:15:12.308530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:15:12.308530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:15:12.308530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:15:12.308530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:15:12.308530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:15:12.308530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:15:12.308530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:12.308530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 612/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:12.311624 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d36d5-55fe-4183-a8d8-e9432bb3ddcb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:12.410247 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d36d5-55fe-4183-a8d8-e9432bb3ddcb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:12.431351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:12.442944 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee60f39-7373-4501-981e-e3967126d042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:12.443537 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee60f39-7373-4501-981e-e3967126d042 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:12.443806 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee60f39-7373-4501-981e-e3967126d042 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:12.444072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee60f39-7373-4501-981e-e3967126d042 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:12.444748 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee60f39-7373-4501-981e-e3967126d042 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:12.445046 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee60f39-7373-4501-981e-e3967126d042 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:12.446498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee60f39-7373-4501-981e-e3967126d042 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:12.458366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 606/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:12.464546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12a7b3-8e5d-4243-85f8-3a2e28d22a1e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:12.562259 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12a7b3-8e5d-4243-85f8-3a2e28d22a1e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:12.590117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:12.595930 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0321d-ffdf-408a-b7a9-b4010c0cf048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:12.596535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0321d-ffdf-408a-b7a9-b4010c0cf048 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:12.596807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0321d-ffdf-408a-b7a9-b4010c0cf048 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:12.597080 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0321d-ffdf-408a-b7a9-b4010c0cf048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:12.597851 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0321d-ffdf-408a-b7a9-b4010c0cf048 None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=e261a9485c3b4d2aa657a931e0388389) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:12.598155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0321d-ffdf-408a-b7a9-b4010c0cf048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:12.599571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0321d-ffdf-408a-b7a9-b4010c0cf048 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:12.604872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 613/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:15:12 2022] GET /identity/v3/role_assignments?user.id=e261a9485c3b4d2aa657a931e0388389&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:14.714551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf584b7-cf08-47b1-8ccd-c87760867cc7 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:14.715100 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf584b7-cf08-47b1-8ccd-c87760867cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:14.715100 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf584b7-cf08-47b1-8ccd-c87760867cc7 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:14.716442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 607/1220] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:15:14.722312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dd2e3-89a6-482b-b340-67bdd84972f6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:14.722728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dd2e3-89a6-482b-b340-67bdd84972f6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:14.722850 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dd2e3-89a6-482b-b340-67bdd84972f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:14.741683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-392dd2e3-89a6-482b-b340-67bdd84972f6 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:15:14.742897 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-392dd2e3-89a6-482b-b340-67bdd84972f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:15:14.809911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 614/1221] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:15:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:15:15.080883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf584b7-cf08-47b1-8ccd-c87760867cc7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:15.182765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf584b7-cf08-47b1-8ccd-c87760867cc7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:15.216206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55ec80-0a4f-4f2a-9379-877374ba16f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:15.216818 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55ec80-0a4f-4f2a-9379-877374ba16f5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:15.217091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55ec80-0a4f-4f2a-9379-877374ba16f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:15.217454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55ec80-0a4f-4f2a-9379-877374ba16f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:15.227095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55ec80-0a4f-4f2a-9379-877374ba16f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-dd55ec80-0a4f-4f2a-9379-877374ba16f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:15:15.231846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:15.233474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:15.234533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:15.234533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:15.234533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:15.234533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:15.234533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:15:15.234533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:15:15.234533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:15:15.234533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:15:15.234533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:15:15.234533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:15:15.234533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:15:15.234533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:15.234533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 608/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:15:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:15.239713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dd2e3-89a6-482b-b340-67bdd84972f6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:15.338147 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dd2e3-89a6-482b-b340-67bdd84972f6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:15.361154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:15.371391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71224fb-d23a-4adf-9ba9-8aa6868e4517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:15.371985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71224fb-d23a-4adf-9ba9-8aa6868e4517 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:15.372259 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71224fb-d23a-4adf-9ba9-8aa6868e4517 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:15.372551 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71224fb-d23a-4adf-9ba9-8aa6868e4517 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:15.374106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71224fb-d23a-4adf-9ba9-8aa6868e4517 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:15.374404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71224fb-d23a-4adf-9ba9-8aa6868e4517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:15.375762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71224fb-d23a-4adf-9ba9-8aa6868e4517 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:15.383382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 615/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:15:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:15:15.389927 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55ec80-0a4f-4f2a-9379-877374ba16f5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:15.432380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:15.487551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55ec80-0a4f-4f2a-9379-877374ba16f5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:15.522030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f084579-62ad-427b-840a-37a99d1ede95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:15.522646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f084579-62ad-427b-840a-37a99d1ede95 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:15.522924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f084579-62ad-427b-840a-37a99d1ede95 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:15.523193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f084579-62ad-427b-840a-37a99d1ede95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:15.532875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f084579-62ad-427b-840a-37a99d1ede95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:15.534340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f084579-62ad-427b-840a-37a99d1ede95 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-3f084579-62ad-427b-840a-37a99d1ede95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:15:15.548837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:15.550041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:15:15.551385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:15:15.551385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:15.551385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:15.551385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 609/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:15.555881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71224fb-d23a-4adf-9ba9-8aa6868e4517 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:15.657520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71224fb-d23a-4adf-9ba9-8aa6868e4517 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:15.690460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc54687-7f01-439b-8556-40618a33379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:15.691051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc54687-7f01-439b-8556-40618a33379f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:15.691328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc54687-7f01-439b-8556-40618a33379f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:15.691596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc54687-7f01-439b-8556-40618a33379f None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:15.692227 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc54687-7f01-439b-8556-40618a33379f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:15.692524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc54687-7f01-439b-8556-40618a33379f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:15.693901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc54687-7f01-439b-8556-40618a33379f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:15.705944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 616/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:15.711641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f084579-62ad-427b-840a-37a99d1ede95 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:15.802872 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:15.809430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f084579-62ad-427b-840a-37a99d1ede95 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:15.841724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445692a7-40a4-45c4-bf44-e9f2e50c592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:15.842349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445692a7-40a4-45c4-bf44-e9f2e50c592b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:15.842620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445692a7-40a4-45c4-bf44-e9f2e50c592b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:15.842888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445692a7-40a4-45c4-bf44-e9f2e50c592b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:15.850285 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445692a7-40a4-45c4-bf44-e9f2e50c592b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:15.851704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445692a7-40a4-45c4-bf44-e9f2e50c592b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-445692a7-40a4-45c4-bf44-e9f2e50c592b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:15:15.862978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:15.864153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:15.865370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:15.865370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:15.865370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:15:15.865370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:15:15.865370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:15:15.865370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:15:15.865370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:15:15.865370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:15:15.865370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 03:15:15.865370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:15.865370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 610/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:15.870127 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc54687-7f01-439b-8556-40618a33379f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:15.917055 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:15.968486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc54687-7f01-439b-8556-40618a33379f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:16.002939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80428559-a657-45a5-b3c8-178f606598c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:16.003526 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80428559-a657-45a5-b3c8-178f606598c9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:16.003800 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80428559-a657-45a5-b3c8-178f606598c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:16.004069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80428559-a657-45a5-b3c8-178f606598c9 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:16.004774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80428559-a657-45a5-b3c8-178f606598c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:16.005075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80428559-a657-45a5-b3c8-178f606598c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:16.006526 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80428559-a657-45a5-b3c8-178f606598c9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:16.023400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 617/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 13 03:15:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:16.029145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445692a7-40a4-45c4-bf44-e9f2e50c592b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:16.130044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445692a7-40a4-45c4-bf44-e9f2e50c592b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:16.163738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603c658-9cde-4cb0-812e-414191e20669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:16.164361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603c658-9cde-4cb0-812e-414191e20669 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:16.164638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603c658-9cde-4cb0-812e-414191e20669 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:16.164909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603c658-9cde-4cb0-812e-414191e20669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:16.175379 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603c658-9cde-4cb0-812e-414191e20669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:16.176798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603c658-9cde-4cb0-812e-414191e20669 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e603c658-9cde-4cb0-812e-414191e20669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:15:16.190994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:16.192138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:15:16.193315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:15:16.193315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:16.193315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:16.193315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 611/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:16.198119 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80428559-a657-45a5-b3c8-178f606598c9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:16.296321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80428559-a657-45a5-b3c8-178f606598c9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:16.298596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:16.329658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c55cd-7507-498b-aff8-00a8b1935cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:16.330247 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c55cd-7507-498b-aff8-00a8b1935cac None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:16.330520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c55cd-7507-498b-aff8-00a8b1935cac None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:16.330789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c55cd-7507-498b-aff8-00a8b1935cac None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:16.331412 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c55cd-7507-498b-aff8-00a8b1935cac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:16.331732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c55cd-7507-498b-aff8-00a8b1935cac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:16.333084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c55cd-7507-498b-aff8-00a8b1935cac None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:16.344087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 618/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:16.349846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603c658-9cde-4cb0-812e-414191e20669 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:16.358948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:16.446339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603c658-9cde-4cb0-812e-414191e20669 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:16.479573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55753474-62d2-4a0d-be32-562ec00ac13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:16.480191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55753474-62d2-4a0d-be32-562ec00ac13e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:16.480466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55753474-62d2-4a0d-be32-562ec00ac13e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:16.480733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55753474-62d2-4a0d-be32-562ec00ac13e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:16.487936 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55753474-62d2-4a0d-be32-562ec00ac13e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:16.490073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55753474-62d2-4a0d-be32-562ec00ac13e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-55753474-62d2-4a0d-be32-562ec00ac13e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:15:16.502146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:16.503176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:16.504173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:15:16.504173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:15:16.504173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:15:16.504173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:15:16.504173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:15:16.504173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:15:16.504173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:15:16.504173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:16.504173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 612/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:15:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:16.509135 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c55cd-7507-498b-aff8-00a8b1935cac None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:16.607956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c55cd-7507-498b-aff8-00a8b1935cac None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:16.642372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961549e-2dad-4365-86bc-0332ca7266c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:16.642965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961549e-2dad-4365-86bc-0332ca7266c9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:16.643243 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961549e-2dad-4365-86bc-0332ca7266c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:16.643517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961549e-2dad-4365-86bc-0332ca7266c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:16.644201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961549e-2dad-4365-86bc-0332ca7266c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:16.644506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961549e-2dad-4365-86bc-0332ca7266c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:16.646065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961549e-2dad-4365-86bc-0332ca7266c9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:16.658499 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 619/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:15:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:16.664466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55753474-62d2-4a0d-be32-562ec00ac13e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:16.744622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:16.778570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55753474-62d2-4a0d-be32-562ec00ac13e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:16.812762 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a281b4-9cc5-4b7f-8e46-8d6c897aff09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:16.813497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a281b4-9cc5-4b7f-8e46-8d6c897aff09 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:16.813831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a281b4-9cc5-4b7f-8e46-8d6c897aff09 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:16.814093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a281b4-9cc5-4b7f-8e46-8d6c897aff09 None admin] PATH_INFO: `/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/e261a9485c3b4d2aa657a931e0388389/roles/79cc79c433824f04b3110bccd205b2ba` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:16.828007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a281b4-9cc5-4b7f-8e46-8d6c897aff09 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad922f6e2414214abe3ba1de67fc8de, user_id=e261a9485c3b4d2aa657a931e0388389, role_id=79cc79c433824f04b3110bccd205b2ba)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:16.829539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a281b4-9cc5-4b7f-8e46-8d6c897aff09 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:16.933475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 613/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:15:16 2022] PUT /identity/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/e261a9485c3b4d2aa657a931e0388389/roles/79cc79c433824f04b3110bccd205b2ba => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:15:19.076171 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cceb3-d9bc-4a56-9051-217e74e12f73 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:19.076721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cceb3-d9bc-4a56-9051-217e74e12f73 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:19.076721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cceb3-d9bc-4a56-9051-217e74e12f73 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:19.078089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 620/1233] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:15:19.083450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431751-f71c-4978-a854-9aec6ab5a043 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:19.083850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431751-f71c-4978-a854-9aec6ab5a043 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:19.084005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431751-f71c-4978-a854-9aec6ab5a043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:19.102266 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cb431751-f71c-4978-a854-9aec6ab5a043 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:15:19.103479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cb431751-f71c-4978-a854-9aec6ab5a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:15:19.170871 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 614/1234] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:15:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:15:19.441601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cceb3-d9bc-4a56-9051-217e74e12f73 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:19.466939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:19.540304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cceb3-d9bc-4a56-9051-217e74e12f73 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:19.574988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c87148-1c8b-4b81-ba23-99e20ccbbd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:19.575603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c87148-1c8b-4b81-ba23-99e20ccbbd1d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:19.575879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c87148-1c8b-4b81-ba23-99e20ccbbd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:19.576149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c87148-1c8b-4b81-ba23-99e20ccbbd1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:19.586120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c87148-1c8b-4b81-ba23-99e20ccbbd1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-47c87148-1c8b-4b81-ba23-99e20ccbbd1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:15:19.590886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:19.591988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:19.592925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:19.592925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:19.592925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:19.592925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:19.592925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:15:19.592925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:15:19.592925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:15:19.592925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:15:19.592925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:15:19.592925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:15:19.592925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 03:15:19.592925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:19.592925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 621/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Sep 13 03:15:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:19.598006 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb431751-f71c-4978-a854-9aec6ab5a043 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:19.643916 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:19.694143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb431751-f71c-4978-a854-9aec6ab5a043 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:19.727493 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d7386-b202-4109-9a81-4084d35a0085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:19.728089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d7386-b202-4109-9a81-4084d35a0085 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:19.728364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d7386-b202-4109-9a81-4084d35a0085 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:19.728633 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d7386-b202-4109-9a81-4084d35a0085 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:19.729305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d7386-b202-4109-9a81-4084d35a0085 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:19.729607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d7386-b202-4109-9a81-4084d35a0085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:19.731006 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d7386-b202-4109-9a81-4084d35a0085 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:19.738618 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 615/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Sep 13 03:15:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:19.744664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c87148-1c8b-4b81-ba23-99e20ccbbd1d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:19.829094 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:19.845013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c87148-1c8b-4b81-ba23-99e20ccbbd1d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:19.877792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db959d79-5b49-4f16-88a7-0a3f0523ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:19.878415 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db959d79-5b49-4f16-88a7-0a3f0523ebbb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:19.878694 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db959d79-5b49-4f16-88a7-0a3f0523ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:19.878967 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db959d79-5b49-4f16-88a7-0a3f0523ebbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:19.889819 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db959d79-5b49-4f16-88a7-0a3f0523ebbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:19.891245 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db959d79-5b49-4f16-88a7-0a3f0523ebbb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-db959d79-5b49-4f16-88a7-0a3f0523ebbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:15:19.904837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:19.906483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:15:19.907704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:15:19.907704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:19.907704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:19.907704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 622/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:19.911739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d7386-b202-4109-9a81-4084d35a0085 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:20.010403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d7386-b202-4109-9a81-4084d35a0085 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:20.019643 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:20.043526 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38e81d-399d-4245-9b3a-8aa7eeea2aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:20.044128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38e81d-399d-4245-9b3a-8aa7eeea2aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:20.044433 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38e81d-399d-4245-9b3a-8aa7eeea2aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:20.044712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38e81d-399d-4245-9b3a-8aa7eeea2aa3 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:20.045376 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38e81d-399d-4245-9b3a-8aa7eeea2aa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:20.045679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38e81d-399d-4245-9b3a-8aa7eeea2aa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:20.047046 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38e81d-399d-4245-9b3a-8aa7eeea2aa3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:20.058512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 616/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:20.064882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db959d79-5b49-4f16-88a7-0a3f0523ebbb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:20.165839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db959d79-5b49-4f16-88a7-0a3f0523ebbb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:20.199596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acfa31-e231-46ff-bfce-b58115ae059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:20.200215 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acfa31-e231-46ff-bfce-b58115ae059f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:20.200496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acfa31-e231-46ff-bfce-b58115ae059f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:20.200769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acfa31-e231-46ff-bfce-b58115ae059f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:20.203939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:20.209795 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acfa31-e231-46ff-bfce-b58115ae059f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:20.215528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acfa31-e231-46ff-bfce-b58115ae059f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f2acfa31-e231-46ff-bfce-b58115ae059f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:15:20.222453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:20.223604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:20.224807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:20.224807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:20.224807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:15:20.224807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:15:20.224807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:15:20.224807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:15:20.224807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:15:20.224807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:15:20.224807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 03:15:20.224807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:20.224807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 623/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:20.229583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38e81d-399d-4245-9b3a-8aa7eeea2aa3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:20.330534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38e81d-399d-4245-9b3a-8aa7eeea2aa3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:20.364554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb1bb-0807-4377-90f3-8309f8569aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:20.365153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb1bb-0807-4377-90f3-8309f8569aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:20.365466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb1bb-0807-4377-90f3-8309f8569aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:20.365738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb1bb-0807-4377-90f3-8309f8569aa6 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:20.366457 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abb1bb-0807-4377-90f3-8309f8569aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:20.366759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abb1bb-0807-4377-90f3-8309f8569aa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:20.368179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abb1bb-0807-4377-90f3-8309f8569aa6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:20.385703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 617/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 13 03:15:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:20.391683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acfa31-e231-46ff-bfce-b58115ae059f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:20.489407 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acfa31-e231-46ff-bfce-b58115ae059f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:20.522553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0291c-d0cd-4e73-ad16-d5341c7084ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:20.523160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0291c-d0cd-4e73-ad16-d5341c7084ac None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:20.523422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0291c-d0cd-4e73-ad16-d5341c7084ac None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:20.523694 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0291c-d0cd-4e73-ad16-d5341c7084ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:20.583536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:20.589841 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0291c-d0cd-4e73-ad16-d5341c7084ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:20.591304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0291c-d0cd-4e73-ad16-d5341c7084ac None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:20.686759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 624/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:15:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:15:20.692808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb1bb-0807-4377-90f3-8309f8569aa6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:20.719581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:20.790177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb1bb-0807-4377-90f3-8309f8569aa6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:20.823347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51868a-751e-4e05-a814-0690d1e3adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:20.823963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51868a-751e-4e05-a814-0690d1e3adde None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:20.824237 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51868a-751e-4e05-a814-0690d1e3adde None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:20.824505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51868a-751e-4e05-a814-0690d1e3adde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:20.834238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51868a-751e-4e05-a814-0690d1e3adde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:20.835600 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51868a-751e-4e05-a814-0690d1e3adde None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9d51868a-751e-4e05-a814-0690d1e3adde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:15:20.850254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:20.851754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:15:20.852831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:15:20.852831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:20.852831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:20.852831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 618/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:20.857196 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0291c-d0cd-4e73-ad16-d5341c7084ac None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:20.949417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:20.955550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0291c-d0cd-4e73-ad16-d5341c7084ac None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:20.988088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9f1e6-9494-49ae-ac15-00dd5f6e2327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:20.988779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9f1e6-9494-49ae-ac15-00dd5f6e2327 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:20.989054 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9f1e6-9494-49ae-ac15-00dd5f6e2327 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:20.989342 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9f1e6-9494-49ae-ac15-00dd5f6e2327 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:20.990007 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9f1e6-9494-49ae-ac15-00dd5f6e2327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:20.990297 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9f1e6-9494-49ae-ac15-00dd5f6e2327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:20.991643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9f1e6-9494-49ae-ac15-00dd5f6e2327 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:21.002733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 625/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:21.008490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51868a-751e-4e05-a814-0690d1e3adde None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:21.085641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:21.107296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51868a-751e-4e05-a814-0690d1e3adde None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:21.139736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbbfcc-7efc-47cb-86ae-0641b65025d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:21.140371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbbfcc-7efc-47cb-86ae-0641b65025d5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:21.140657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbbfcc-7efc-47cb-86ae-0641b65025d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:21.140935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbbfcc-7efc-47cb-86ae-0641b65025d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:21.147986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbbfcc-7efc-47cb-86ae-0641b65025d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:21.152323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbbfcc-7efc-47cb-86ae-0641b65025d5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f4cbbfcc-7efc-47cb-86ae-0641b65025d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:15:21.161347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:21.162422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:21.163572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:15:21.163572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:15:21.163572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:15:21.163572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:15:21.163572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:15:21.163572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:15:21.163572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:15:21.163572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:21.163572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 619/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:21.168361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9f1e6-9494-49ae-ac15-00dd5f6e2327 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:21.268157 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9f1e6-9494-49ae-ac15-00dd5f6e2327 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:21.301083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfb0b3-80d9-4ee1-aaa7-b22596a0869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:21.301703 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfb0b3-80d9-4ee1-aaa7-b22596a0869d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:21.301982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfb0b3-80d9-4ee1-aaa7-b22596a0869d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:21.302249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfb0b3-80d9-4ee1-aaa7-b22596a0869d None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:21.302920 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfb0b3-80d9-4ee1-aaa7-b22596a0869d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:21.303218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfb0b3-80d9-4ee1-aaa7-b22596a0869d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:21.304697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfb0b3-80d9-4ee1-aaa7-b22596a0869d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:21.316900 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 626/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:15:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:21.323008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbbfcc-7efc-47cb-86ae-0641b65025d5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:21.422954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbbfcc-7efc-47cb-86ae-0641b65025d5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:21.454890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84251ad6-2f39-4a13-ad04-b5f32f19a9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:21.455480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84251ad6-2f39-4a13-ad04-b5f32f19a9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:21.455753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84251ad6-2f39-4a13-ad04-b5f32f19a9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:21.456021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84251ad6-2f39-4a13-ad04-b5f32f19a9b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:21.456734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84251ad6-2f39-4a13-ad04-b5f32f19a9b1 None admin] RBAC: Adding query filter params (role.id=79cc79c433824f04b3110bccd205b2ba, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=e261a9485c3b4d2aa657a931e0388389) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:21.457034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84251ad6-2f39-4a13-ad04-b5f32f19a9b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:21.458533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84251ad6-2f39-4a13-ad04-b5f32f19a9b1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:21.464067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 620/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:15:21 2022] GET /identity/v3/role_assignments?user.id=e261a9485c3b4d2aa657a931e0388389&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=79cc79c433824f04b3110bccd205b2ba => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:23.647628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a644b6-ab84-4e66-879a-4eca85afdca5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:23.648184 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a644b6-ab84-4e66-879a-4eca85afdca5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:23.648184 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a644b6-ab84-4e66-879a-4eca85afdca5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:23.649516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 627/1247] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:15:23.654665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ce2b1-4dc1-46d0-95b4-21d5ea859f92 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:23.655086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ce2b1-4dc1-46d0-95b4-21d5ea859f92 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:23.655305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ce2b1-4dc1-46d0-95b4-21d5ea859f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:23.661512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:23.673695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f25ce2b1-4dc1-46d0-95b4-21d5ea859f92 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:15:23.674865 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f25ce2b1-4dc1-46d0-95b4-21d5ea859f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:15:23.739988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 621/1248] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:15:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:15:24.008042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a644b6-ab84-4e66-879a-4eca85afdca5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:24.026840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:24.106411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a644b6-ab84-4e66-879a-4eca85afdca5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:24.140842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56afb9-8440-467a-ae60-d82c79dff67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:24.141491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56afb9-8440-467a-ae60-d82c79dff67f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:24.141767 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56afb9-8440-467a-ae60-d82c79dff67f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:24.142030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56afb9-8440-467a-ae60-d82c79dff67f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:24.152226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56afb9-8440-467a-ae60-d82c79dff67f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-eb56afb9-8440-467a-ae60-d82c79dff67f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:15:24.157575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:24.158682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:24.159771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:24.159771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:24.159771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:24.159771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:24.159771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:15:24.159771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:15:24.159771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:15:24.159771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:15:24.159771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:15:24.159771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:15:24.159771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:15:24.159771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:24.159771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 628/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:15:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:24.164674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ce2b1-4dc1-46d0-95b4-21d5ea859f92 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:24.260340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ce2b1-4dc1-46d0-95b4-21d5ea859f92 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:24.290512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:24.295534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd409bd6-689f-47b3-87d2-630a0157094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:24.296175 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd409bd6-689f-47b3-87d2-630a0157094f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:24.296450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd409bd6-689f-47b3-87d2-630a0157094f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:24.296761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd409bd6-689f-47b3-87d2-630a0157094f None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:24.297452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd409bd6-689f-47b3-87d2-630a0157094f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:24.297754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd409bd6-689f-47b3-87d2-630a0157094f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:24.299114 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd409bd6-689f-47b3-87d2-630a0157094f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:24.307157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 622/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:15:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:24.312965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56afb9-8440-467a-ae60-d82c79dff67f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:24.391266 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:24.413732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56afb9-8440-467a-ae60-d82c79dff67f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:24.446239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17312f4d-7985-42a5-bfec-16dd884fad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:24.446852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312f4d-7985-42a5-bfec-16dd884fad46 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:24.447127 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312f4d-7985-42a5-bfec-16dd884fad46 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:24.447405 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312f4d-7985-42a5-bfec-16dd884fad46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:24.458171 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17312f4d-7985-42a5-bfec-16dd884fad46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:24.459598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17312f4d-7985-42a5-bfec-16dd884fad46 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-17312f4d-7985-42a5-bfec-16dd884fad46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:15:24.473781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:24.474890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:15:24.475809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:15:24.475809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:24.475809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:24.475809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 629/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:24.480652 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd409bd6-689f-47b3-87d2-630a0157094f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:24.579041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd409bd6-689f-47b3-87d2-630a0157094f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:24.611488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170433a-7a8f-4566-a4db-9dd62fd289ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:24.612089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170433a-7a8f-4566-a4db-9dd62fd289ff None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:24.612366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170433a-7a8f-4566-a4db-9dd62fd289ff None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:24.612637 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170433a-7a8f-4566-a4db-9dd62fd289ff None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:24.613292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170433a-7a8f-4566-a4db-9dd62fd289ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:24.613596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170433a-7a8f-4566-a4db-9dd62fd289ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:24.614953 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170433a-7a8f-4566-a4db-9dd62fd289ff None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:24.627043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 623/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:24.632910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17312f4d-7985-42a5-bfec-16dd884fad46 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:24.731057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17312f4d-7985-42a5-bfec-16dd884fad46 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:24.757773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:24.765480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2b1fa-4994-4e08-a898-fbe50b7cd277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:24.766099 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b1fa-4994-4e08-a898-fbe50b7cd277 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:24.766375 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b1fa-4994-4e08-a898-fbe50b7cd277 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:24.766642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b1fa-4994-4e08-a898-fbe50b7cd277 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:24.773807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2b1fa-4994-4e08-a898-fbe50b7cd277 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:24.775317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2b1fa-4994-4e08-a898-fbe50b7cd277 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b6f2b1fa-4994-4e08-a898-fbe50b7cd277 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:15:24.786362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:24.787658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:24.788639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:24.788639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:24.788639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:15:24.788639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:15:24.788639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:15:24.788639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:15:24.788639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:15:24.788639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:15:24.788639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 03:15:24.788639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:24.788639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 630/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:24.793388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170433a-7a8f-4566-a4db-9dd62fd289ff None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:24.847829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:24.891481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170433a-7a8f-4566-a4db-9dd62fd289ff None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:24.924787 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c115f-17ab-405e-962b-804261905860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:24.925408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c115f-17ab-405e-962b-804261905860 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:24.925684 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c115f-17ab-405e-962b-804261905860 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:24.925956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c115f-17ab-405e-962b-804261905860 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:24.926672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c115f-17ab-405e-962b-804261905860 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:24.926973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c115f-17ab-405e-962b-804261905860 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:24.928398 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c115f-17ab-405e-962b-804261905860 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:24.945998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 624/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 13 03:15:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:24.951936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2b1fa-4994-4e08-a898-fbe50b7cd277 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:25.050729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2b1fa-4994-4e08-a898-fbe50b7cd277 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:25.083458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288a662-1dac-4f41-abc5-30fd90a2458a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:25.084067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288a662-1dac-4f41-abc5-30fd90a2458a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:25.084344 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288a662-1dac-4f41-abc5-30fd90a2458a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:25.084612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288a662-1dac-4f41-abc5-30fd90a2458a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:25.138673 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:25.150500 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288a662-1dac-4f41-abc5-30fd90a2458a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:25.152006 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288a662-1dac-4f41-abc5-30fd90a2458a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:25.248781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 631/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:15:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:15:25.254685 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c115f-17ab-405e-962b-804261905860 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:25.353043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c115f-17ab-405e-962b-804261905860 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:25.366453 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:25.387031 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b4996-5711-4820-81fe-63d946cc293f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:25.387647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b4996-5711-4820-81fe-63d946cc293f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:25.387920 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b4996-5711-4820-81fe-63d946cc293f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:25.388208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b4996-5711-4820-81fe-63d946cc293f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:25.397810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b4996-5711-4820-81fe-63d946cc293f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:25.399248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b4996-5711-4820-81fe-63d946cc293f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-057b4996-5711-4820-81fe-63d946cc293f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:15:25.414000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:25.414956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:15:25.416333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:15:25.416333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:25.416333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:25.416333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 625/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:25.421505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288a662-1dac-4f41-abc5-30fd90a2458a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:25.507572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:25.520016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288a662-1dac-4f41-abc5-30fd90a2458a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:25.553868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332eb94-4717-42fc-9a48-39355fa4255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:25.554461 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332eb94-4717-42fc-9a48-39355fa4255e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:25.554736 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332eb94-4717-42fc-9a48-39355fa4255e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:25.555006 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332eb94-4717-42fc-9a48-39355fa4255e None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:25.555635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332eb94-4717-42fc-9a48-39355fa4255e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:25.555932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332eb94-4717-42fc-9a48-39355fa4255e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:25.557301 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332eb94-4717-42fc-9a48-39355fa4255e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:25.568918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 632/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:25.574584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b4996-5711-4820-81fe-63d946cc293f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:25.670636 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b4996-5711-4820-81fe-63d946cc293f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:25.704177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8c125-9319-4c5d-9a19-47de7ba0615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:25.704792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8c125-9319-4c5d-9a19-47de7ba0615c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:25.705064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8c125-9319-4c5d-9a19-47de7ba0615c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:25.705367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8c125-9319-4c5d-9a19-47de7ba0615c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:25.711760 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8c125-9319-4c5d-9a19-47de7ba0615c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:25.713220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8c125-9319-4c5d-9a19-47de7ba0615c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-8ca8c125-9319-4c5d-9a19-47de7ba0615c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:15:25.724093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:25.725151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:25.726315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:15:25.726315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:15:25.726315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:15:25.726315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:15:25.726315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:15:25.726315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:15:25.726315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:15:25.726315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:25.726315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 626/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:15:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:25.731108 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332eb94-4717-42fc-9a48-39355fa4255e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:25.829157 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332eb94-4717-42fc-9a48-39355fa4255e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:25.863621 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b6438-e99e-45a4-b646-672a134e39d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:25.864220 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b6438-e99e-45a4-b646-672a134e39d9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:25.864496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b6438-e99e-45a4-b646-672a134e39d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:25.864763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b6438-e99e-45a4-b646-672a134e39d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:25.865479 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b6438-e99e-45a4-b646-672a134e39d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:25.865779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b6438-e99e-45a4-b646-672a134e39d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:25.867203 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b6438-e99e-45a4-b646-672a134e39d9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:25.879669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 633/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:15:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:15:25.885837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8c125-9319-4c5d-9a19-47de7ba0615c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:25.911855 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:25.984369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8c125-9319-4c5d-9a19-47de7ba0615c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:26.018892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bf77a-cdc0-461a-b03c-eb22fd4e0863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:26.019488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bf77a-cdc0-461a-b03c-eb22fd4e0863 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:26.019766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bf77a-cdc0-461a-b03c-eb22fd4e0863 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:26.020039 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bf77a-cdc0-461a-b03c-eb22fd4e0863 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:26.020758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bf77a-cdc0-461a-b03c-eb22fd4e0863 None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=e261a9485c3b4d2aa657a931e0388389) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:26.021168 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bf77a-cdc0-461a-b03c-eb22fd4e0863 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:26.022578 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bf77a-cdc0-461a-b03c-eb22fd4e0863 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:26.027934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 627/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:15:25 2022] GET /identity/v3/role_assignments?user.id=e261a9485c3b4d2aa657a931e0388389&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:28.147463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10763a63-aee8-4b29-a93a-ef209a839d9e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:28.148007 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10763a63-aee8-4b29-a93a-ef209a839d9e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:28.148007 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10763a63-aee8-4b29-a93a-ef209a839d9e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:28.149433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 634/1261] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:15:28.154759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0907de-3f54-42a3-9a1e-de406b69aab4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:28.155136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0907de-3f54-42a3-9a1e-de406b69aab4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:28.155308 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0907de-3f54-42a3-9a1e-de406b69aab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:28.173507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dd0907de-3f54-42a3-9a1e-de406b69aab4 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:15:28.176246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dd0907de-3f54-42a3-9a1e-de406b69aab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:15:28.240387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 628/1262] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:15:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 03:15:28.510491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10763a63-aee8-4b29-a93a-ef209a839d9e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:28.521869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:28.610155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10763a63-aee8-4b29-a93a-ef209a839d9e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:28.643889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a01994-91a6-4885-8470-c7b601bfb253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:28.644502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a01994-91a6-4885-8470-c7b601bfb253 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:28.644775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a01994-91a6-4885-8470-c7b601bfb253 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:28.645042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a01994-91a6-4885-8470-c7b601bfb253 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:28.654991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a01994-91a6-4885-8470-c7b601bfb253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-12a01994-91a6-4885-8470-c7b601bfb253 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:15:28.659889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:28.661086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:28.662226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:28.662226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:28.662226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:28.662226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:28.662226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:15:28.662226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:15:28.662226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:15:28.662226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:15:28.662226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:15:28.662226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:15:28.662226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:15:28.662226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:28.662226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 635/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:15:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:28.667022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0907de-3f54-42a3-9a1e-de406b69aab4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:28.685746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:28.762797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0907de-3f54-42a3-9a1e-de406b69aab4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:28.796128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d72c3-0f36-4091-b0c7-5bee123cdd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:28.796721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d72c3-0f36-4091-b0c7-5bee123cdd2f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:28.796994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d72c3-0f36-4091-b0c7-5bee123cdd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:28.797290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d72c3-0f36-4091-b0c7-5bee123cdd2f None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:28.798029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d72c3-0f36-4091-b0c7-5bee123cdd2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:28.798328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d72c3-0f36-4091-b0c7-5bee123cdd2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:28.799687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d72c3-0f36-4091-b0c7-5bee123cdd2f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:28.809419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 629/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:15:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:28.815770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a01994-91a6-4885-8470-c7b601bfb253 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:28.881019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:28.912743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a01994-91a6-4885-8470-c7b601bfb253 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:28.946770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00a74f-593e-40a9-b2f9-4f3c983223ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:28.947369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00a74f-593e-40a9-b2f9-4f3c983223ac None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:28.947648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00a74f-593e-40a9-b2f9-4f3c983223ac None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:28.947919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00a74f-593e-40a9-b2f9-4f3c983223ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:28.958107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00a74f-593e-40a9-b2f9-4f3c983223ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:28.959579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00a74f-593e-40a9-b2f9-4f3c983223ac None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-4a00a74f-593e-40a9-b2f9-4f3c983223ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:15:28.973824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:28.974901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:15:28.975877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:15:28.975877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:28.975877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:28.975877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 636/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:28.980657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d72c3-0f36-4091-b0c7-5bee123cdd2f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:29.061768 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:29.080607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d72c3-0f36-4091-b0c7-5bee123cdd2f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:29.112423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136d7c2-0acd-4a7f-913b-fcf7f10f3b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:29.113080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136d7c2-0acd-4a7f-913b-fcf7f10f3b3a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:29.113391 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136d7c2-0acd-4a7f-913b-fcf7f10f3b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:29.113665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136d7c2-0acd-4a7f-913b-fcf7f10f3b3a None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:29.114351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136d7c2-0acd-4a7f-913b-fcf7f10f3b3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:29.114655 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136d7c2-0acd-4a7f-913b-fcf7f10f3b3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:29.116055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136d7c2-0acd-4a7f-913b-fcf7f10f3b3a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:29.128078 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 630/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:29.133894 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00a74f-593e-40a9-b2f9-4f3c983223ac None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:29.235948 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00a74f-593e-40a9-b2f9-4f3c983223ac None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:29.255697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:29.269091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49c608-c13a-410e-a8ad-b9c98e7066c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:29.269738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49c608-c13a-410e-a8ad-b9c98e7066c4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:29.270015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49c608-c13a-410e-a8ad-b9c98e7066c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:29.270283 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49c608-c13a-410e-a8ad-b9c98e7066c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:29.277483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49c608-c13a-410e-a8ad-b9c98e7066c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:29.278917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49c608-c13a-410e-a8ad-b9c98e7066c4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-cb49c608-c13a-410e-a8ad-b9c98e7066c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:15:29.289867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:29.291018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:29.292411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:29.292411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:29.292411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:15:29.292411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:15:29.292411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:15:29.292411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:15:29.292411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:15:29.292411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:15:29.292411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 03:15:29.292411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:29.292411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 637/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:29.297219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136d7c2-0acd-4a7f-913b-fcf7f10f3b3a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:29.394886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136d7c2-0acd-4a7f-913b-fcf7f10f3b3a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:29.428511 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883430f-4027-4864-8143-4b5b95c569f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:29.429130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883430f-4027-4864-8143-4b5b95c569f0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:29.429436 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883430f-4027-4864-8143-4b5b95c569f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:29.429704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883430f-4027-4864-8143-4b5b95c569f0 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:29.430420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883430f-4027-4864-8143-4b5b95c569f0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:29.430727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883430f-4027-4864-8143-4b5b95c569f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:29.432130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883430f-4027-4864-8143-4b5b95c569f0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:29.441483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:29.449695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 631/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 13 03:15:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:29.455579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49c608-c13a-410e-a8ad-b9c98e7066c4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:29.554195 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49c608-c13a-410e-a8ad-b9c98e7066c4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:29.586714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804efa68-e6f5-49bd-9f7d-1d3d6c4133c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:29.587338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804efa68-e6f5-49bd-9f7d-1d3d6c4133c5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:29.587616 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804efa68-e6f5-49bd-9f7d-1d3d6c4133c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:29.587886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804efa68-e6f5-49bd-9f7d-1d3d6c4133c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:29.598712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804efa68-e6f5-49bd-9f7d-1d3d6c4133c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:29.600139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804efa68-e6f5-49bd-9f7d-1d3d6c4133c5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-804efa68-e6f5-49bd-9f7d-1d3d6c4133c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:15:29.614506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:29.615644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:15:29.616590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:15:29.616590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:29.616590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:29.616590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 638/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 03:15:29.621437 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883430f-4027-4864-8143-4b5b95c569f0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:29.718468 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883430f-4027-4864-8143-4b5b95c569f0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:29.752577 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9a742-ba5e-483f-b5dc-cc4d5d33fca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:29.753174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9a742-ba5e-483f-b5dc-cc4d5d33fca6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:29.753479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9a742-ba5e-483f-b5dc-cc4d5d33fca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:29.753754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9a742-ba5e-483f-b5dc-cc4d5d33fca6 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:29.754387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9a742-ba5e-483f-b5dc-cc4d5d33fca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:29.754687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9a742-ba5e-483f-b5dc-cc4d5d33fca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:29.756059 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9a742-ba5e-483f-b5dc-cc4d5d33fca6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:29.766955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 632/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:29.772643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804efa68-e6f5-49bd-9f7d-1d3d6c4133c5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:29.804805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:29.871843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804efa68-e6f5-49bd-9f7d-1d3d6c4133c5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:29.906205 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab173dd-c9dc-4648-885a-8cf83dd64daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:29.906826 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab173dd-c9dc-4648-885a-8cf83dd64daf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:29.907101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab173dd-c9dc-4648-885a-8cf83dd64daf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:29.907368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab173dd-c9dc-4648-885a-8cf83dd64daf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:29.913784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab173dd-c9dc-4648-885a-8cf83dd64daf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:29.915203 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab173dd-c9dc-4648-885a-8cf83dd64daf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-7ab173dd-c9dc-4648-885a-8cf83dd64daf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:15:29.926159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:29.927213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:29.928713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:15:29.928713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:15:29.928713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:15:29.928713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:15:29.928713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:15:29.928713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:15:29.928713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:15:29.928713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:29.928713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 639/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:15:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:29.933169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9a742-ba5e-483f-b5dc-cc4d5d33fca6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:29.990670 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:30.031821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9a742-ba5e-483f-b5dc-cc4d5d33fca6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:30.065763 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cc700-ef92-488e-b44f-d1014c47b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:30.066367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cc700-ef92-488e-b44f-d1014c47b706 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:30.066645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cc700-ef92-488e-b44f-d1014c47b706 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:30.066920 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cc700-ef92-488e-b44f-d1014c47b706 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:30.067603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7cc700-ef92-488e-b44f-d1014c47b706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:30.067907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7cc700-ef92-488e-b44f-d1014c47b706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:30.069409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7cc700-ef92-488e-b44f-d1014c47b706 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:30.081315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 633/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:15:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:30.087256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab173dd-c9dc-4648-885a-8cf83dd64daf None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:30.177854 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:30.186765 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab173dd-c9dc-4648-885a-8cf83dd64daf None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:30.217846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7561e55-7e67-48f5-9d2e-51c87f573aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:30.218632 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7561e55-7e67-48f5-9d2e-51c87f573aa1 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:30.218991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7561e55-7e67-48f5-9d2e-51c87f573aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:30.219382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7561e55-7e67-48f5-9d2e-51c87f573aa1 None admin] PATH_INFO: `/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/e261a9485c3b4d2aa657a931e0388389/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:30.221454 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7561e55-7e67-48f5-9d2e-51c87f573aa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ad922f6e2414214abe3ba1de67fc8de, user_id=e261a9485c3b4d2aa657a931e0388389, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:30.223066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7561e55-7e67-48f5-9d2e-51c87f573aa1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:30.349638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 640/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Sep 13 03:15:30 2022] PUT /identity/v3/projects/7ad922f6e2414214abe3ba1de67fc8de/users/e261a9485c3b4d2aa657a931e0388389/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:15:32.469906 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b53e74-9321-4779-966c-37a97c918a1c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:32.470414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b53e74-9321-4779-966c-37a97c918a1c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:32.472041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b53e74-9321-4779-966c-37a97c918a1c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:32.472041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 634/1274] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:15:32.477125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4742da0-f203-4c3e-9652-fff9ad077be7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:32.477522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4742da0-f203-4c3e-9652-fff9ad077be7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:32.477721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4742da0-f203-4c3e-9652-fff9ad077be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:32.496268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e4742da0-f203-4c3e-9652-fff9ad077be7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:15:32.498305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e4742da0-f203-4c3e-9652-fff9ad077be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:15:32.563334 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 641/1275] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:15:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:15:32.829944 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b53e74-9321-4779-966c-37a97c918a1c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:32.932498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b53e74-9321-4779-966c-37a97c918a1c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:32.951907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:32.968722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d003d-6fac-414a-a4b7-5e6e1e2c0711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:32.969415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d003d-6fac-414a-a4b7-5e6e1e2c0711 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:32.969697 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d003d-6fac-414a-a4b7-5e6e1e2c0711 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:32.969971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d003d-6fac-414a-a4b7-5e6e1e2c0711 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:32.980011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d003d-6fac-414a-a4b7-5e6e1e2c0711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-699d003d-6fac-414a-a4b7-5e6e1e2c0711 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 03:15:32.985336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:32.986431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:32.987488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:32.987488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:32.987488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:32.987488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:32.987488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 03:15:32.987488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 03:15:32.987488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 03:15:32.987488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 03:15:32.987488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 03:15:32.987488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 03:15:32.987488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 03:15:32.987488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:32.994490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 635/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Sep 13 03:15:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:32.994621 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4742da0-f203-4c3e-9652-fff9ad077be7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:33.074017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:33.092220 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4742da0-f203-4c3e-9652-fff9ad077be7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:33.125912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f09ea7-e15c-4c2c-8d10-8412df4f6d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:33.126532 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f09ea7-e15c-4c2c-8d10-8412df4f6d80 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:33.126808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f09ea7-e15c-4c2c-8d10-8412df4f6d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:33.127081 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f09ea7-e15c-4c2c-8d10-8412df4f6d80 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:33.127732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f09ea7-e15c-4c2c-8d10-8412df4f6d80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:33.128030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f09ea7-e15c-4c2c-8d10-8412df4f6d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:33.129423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f09ea7-e15c-4c2c-8d10-8412df4f6d80 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:33.137399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 642/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Sep 13 03:15:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:33.143938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d003d-6fac-414a-a4b7-5e6e1e2c0711 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:33.243780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d003d-6fac-414a-a4b7-5e6e1e2c0711 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:33.276702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09568f8-6241-41c8-9242-62c25dc869d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:33.277409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09568f8-6241-41c8-9242-62c25dc869d2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:33.277687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09568f8-6241-41c8-9242-62c25dc869d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:33.277952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09568f8-6241-41c8-9242-62c25dc869d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:33.288652 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09568f8-6241-41c8-9242-62c25dc869d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:33.290210 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09568f8-6241-41c8-9242-62c25dc869d2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a09568f8-6241-41c8-9242-62c25dc869d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:15:33.303844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:33.304970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:15:33.306257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:15:33.306257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:33.306257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:33.306257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 636/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:33.310798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f09ea7-e15c-4c2c-8d10-8412df4f6d80 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:33.411731 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f09ea7-e15c-4c2c-8d10-8412df4f6d80 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:33.448179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f2321-ce83-47ff-a7e0-4c95c9d7122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:33.448799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f2321-ce83-47ff-a7e0-4c95c9d7122b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:33.449070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f2321-ce83-47ff-a7e0-4c95c9d7122b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:33.449367 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f2321-ce83-47ff-a7e0-4c95c9d7122b None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:33.450705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f2321-ce83-47ff-a7e0-4c95c9d7122b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:33.451007 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f2321-ce83-47ff-a7e0-4c95c9d7122b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:33.452388 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f2321-ce83-47ff-a7e0-4c95c9d7122b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:33.465021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 643/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:33.470966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09568f8-6241-41c8-9242-62c25dc869d2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:33.510900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:33.584972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09568f8-6241-41c8-9242-62c25dc869d2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:33.620516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c442c4-1395-463c-aa3f-60836d01a372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:33.621154 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c442c4-1395-463c-aa3f-60836d01a372 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:33.621760 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c442c4-1395-463c-aa3f-60836d01a372 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:33.622519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c442c4-1395-463c-aa3f-60836d01a372 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:33.630909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c442c4-1395-463c-aa3f-60836d01a372 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:33.632387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c442c4-1395-463c-aa3f-60836d01a372 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-76c442c4-1395-463c-aa3f-60836d01a372 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 03:15:33.645646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:33.646794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:33.647779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:33.647779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:33.647779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 03:15:33.647779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 03:15:33.647779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 03:15:33.647779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 03:15:33.647779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 03:15:33.647779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 03:15:33.647779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 03:15:33.647779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:33.647779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 637/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:33.652840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f2321-ce83-47ff-a7e0-4c95c9d7122b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:33.657651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:33.754968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f2321-ce83-47ff-a7e0-4c95c9d7122b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:33.789383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0686e1-954f-45c1-bf4c-12bc77448dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:33.789988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0686e1-954f-45c1-bf4c-12bc77448dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:33.790283 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0686e1-954f-45c1-bf4c-12bc77448dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:33.790539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0686e1-954f-45c1-bf4c-12bc77448dc2 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:33.791255 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0686e1-954f-45c1-bf4c-12bc77448dc2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:33.791557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0686e1-954f-45c1-bf4c-12bc77448dc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:33.792978 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0686e1-954f-45c1-bf4c-12bc77448dc2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:33.811318 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 644/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Sep 13 03:15:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:33.817356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c442c4-1395-463c-aa3f-60836d01a372 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:33.915973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:33.925981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c442c4-1395-463c-aa3f-60836d01a372 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:33.962400 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9b060-3dd3-4be2-a217-6fc56e7fdc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:33.963005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9b060-3dd3-4be2-a217-6fc56e7fdc24 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:33.963285 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9b060-3dd3-4be2-a217-6fc56e7fdc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:33.963557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9b060-3dd3-4be2-a217-6fc56e7fdc24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:34.030064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9b060-3dd3-4be2-a217-6fc56e7fdc24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:34.031503 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9b060-3dd3-4be2-a217-6fc56e7fdc24 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:34.117891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:34.128152 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 638/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Sep 13 03:15:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 03:15:34.134079 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0686e1-954f-45c1-bf4c-12bc77448dc2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:34.195931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:34.233644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0686e1-954f-45c1-bf4c-12bc77448dc2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:34.266607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc34665-b613-4a3a-a5bc-114ac87fcab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:34.267223 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc34665-b613-4a3a-a5bc-114ac87fcab1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:34.267501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc34665-b613-4a3a-a5bc-114ac87fcab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:34.267772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc34665-b613-4a3a-a5bc-114ac87fcab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:34.277403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc34665-b613-4a3a-a5bc-114ac87fcab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:34.278851 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc34665-b613-4a3a-a5bc-114ac87fcab1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ddc34665-b613-4a3a-a5bc-114ac87fcab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 03:15:34.293058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:34.294129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 03:15:34.295048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 03:15:34.295048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 03:15:34.295048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:34.295048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 645/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:34.299906 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9b060-3dd3-4be2-a217-6fc56e7fdc24 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:34.397814 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9b060-3dd3-4be2-a217-6fc56e7fdc24 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:34.433540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895d4d-d1f6-4111-866c-cb39eea2190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:34.433540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895d4d-d1f6-4111-866c-cb39eea2190b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:34.433540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895d4d-d1f6-4111-866c-cb39eea2190b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:34.433540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895d4d-d1f6-4111-866c-cb39eea2190b None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:34.433996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2895d4d-d1f6-4111-866c-cb39eea2190b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:34.433996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2895d4d-d1f6-4111-866c-cb39eea2190b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:34.433996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2895d4d-d1f6-4111-866c-cb39eea2190b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:34.445772 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 639/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Sep 13 03:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:34.452057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc34665-b613-4a3a-a5bc-114ac87fcab1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:34.550651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc34665-b613-4a3a-a5bc-114ac87fcab1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:34.564286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:34.583235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d98c9c-d810-4249-b3f1-8e9fbae962ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:34.583848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d98c9c-d810-4249-b3f1-8e9fbae962ed None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:34.584125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d98c9c-d810-4249-b3f1-8e9fbae962ed None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:34.584391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d98c9c-d810-4249-b3f1-8e9fbae962ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:34.590816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d98c9c-d810-4249-b3f1-8e9fbae962ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:34.592249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d98c9c-d810-4249-b3f1-8e9fbae962ed None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-21d98c9c-d810-4249-b3f1-8e9fbae962ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 03:15:34.603136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:34.604178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:34.605322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 03:15:34.605322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 03:15:34.605322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 03:15:34.605322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 03:15:34.605322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 03:15:34.605322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 03:15:34.605322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 03:15:34.605322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 13 03:15:34.605322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 646/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Sep 13 03:15:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:34.610538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895d4d-d1f6-4111-866c-cb39eea2190b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:34.659110 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:34.707448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895d4d-d1f6-4111-866c-cb39eea2190b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:34.739953 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2b2c9-7247-4c4a-a4f3-5d6bef1fb8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:34.740581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b2c9-7247-4c4a-a4f3-5d6bef1fb8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:34.740856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b2c9-7247-4c4a-a4f3-5d6bef1fb8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:34.741121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b2c9-7247-4c4a-a4f3-5d6bef1fb8e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:34.741831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2b2c9-7247-4c4a-a4f3-5d6bef1fb8e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:34.742132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2b2c9-7247-4c4a-a4f3-5d6bef1fb8e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:34.743543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2b2c9-7247-4c4a-a4f3-5d6bef1fb8e9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:34.755879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 640/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Sep 13 03:15:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:34.761885 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d98c9c-d810-4249-b3f1-8e9fbae962ed None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:34.859490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d98c9c-d810-4249-b3f1-8e9fbae962ed None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:34.892052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9745c0-f181-4d01-ba32-252343993910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:34.892642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9745c0-f181-4d01-ba32-252343993910 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:34.892919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9745c0-f181-4d01-ba32-252343993910 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:34.893190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9745c0-f181-4d01-ba32-252343993910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:34.893929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9745c0-f181-4d01-ba32-252343993910 None admin] RBAC: Adding query filter params (role.id=d5e165a3cc334fcf92d7b94730dc0816, scope.project.id=7ad922f6e2414214abe3ba1de67fc8de, user.id=e261a9485c3b4d2aa657a931e0388389) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:34.894234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9745c0-f181-4d01-ba32-252343993910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:34.895646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9745c0-f181-4d01-ba32-252343993910 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:34.901275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 647/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Sep 13 03:15:34 2022] GET /identity/v3/role_assignments?user.id=e261a9485c3b4d2aa657a931e0388389&scope.project.id=7ad922f6e2414214abe3ba1de67fc8de&role.id=d5e165a3cc334fcf92d7b94730dc0816 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:37.039205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131d4a-a0ef-460a-8381-ecf3ee5f834d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:37.039736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131d4a-a0ef-460a-8381-ecf3ee5f834d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:37.039736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131d4a-a0ef-460a-8381-ecf3ee5f834d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:37.041094 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 641/1288] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:15:37.046255 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fedc3e-489b-49f8-874a-960218a2fac9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:37.046641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fedc3e-489b-49f8-874a-960218a2fac9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:37.046793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fedc3e-489b-49f8-874a-960218a2fac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:37.064907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d6fedc3e-489b-49f8-874a-960218a2fac9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:15:37.066170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d6fedc3e-489b-49f8-874a-960218a2fac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:15:37.095965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:37.132133 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 648/1289] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:15:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:15:37.399968 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f131d4a-a0ef-460a-8381-ecf3ee5f834d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:37.501251 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f131d4a-a0ef-460a-8381-ecf3ee5f834d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:37.512058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:37.534258 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3823a7-7b5b-472d-a32b-9c143bed721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:37.534918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3823a7-7b5b-472d-a32b-9c143bed721d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:37.535194 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3823a7-7b5b-472d-a32b-9c143bed721d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:37.535469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3823a7-7b5b-472d-a32b-9c143bed721d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:37.536041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3823a7-7b5b-472d-a32b-9c143bed721d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:37.537512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3823a7-7b5b-472d-a32b-9c143bed721d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7b3823a7-7b5b-472d-a32b-9c143bed721d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:37.546388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:37.547588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:37.548594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 642/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 03:15:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:37.553604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fedc3e-489b-49f8-874a-960218a2fac9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:37.650604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fedc3e-489b-49f8-874a-960218a2fac9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:37.683191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549edbb-4e1e-4c50-b54c-100457ce2376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:37.683800 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549edbb-4e1e-4c50-b54c-100457ce2376 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:37.684656 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549edbb-4e1e-4c50-b54c-100457ce2376 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:37.684929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549edbb-4e1e-4c50-b54c-100457ce2376 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:37.685588 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549edbb-4e1e-4c50-b54c-100457ce2376 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:37.685889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549edbb-4e1e-4c50-b54c-100457ce2376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:37.687248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549edbb-4e1e-4c50-b54c-100457ce2376 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:37.692128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 649/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Sep 13 03:15:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:37.697955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3823a7-7b5b-472d-a32b-9c143bed721d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:37.795602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3823a7-7b5b-472d-a32b-9c143bed721d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:37.828040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bd3fb-3f50-4e5d-9103-a7ff9385a0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:37.828633 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bd3fb-3f50-4e5d-9103-a7ff9385a0fa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:37.828910 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bd3fb-3f50-4e5d-9103-a7ff9385a0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:37.829181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bd3fb-3f50-4e5d-9103-a7ff9385a0fa None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:37.829831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bd3fb-3f50-4e5d-9103-a7ff9385a0fa None admin] RBAC: Adding query filter params (type=placement) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:37.830138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bd3fb-3f50-4e5d-9103-a7ff9385a0fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:37.831528 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bd3fb-3f50-4e5d-9103-a7ff9385a0fa None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:37.835808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 643/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Sep 13 03:15:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:39.977083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d34031-8e4f-4153-8b4d-675968940a38 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:39.977671 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d34031-8e4f-4153-8b4d-675968940a38 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:39.977671 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d34031-8e4f-4153-8b4d-675968940a38 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:39.979003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 650/1293] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:15:39.984868 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a19912-3b3a-4155-a29b-96f1e1a7189c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:39.985316 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a19912-3b3a-4155-a29b-96f1e1a7189c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:39.985473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a19912-3b3a-4155-a29b-96f1e1a7189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:40.004381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-92a19912-3b3a-4155-a29b-96f1e1a7189c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:15:40.005603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-92a19912-3b3a-4155-a29b-96f1e1a7189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:15:40.035215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:40.070503 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 644/1294] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:15:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:15:40.340610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d34031-8e4f-4153-8b4d-675968940a38 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:40.372759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:40.440463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d34031-8e4f-4153-8b4d-675968940a38 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:40.475263 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44bce4-50be-4ba9-aa29-f4420e49b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:40.475854 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44bce4-50be-4ba9-aa29-f4420e49b180 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:40.476130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44bce4-50be-4ba9-aa29-f4420e49b180 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:40.476417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44bce4-50be-4ba9-aa29-f4420e49b180 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:40.477046 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44bce4-50be-4ba9-aa29-f4420e49b180 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:40.478438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44bce4-50be-4ba9-aa29-f4420e49b180 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:40.595805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 651/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Sep 13 03:15:40 2022] POST /identity/v3/services => generated 246 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:15:42.738000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877589-2fcc-4583-8452-52369c28d0a5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:42.738579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877589-2fcc-4583-8452-52369c28d0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:42.738579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40877589-2fcc-4583-8452-52369c28d0a5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:42.739873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 645/1296] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:15:42.744964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea0c18-bc10-4e34-8d10-06a058dbb37d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:42.745417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea0c18-bc10-4e34-8d10-06a058dbb37d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:42.745794 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea0c18-bc10-4e34-8d10-06a058dbb37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:42.764202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d7ea0c18-bc10-4e34-8d10-06a058dbb37d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:15:42.765410 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d7ea0c18-bc10-4e34-8d10-06a058dbb37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:15:42.835359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 652/1297] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:15:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:15:43.101693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877589-2fcc-4583-8452-52369c28d0a5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:43.202089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40877589-2fcc-4583-8452-52369c28d0a5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:43.236235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8e90b-d922-4ae5-811c-7672b0d3f04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:43.236875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8e90b-d922-4ae5-811c-7672b0d3f04f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:43.237148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8e90b-d922-4ae5-811c-7672b0d3f04f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:43.237443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8e90b-d922-4ae5-811c-7672b0d3f04f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:43.240575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8e90b-d922-4ae5-811c-7672b0d3f04f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:43.240575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8e90b-d922-4ae5-811c-7672b0d3f04f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-98f8e90b-d922-4ae5-811c-7672b0d3f04f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:43.248169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:43.249567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:43.250704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 646/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 03:15:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:43.255466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea0c18-bc10-4e34-8d10-06a058dbb37d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:43.273622 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:43.352104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea0c18-bc10-4e34-8d10-06a058dbb37d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:43.385531 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed521c37-f536-4f95-a1cd-1a24e69f9c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:43.386120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed521c37-f536-4f95-a1cd-1a24e69f9c08 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:43.386392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed521c37-f536-4f95-a1cd-1a24e69f9c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:43.386685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed521c37-f536-4f95-a1cd-1a24e69f9c08 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:43.387298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed521c37-f536-4f95-a1cd-1a24e69f9c08 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:43.387633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed521c37-f536-4f95-a1cd-1a24e69f9c08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:43.388986 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed521c37-f536-4f95-a1cd-1a24e69f9c08 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:43.394018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 653/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Sep 13 03:15:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:43.400101 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8e90b-d922-4ae5-811c-7672b0d3f04f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:43.432194 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:43.499416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8e90b-d922-4ae5-811c-7672b0d3f04f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:43.532729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79c6bd-a2d6-479e-bbf0-4ec9a9ec650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:43.533375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79c6bd-a2d6-479e-bbf0-4ec9a9ec650f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:43.533655 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79c6bd-a2d6-479e-bbf0-4ec9a9ec650f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:43.533924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79c6bd-a2d6-479e-bbf0-4ec9a9ec650f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:43.534614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79c6bd-a2d6-479e-bbf0-4ec9a9ec650f None admin] RBAC: Adding query filter params (interface=public, service_id=7835ad4394274bce8222d074256552f3, region_id=RegionOne) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:43.534917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79c6bd-a2d6-479e-bbf0-4ec9a9ec650f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:43.536320 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79c6bd-a2d6-479e-bbf0-4ec9a9ec650f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:43.541171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 647/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Sep 13 03:15:43 2022] GET /identity/v3/endpoints?service_id=7835ad4394274bce8222d074256552f3&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:43.546881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed521c37-f536-4f95-a1cd-1a24e69f9c08 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:43.625701 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:43.643356 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed521c37-f536-4f95-a1cd-1a24e69f9c08 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:43.676155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba5e50-a19e-4985-9105-52fdb4cccbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:43.676776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba5e50-a19e-4985-9105-52fdb4cccbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:43.677046 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba5e50-a19e-4985-9105-52fdb4cccbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:43.677335 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba5e50-a19e-4985-9105-52fdb4cccbf6 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:43.677920 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba5e50-a19e-4985-9105-52fdb4cccbf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:43.679266 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba5e50-a19e-4985-9105-52fdb4cccbf6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:43.686392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 654/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Sep 13 03:15:43 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:15:45.819025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375b329-8831-42bd-9628-22a6d519cecf None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:45.819601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375b329-8831-42bd-9628-22a6d519cecf None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:45.819601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375b329-8831-42bd-9628-22a6d519cecf None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:45.820947 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 648/1302] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:15:45.826864 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233e567-682d-4be1-89fc-45ba72f5bf50 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:45.829218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233e567-682d-4be1-89fc-45ba72f5bf50 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:45.829218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233e567-682d-4be1-89fc-45ba72f5bf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:45.846112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a233e567-682d-4be1-89fc-45ba72f5bf50 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:15:45.847283 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a233e567-682d-4be1-89fc-45ba72f5bf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:15:45.911957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 655/1303] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:15:45 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 03:15:46.182397 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375b329-8831-42bd-9628-22a6d519cecf None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:46.275872 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:46.282330 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375b329-8831-42bd-9628-22a6d519cecf None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:46.316993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e92ab-9f1a-4a28-98f5-5c192456caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:46.317619 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e92ab-9f1a-4a28-98f5-5c192456caa5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:46.317893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e92ab-9f1a-4a28-98f5-5c192456caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:46.318159 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e92ab-9f1a-4a28-98f5-5c192456caa5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:46.318729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e92ab-9f1a-4a28-98f5-5c192456caa5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:46.320078 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e92ab-9f1a-4a28-98f5-5c192456caa5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b18e92ab-9f1a-4a28-98f5-5c192456caa5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 03:15:46.329240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 03:15:46.330423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 13 03:15:46.331449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 649/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Sep 13 03:15:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 03:15:46.336499 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233e567-682d-4be1-89fc-45ba72f5bf50 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:46.410912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:46.432468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233e567-682d-4be1-89fc-45ba72f5bf50 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:46.465539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2ea32-7405-4a81-b954-96a63ef965c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:46.466137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2ea32-7405-4a81-b954-96a63ef965c2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:46.466413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2ea32-7405-4a81-b954-96a63ef965c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:46.466685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2ea32-7405-4a81-b954-96a63ef965c2 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:46.467304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2ea32-7405-4a81-b954-96a63ef965c2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:15:46.467606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2ea32-7405-4a81-b954-96a63ef965c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:46.468962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2ea32-7405-4a81-b954-96a63ef965c2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:46.474149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 656/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Sep 13 03:15:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:15:46.479785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e92ab-9f1a-4a28-98f5-5c192456caa5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:15:46.577646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e92ab-9f1a-4a28-98f5-5c192456caa5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:15:46.610396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b037fc-7022-4427-955b-5c3e80430245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:15:46.610982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b037fc-7022-4427-955b-5c3e80430245 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:15:46.611254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b037fc-7022-4427-955b-5c3e80430245 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:15:46.611522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b037fc-7022-4427-955b-5c3e80430245 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:15:46.612247 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b037fc-7022-4427-955b-5c3e80430245 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:15:46.613627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b037fc-7022-4427-955b-5c3e80430245 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:15:46.706380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 650/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:15:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:15:56.475312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=30 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:15:56.701819 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:46.325322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e88cf2-4595-4749-8ff2-028dcd534f09 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:46.325896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e88cf2-4595-4749-8ff2-028dcd534f09 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:46.325896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e88cf2-4595-4749-8ff2-028dcd534f09 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:46.327188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 657/1307] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:21:46.332577 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc12c94-759b-4064-8073-8eabf67351f3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:46.333010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc12c94-759b-4064-8073-8eabf67351f3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:46.333183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc12c94-759b-4064-8073-8eabf67351f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:46.431548 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-edc12c94-759b-4064-8073-8eabf67351f3 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:21:46.433982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-edc12c94-759b-4064-8073-8eabf67351f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:46.554400 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 651/1308] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:21:46.848980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec98c1-7cae-4097-a335-b71c61924be6 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:46.849293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec98c1-7cae-4097-a335-b71c61924be6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:46.849571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec98c1-7cae-4097-a335-b71c61924be6 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:46.850921 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 658/1309] 10.222.0.48 () {54 vars in 965 bytes} [Tue Sep 13 03:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:21:46.857191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377bcef-8ce9-4990-850a-a4367bca2d37 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:46.857775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377bcef-8ce9-4990-850a-a4367bca2d37 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:46.858155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377bcef-8ce9-4990-850a-a4367bca2d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:46.938227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9377bcef-8ce9-4990-850a-a4367bca2d37 None None] MFA Rules not processed for user `5bb4ef26660244ce90b0105113e252b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:21:46.939919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9377bcef-8ce9-4990-850a-a4367bca2d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:46.961554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:47.020693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 652/1310] 10.222.0.48 () {58 vars in 1062 bytes} [Tue Sep 13 03:21:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:21:47.029599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec98c1-7cae-4097-a335-b71c61924be6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:21:47.031477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c8ec98c1-7cae-4097-a335-b71c61924be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:47.154296 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec98c1-7cae-4097-a335-b71c61924be6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:21:47.246308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89f670-c50a-4f34-8dd7-15963c921540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:21:47.246932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89f670-c50a-4f34-8dd7-15963c921540 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:47.247218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89f670-c50a-4f34-8dd7-15963c921540 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:47.247494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89f670-c50a-4f34-8dd7-15963c921540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:47.249187 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7b89f670-c50a-4f34-8dd7-15963c921540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:47.310903 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:47.379479 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89f670-c50a-4f34-8dd7-15963c921540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:21:47.380959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89f670-c50a-4f34-8dd7-15963c921540 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:21:47.404415 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 659/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:21:49.840090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb186b-37bf-465d-bcdf-d6cf00046730 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:49.840739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb186b-37bf-465d-bcdf-d6cf00046730 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:49.840739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb186b-37bf-465d-bcdf-d6cf00046730 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:49.842156 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 653/1312] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:21:49.847988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a31f46-cc50-4dbc-9c95-0d23ca5f5aab None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:49.848435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a31f46-cc50-4dbc-9c95-0d23ca5f5aab None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:49.848535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a31f46-cc50-4dbc-9c95-0d23ca5f5aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:49.935189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a9a31f46-cc50-4dbc-9c95-0d23ca5f5aab None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:21:49.936544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a9a31f46-cc50-4dbc-9c95-0d23ca5f5aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:50.043586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 660/1313] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:21:50.337420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f268d73-f275-4377-9e5a-c942167cae5c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:50.337797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f268d73-f275-4377-9e5a-c942167cae5c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:50.338141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f268d73-f275-4377-9e5a-c942167cae5c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:50.339563 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 654/1314] 10.222.0.48 () {54 vars in 965 bytes} [Tue Sep 13 03:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:21:50.346276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30afc-dd75-4b01-9ae4-2ef0dc801a89 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:50.346563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30afc-dd75-4b01-9ae4-2ef0dc801a89 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:50.346835 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30afc-dd75-4b01-9ae4-2ef0dc801a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:50.358469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:50.423776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d6d30afc-dd75-4b01-9ae4-2ef0dc801a89 None None] MFA Rules not processed for user `5bb4ef26660244ce90b0105113e252b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:21:50.424893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d6d30afc-dd75-4b01-9ae4-2ef0dc801a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:50.501482 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 661/1315] 10.222.0.48 () {58 vars in 1062 bytes} [Tue Sep 13 03:21:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:21:50.510513 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f268d73-f275-4377-9e5a-c942167cae5c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:21:50.512046 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4f268d73-f275-4377-9e5a-c942167cae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:50.615278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f268d73-f275-4377-9e5a-c942167cae5c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:21:50.696674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:50.699026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac73e27-8066-41d7-9253-985bc0f8e3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:21:50.699647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac73e27-8066-41d7-9253-985bc0f8e3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:50.699926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac73e27-8066-41d7-9253-985bc0f8e3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:50.700198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac73e27-8066-41d7-9253-985bc0f8e3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:50.701904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eac73e27-8066-41d7-9253-985bc0f8e3c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:50.821995 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac73e27-8066-41d7-9253-985bc0f8e3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:21:50.823900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac73e27-8066-41d7-9253-985bc0f8e3c3 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:21:50.843826 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 655/1316] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:21:53.704662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42479c69-e8d0-4d63-8331-19ce0fad1841 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:53.715768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42479c69-e8d0-4d63-8331-19ce0fad1841 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:53.715768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42479c69-e8d0-4d63-8331-19ce0fad1841 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:53.715768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 662/1317] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:21:53.716042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2e18e-6dc1-4fcf-98cc-9366a0da80ec None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:53.716042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2e18e-6dc1-4fcf-98cc-9366a0da80ec None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:53.716042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2e18e-6dc1-4fcf-98cc-9366a0da80ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:53.777842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dae2e18e-6dc1-4fcf-98cc-9366a0da80ec None None] MFA Rules not processed for user `34120ea2deec47d6b705c0a9193dce4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:21:53.779150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dae2e18e-6dc1-4fcf-98cc-9366a0da80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:53.830325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:53.874338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 656/1318] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:21:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:21:54.154441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42479c69-e8d0-4d63-8331-19ce0fad1841 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:21:54.155691 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-42479c69-e8d0-4d63-8331-19ce0fad1841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:54.256794 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42479c69-e8d0-4d63-8331-19ce0fad1841 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:21:54.259548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:54.328191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651b823-31bf-45a9-b9d4-acfa0fe4c57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:21:54.328809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651b823-31bf-45a9-b9d4-acfa0fe4c57f service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:54.329121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651b823-31bf-45a9-b9d4-acfa0fe4c57f service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:54.329434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651b823-31bf-45a9-b9d4-acfa0fe4c57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:54.330990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3651b823-31bf-45a9-b9d4-acfa0fe4c57f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:54.436159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651b823-31bf-45a9-b9d4-acfa0fe4c57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:21:54.437534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651b823-31bf-45a9-b9d4-acfa0fe4c57f service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:21:54.454821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 663/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:21:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:21:57.257851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b480a6-35ed-4ad9-8385-013c8a962927 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:57.258373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b480a6-35ed-4ad9-8385-013c8a962927 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:57.258373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b480a6-35ed-4ad9-8385-013c8a962927 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:57.259734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 657/1320] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:21:57.264961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b91244-9bf6-4e04-a31f-3966396a19eb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:57.265358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b91244-9bf6-4e04-a31f-3966396a19eb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:57.265538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b91244-9bf6-4e04-a31f-3966396a19eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:57.306211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:57.330703 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a8b91244-9bf6-4e04-a31f-3966396a19eb None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:21:57.331997 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a8b91244-9bf6-4e04-a31f-3966396a19eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:57.428264 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 664/1321] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:21:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:21:57.715203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b480a6-35ed-4ad9-8385-013c8a962927 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:21:57.716740 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-45b480a6-35ed-4ad9-8385-013c8a962927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:57.818468 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b480a6-35ed-4ad9-8385-013c8a962927 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:21:57.893645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0dfc2-1972-4fd8-bc41-0e16d0c9d2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:21:57.894246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0dfc2-1972-4fd8-bc41-0e16d0c9d2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:21:57.894524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0dfc2-1972-4fd8-bc41-0e16d0c9d2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:21:57.894798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0dfc2-1972-4fd8-bc41-0e16d0c9d2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:21:57.896386 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-65b0dfc2-1972-4fd8-bc41-0e16d0c9d2b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:21:57.903657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:21:58.005165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0dfc2-1972-4fd8-bc41-0e16d0c9d2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:21:58.006694 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0dfc2-1972-4fd8-bc41-0e16d0c9d2b3 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:21:58.024675 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 658/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:21:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:01.073917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fbe32-f5d4-4f7c-a388-a55f499df951 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:01.074447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fbe32-f5d4-4f7c-a388-a55f499df951 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:01.074447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fbe32-f5d4-4f7c-a388-a55f499df951 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:01.075804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 665/1323] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:01.081620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2817ce-7007-428b-b2e0-b492ef25a5e5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:01.082025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2817ce-7007-428b-b2e0-b492ef25a5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:01.082302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2817ce-7007-428b-b2e0-b492ef25a5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:01.149602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cd2817ce-7007-428b-b2e0-b492ef25a5e5 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:01.150760 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cd2817ce-7007-428b-b2e0-b492ef25a5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:01.212136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:01.254894 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 659/1324] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:01.538597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fbe32-f5d4-4f7c-a388-a55f499df951 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:01.540277 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4a3fbe32-f5d4-4f7c-a388-a55f499df951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:01.644966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fbe32-f5d4-4f7c-a388-a55f499df951 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:01.658494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:01.720609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e34ea-bdab-4c1c-8291-da69c662f16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:01.721295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e34ea-bdab-4c1c-8291-da69c662f16c service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:01.721529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e34ea-bdab-4c1c-8291-da69c662f16c service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:01.721800 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e34ea-bdab-4c1c-8291-da69c662f16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:01.723391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-413e34ea-bdab-4c1c-8291-da69c662f16c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:01.833010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e34ea-bdab-4c1c-8291-da69c662f16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:01.834408 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e34ea-bdab-4c1c-8291-da69c662f16c service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:01.852509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 666/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:04.038718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bc4a5-9ccf-4f57-95c1-54d0165715f7 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:04.039262 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bc4a5-9ccf-4f57-95c1-54d0165715f7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:04.039262 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bc4a5-9ccf-4f57-95c1-54d0165715f7 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:04.040624 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 660/1326] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:04.046610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c824f91-e471-4c3f-bf14-a637ea3a5389 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:04.047235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c824f91-e471-4c3f-bf14-a637ea3a5389 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:04.047235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c824f91-e471-4c3f-bf14-a637ea3a5389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:04.097658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:04.115459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6c824f91-e471-4c3f-bf14-a637ea3a5389 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:04.116721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6c824f91-e471-4c3f-bf14-a637ea3a5389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:04.217376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 667/1327] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:04.501746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bc4a5-9ccf-4f57-95c1-54d0165715f7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:04.503305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0b3bc4a5-9ccf-4f57-95c1-54d0165715f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:04.607797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bc4a5-9ccf-4f57-95c1-54d0165715f7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:04.682422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1efe1e-d74a-49b1-a230-b3d176a98ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:04.683026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1efe1e-d74a-49b1-a230-b3d176a98ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:04.683297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1efe1e-d74a-49b1-a230-b3d176a98ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:04.683563 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1efe1e-d74a-49b1-a230-b3d176a98ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:04.685137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9d1efe1e-d74a-49b1-a230-b3d176a98ea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:04.702259 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:04.793428 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1efe1e-d74a-49b1-a230-b3d176a98ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:04.794815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1efe1e-d74a-49b1-a230-b3d176a98ea6 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:04.813290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 661/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:07.029357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20e74-b458-4b91-be10-24ed23e6a395 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:07.029905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20e74-b458-4b91-be10-24ed23e6a395 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:07.029905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20e74-b458-4b91-be10-24ed23e6a395 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:07.031810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 668/1329] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:07.036868 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17914a9-d9d1-419f-9d9e-4c9993bb9e48 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:07.037349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17914a9-d9d1-419f-9d9e-4c9993bb9e48 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:07.037446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17914a9-d9d1-419f-9d9e-4c9993bb9e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:07.103683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b17914a9-d9d1-419f-9d9e-4c9993bb9e48 None None] MFA Rules not processed for user `34120ea2deec47d6b705c0a9193dce4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:07.104815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b17914a9-d9d1-419f-9d9e-4c9993bb9e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:07.169241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:07.201122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 662/1330] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:07.482437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20e74-b458-4b91-be10-24ed23e6a395 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:07.484005 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-22f20e74-b458-4b91-be10-24ed23e6a395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:07.594290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20e74-b458-4b91-be10-24ed23e6a395 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:07.616052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:07.672665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a870eca-85c1-4038-a7d4-9416e145aa6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:07.673364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a870eca-85c1-4038-a7d4-9416e145aa6b service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:07.673685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a870eca-85c1-4038-a7d4-9416e145aa6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:07.673957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a870eca-85c1-4038-a7d4-9416e145aa6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:07.675546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3a870eca-85c1-4038-a7d4-9416e145aa6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:07.783282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a870eca-85c1-4038-a7d4-9416e145aa6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:07.784636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a870eca-85c1-4038-a7d4-9416e145aa6b service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:07.803069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 669/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:10.346396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fe4a2-b73e-4919-9350-d6de9c97d70d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:10.346962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fe4a2-b73e-4919-9350-d6de9c97d70d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:10.346962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fe4a2-b73e-4919-9350-d6de9c97d70d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:10.348269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 663/1332] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:10.353564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af1ef3-e25c-4eb0-9613-7a041e2cdc00 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:10.353971 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af1ef3-e25c-4eb0-9613-7a041e2cdc00 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:10.354118 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af1ef3-e25c-4eb0-9613-7a041e2cdc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:10.417730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:10.420399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-41af1ef3-e25c-4eb0-9613-7a041e2cdc00 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:10.421681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-41af1ef3-e25c-4eb0-9613-7a041e2cdc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:10.516335 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 670/1333] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:10.813128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fe4a2-b73e-4919-9350-d6de9c97d70d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:10.814710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f99fe4a2-b73e-4919-9350-d6de9c97d70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:10.919692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fe4a2-b73e-4919-9350-d6de9c97d70d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:10.998159 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9636fb-f5a0-4417-b930-be02849adabf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:10.998752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9636fb-f5a0-4417-b930-be02849adabf service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:10.999028 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9636fb-f5a0-4417-b930-be02849adabf service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:10.999304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9636fb-f5a0-4417-b930-be02849adabf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:11.001430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-df9636fb-f5a0-4417-b930-be02849adabf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:11.027565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:11.107860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9636fb-f5a0-4417-b930-be02849adabf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:11.109749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9636fb-f5a0-4417-b930-be02849adabf service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:11.128592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 664/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:13.313351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9953682-3026-4c23-bfa0-df9e78b003ff None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:13.313879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9953682-3026-4c23-bfa0-df9e78b003ff None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:13.314003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9953682-3026-4c23-bfa0-df9e78b003ff None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:13.315261 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 671/1335] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:13.320577 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81d1bd-066e-46af-9f3e-f51704eb72cf None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:13.320977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81d1bd-066e-46af-9f3e-f51704eb72cf None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:13.321119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81d1bd-066e-46af-9f3e-f51704eb72cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:13.387032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ee81d1bd-066e-46af-9f3e-f51704eb72cf None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:13.388222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ee81d1bd-066e-46af-9f3e-f51704eb72cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:13.460542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:13.482673 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 665/1336] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:13.769392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9953682-3026-4c23-bfa0-df9e78b003ff None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:13.770941 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e9953682-3026-4c23-bfa0-df9e78b003ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:13.874343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9953682-3026-4c23-bfa0-df9e78b003ff None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:13.904709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:13.949858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eee1e1-4cd2-4d83-8af1-265b8a9a5fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:13.950454 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee1e1-4cd2-4d83-8af1-265b8a9a5fcf service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:13.950729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee1e1-4cd2-4d83-8af1-265b8a9a5fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:13.950995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee1e1-4cd2-4d83-8af1-265b8a9a5fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:13.952577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-15eee1e1-4cd2-4d83-8af1-265b8a9a5fcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:14.058693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eee1e1-4cd2-4d83-8af1-265b8a9a5fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:14.060051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eee1e1-4cd2-4d83-8af1-265b8a9a5fcf service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:14.078490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 672/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:16.786839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac8db1-24b2-4af9-a7ac-0702979f2f03 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:16.787261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac8db1-24b2-4af9-a7ac-0702979f2f03 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:16.787388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac8db1-24b2-4af9-a7ac-0702979f2f03 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:16.788921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 666/1338] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:16.794065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399f208-846e-49dc-88f6-c64d5736297c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:16.794460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399f208-846e-49dc-88f6-c64d5736297c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:16.794684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399f208-846e-49dc-88f6-c64d5736297c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:16.860657 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4399f208-846e-49dc-88f6-c64d5736297c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:16.861934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4399f208-846e-49dc-88f6-c64d5736297c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:16.870546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:16.958227 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 673/1339] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:22:17.240924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac8db1-24b2-4af9-a7ac-0702979f2f03 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:17.242512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a3ac8db1-24b2-4af9-a7ac-0702979f2f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:17.343442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac8db1-24b2-4af9-a7ac-0702979f2f03 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:17.415286 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94572d97-7494-4ffd-99a6-9a68a6024e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:17.415822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94572d97-7494-4ffd-99a6-9a68a6024e85 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:17.416098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94572d97-7494-4ffd-99a6-9a68a6024e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:17.416365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94572d97-7494-4ffd-99a6-9a68a6024e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:17.417965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-94572d97-7494-4ffd-99a6-9a68a6024e85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:17.452356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:17.524697 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94572d97-7494-4ffd-99a6-9a68a6024e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:17.526177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94572d97-7494-4ffd-99a6-9a68a6024e85 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:17.544181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 667/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:21.820043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afef1c4-18f4-4cbf-8a40-3f25ba5c0ae2 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:21.820632 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afef1c4-18f4-4cbf-8a40-3f25ba5c0ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:21.820632 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afef1c4-18f4-4cbf-8a40-3f25ba5c0ae2 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:21.821976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 674/1341] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:21.827497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1452ff-da54-4724-bbf8-cba46d0be432 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:21.827931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1452ff-da54-4724-bbf8-cba46d0be432 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:21.828668 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1452ff-da54-4724-bbf8-cba46d0be432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:21.896918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5f1452ff-da54-4724-bbf8-cba46d0be432 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:21.898234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5f1452ff-da54-4724-bbf8-cba46d0be432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:21.988284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:21.999713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 668/1342] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:22.281253 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afef1c4-18f4-4cbf-8a40-3f25ba5c0ae2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:22.282809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1afef1c4-18f4-4cbf-8a40-3f25ba5c0ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:22.387158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afef1c4-18f4-4cbf-8a40-3f25ba5c0ae2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:22.426608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:22.464402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc9cab-940d-4797-a034-21d60bbb98a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:22.465008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc9cab-940d-4797-a034-21d60bbb98a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:22.465307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc9cab-940d-4797-a034-21d60bbb98a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:22.465587 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc9cab-940d-4797-a034-21d60bbb98a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:22.467190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c6bc9cab-940d-4797-a034-21d60bbb98a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:22.578643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc9cab-940d-4797-a034-21d60bbb98a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:22.579996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc9cab-940d-4797-a034-21d60bbb98a8 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:22.598415 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 675/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:25.754973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71113c4e-d0c1-46c1-9180-56b4c137d713 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:25.755532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71113c4e-d0c1-46c1-9180-56b4c137d713 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:25.755532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71113c4e-d0c1-46c1-9180-56b4c137d713 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:25.756867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 669/1344] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:25.762597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2bb84-737c-44e9-8df4-4a7adac3496a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:25.763084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2bb84-737c-44e9-8df4-4a7adac3496a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:25.763170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2bb84-737c-44e9-8df4-4a7adac3496a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:25.831287 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c7d2bb84-737c-44e9-8df4-4a7adac3496a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:25.832489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c7d2bb84-737c-44e9-8df4-4a7adac3496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:25.851465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:25.931348 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 676/1345] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:26.237500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71113c4e-d0c1-46c1-9180-56b4c137d713 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:26.239091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-71113c4e-d0c1-46c1-9180-56b4c137d713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:26.351298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71113c4e-d0c1-46c1-9180-56b4c137d713 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:26.440355 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3003b-e2f1-4cca-9320-ab0ccb37147e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:26.445727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3003b-e2f1-4cca-9320-ab0ccb37147e service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:26.445727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3003b-e2f1-4cca-9320-ab0ccb37147e service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:26.445727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3003b-e2f1-4cca-9320-ab0ccb37147e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:26.445727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fab3003b-e2f1-4cca-9320-ab0ccb37147e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:26.494986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:26.567456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3003b-e2f1-4cca-9320-ab0ccb37147e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:26.568952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3003b-e2f1-4cca-9320-ab0ccb37147e service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:26.588318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 670/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:30.868728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d369f-fdac-4110-afd3-485c1e650102 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:30.869316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d369f-fdac-4110-afd3-485c1e650102 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:30.869316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d369f-fdac-4110-afd3-485c1e650102 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:30.870687 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 677/1347] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:30.876678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd5af8-65a9-478e-905e-9e65fd2b794b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:30.877148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd5af8-65a9-478e-905e-9e65fd2b794b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:30.877390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd5af8-65a9-478e-905e-9e65fd2b794b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:30.947973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-61fd5af8-65a9-478e-905e-9e65fd2b794b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:30.949190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-61fd5af8-65a9-478e-905e-9e65fd2b794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:31.047932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:31.050174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 671/1348] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:31.332189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d369f-fdac-4110-afd3-485c1e650102 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:31.333740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2e2d369f-fdac-4110-afd3-485c1e650102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:31.435591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d369f-fdac-4110-afd3-485c1e650102 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:31.483100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:31.508172 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dff41b-fe39-4302-893a-c8ce23832370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:31.508766 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dff41b-fe39-4302-893a-c8ce23832370 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:31.509048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dff41b-fe39-4302-893a-c8ce23832370 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:31.509348 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dff41b-fe39-4302-893a-c8ce23832370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:31.510934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-05dff41b-fe39-4302-893a-c8ce23832370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:31.619595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dff41b-fe39-4302-893a-c8ce23832370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:31.621017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dff41b-fe39-4302-893a-c8ce23832370 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:31.639901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 678/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:36.526255 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb6379-cc89-4a13-bf62-29cf175ac395 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:36.527059 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb6379-cc89-4a13-bf62-29cf175ac395 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:36.527770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb6379-cc89-4a13-bf62-29cf175ac395 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:36.536992 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63791f40-c362-4f36-aeef-26d2a4d66f1b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:36.536992 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63791f40-c362-4f36-aeef-26d2a4d66f1b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:36.536992 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63791f40-c362-4f36-aeef-26d2a4d66f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:36.538652 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 672/1350] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:36.688959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-63791f40-c362-4f36-aeef-26d2a4d66f1b None None] MFA Rules not processed for user `e261a9485c3b4d2aa657a931e0388389`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:36.690312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-63791f40-c362-4f36-aeef-26d2a4d66f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:36.734449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:36.816026 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 679/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:22:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:22:40.781315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402eb3-c2da-4854-a056-850deaedfc69 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:40.781859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402eb3-c2da-4854-a056-850deaedfc69 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:40.782074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402eb3-c2da-4854-a056-850deaedfc69 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:40.783510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 673/1352] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:40.789208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b693a-d05b-411d-8e58-3e61c47450b8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:40.789643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b693a-d05b-411d-8e58-3e61c47450b8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:40.790056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b693a-d05b-411d-8e58-3e61c47450b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:40.870679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-df5b693a-d05b-411d-8e58-3e61c47450b8 None None] MFA Rules not processed for user `e261a9485c3b4d2aa657a931e0388389`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:40.871980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-df5b693a-d05b-411d-8e58-3e61c47450b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:40.950923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:40.992355 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 680/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:22:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:42.420043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff976f3b-9c31-438d-9006-cf0d37270738 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:42.420569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff976f3b-9c31-438d-9006-cf0d37270738 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:42.420771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff976f3b-9c31-438d-9006-cf0d37270738 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:42.423396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 674/1354] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:42.428901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313e382-90b3-458b-93be-03abda20fba9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:42.429354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313e382-90b3-458b-93be-03abda20fba9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:42.429560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313e382-90b3-458b-93be-03abda20fba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:42.510419 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3313e382-90b3-458b-93be-03abda20fba9 None None] MFA Rules not processed for user `e261a9485c3b4d2aa657a931e0388389`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:42.511637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3313e382-90b3-458b-93be-03abda20fba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:42.623664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 681/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:22:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:22:46.172897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c876db-1aa2-4fe9-a595-d2eecd6fa34f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:46.173769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c876db-1aa2-4fe9-a595-d2eecd6fa34f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:46.174193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c876db-1aa2-4fe9-a595-d2eecd6fa34f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:46.176128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 675/1356] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:46.181667 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffdcd0-cf3a-4847-93b4-caa7c6daaffd None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:46.182176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffdcd0-cf3a-4847-93b4-caa7c6daaffd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:46.182282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffdcd0-cf3a-4847-93b4-caa7c6daaffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:46.219735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:46.253688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2bffdcd0-cf3a-4847-93b4-caa7c6daaffd None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:46.254873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2bffdcd0-cf3a-4847-93b4-caa7c6daaffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:46.354942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 682/1357] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:46.656815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd8e26-b034-42c3-bbf1-7ce8b60ab233 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:46.657643 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd8e26-b034-42c3-bbf1-7ce8b60ab233 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:46.658641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd8e26-b034-42c3-bbf1-7ce8b60ab233 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:46.660354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 676/1358] 10.222.0.48 () {54 vars in 962 bytes} [Tue Sep 13 03:22:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:46.674464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d727dd5-a6bd-4231-8665-7e5768047a5d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:46.675791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d727dd5-a6bd-4231-8665-7e5768047a5d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:46.675791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d727dd5-a6bd-4231-8665-7e5768047a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:46.767429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6d727dd5-a6bd-4231-8665-7e5768047a5d None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:46.768613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6d727dd5-a6bd-4231-8665-7e5768047a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:46.820535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:46.891898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 683/1359] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Sep 13 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:22:46.899481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd8e26-b034-42c3-bbf1-7ce8b60ab233 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:46.901528 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-51cd8e26-b034-42c3-bbf1-7ce8b60ab233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:47.070570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd8e26-b034-42c3-bbf1-7ce8b60ab233 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:47.148265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:47.191031 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d3b51-4ea4-4720-86e0-9191966b76cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:47.191861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3b51-4ea4-4720-86e0-9191966b76cc service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:47.192239 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3b51-4ea4-4720-86e0-9191966b76cc service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:47.192602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3b51-4ea4-4720-86e0-9191966b76cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:47.194333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d16d3b51-4ea4-4720-86e0-9191966b76cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:47.294855 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d3b51-4ea4-4720-86e0-9191966b76cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:47.296685 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d3b51-4ea4-4720-86e0-9191966b76cc service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:47.316503 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 677/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:49.734288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db527f6-3619-48cf-b938-b918f4385cc0 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:49.735169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db527f6-3619-48cf-b938-b918f4385cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:49.735596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db527f6-3619-48cf-b938-b918f4385cc0 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:49.737096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 684/1361] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:22:49.743164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21896df-9421-41ac-8910-a53b744a98f8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:49.750360 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21896df-9421-41ac-8910-a53b744a98f8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:49.750360 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21896df-9421-41ac-8910-a53b744a98f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:49.845167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f21896df-9421-41ac-8910-a53b744a98f8 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:49.846723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f21896df-9421-41ac-8910-a53b744a98f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:49.887136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:49.950523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 678/1362] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:50.238659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db527f6-3619-48cf-b938-b918f4385cc0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:50.240467 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1db527f6-3619-48cf-b938-b918f4385cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:50.417489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db527f6-3619-48cf-b938-b918f4385cc0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:50.430572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:50.558881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b733fb4-b1ca-4db9-ab63-c83c3160993d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:50.559552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b733fb4-b1ca-4db9-ab63-c83c3160993d service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:50.559836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b733fb4-b1ca-4db9-ab63-c83c3160993d service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:50.560110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b733fb4-b1ca-4db9-ab63-c83c3160993d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:50.561786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9b733fb4-b1ca-4db9-ab63-c83c3160993d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:50.656473 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b733fb4-b1ca-4db9-ab63-c83c3160993d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:50.658145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b733fb4-b1ca-4db9-ab63-c83c3160993d service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:50.676981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 685/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:53.265026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f048b-5520-4480-9f4b-a907cf171d0b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:53.265682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f048b-5520-4480-9f4b-a907cf171d0b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:53.265682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f048b-5520-4480-9f4b-a907cf171d0b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:53.267155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 679/1364] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:53.272135 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b901be1-7da3-4c11-94e5-5c33aefdd0cb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:53.272549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b901be1-7da3-4c11-94e5-5c33aefdd0cb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:53.272729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b901be1-7da3-4c11-94e5-5c33aefdd0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:53.288647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:53.344090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5b901be1-7da3-4c11-94e5-5c33aefdd0cb None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:53.345424 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5b901be1-7da3-4c11-94e5-5c33aefdd0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:53.446035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 686/1365] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:53.732533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee292d56-825b-4d6d-9f2a-3785561062cb None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:53.733642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee292d56-825b-4d6d-9f2a-3785561062cb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:53.733991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee292d56-825b-4d6d-9f2a-3785561062cb None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:53.735798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 680/1366] 10.222.0.48 () {54 vars in 962 bytes} [Tue Sep 13 03:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:53.741208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a284bf-fc4c-4a91-9bb3-2eb297504bfd None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:53.741606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a284bf-fc4c-4a91-9bb3-2eb297504bfd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:53.741947 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a284bf-fc4c-4a91-9bb3-2eb297504bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:53.826269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b1a284bf-fc4c-4a91-9bb3-2eb297504bfd None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:53.827602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b1a284bf-fc4c-4a91-9bb3-2eb297504bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:53.866257 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:53.954471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 687/1367] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Sep 13 03:22:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:22:53.962426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee292d56-825b-4d6d-9f2a-3785561062cb None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:53.964065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ee292d56-825b-4d6d-9f2a-3785561062cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:54.122661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee292d56-825b-4d6d-9f2a-3785561062cb None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:54.145186 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:54.247209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30834b4d-992d-45d0-8bc1-c821d2cdd6af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:54.247733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30834b4d-992d-45d0-8bc1-c821d2cdd6af service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:54.248008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30834b4d-992d-45d0-8bc1-c821d2cdd6af service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:54.248279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30834b4d-992d-45d0-8bc1-c821d2cdd6af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:54.250066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-30834b4d-992d-45d0-8bc1-c821d2cdd6af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:54.346810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30834b4d-992d-45d0-8bc1-c821d2cdd6af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:54.348423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30834b4d-992d-45d0-8bc1-c821d2cdd6af service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:54.368547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 681/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:54.499475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8db56a-540a-4eb8-8853-7ebeda351ae8 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:54.500008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8db56a-540a-4eb8-8853-7ebeda351ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:54.500008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8db56a-540a-4eb8-8853-7ebeda351ae8 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:54.501504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 688/1369] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:54.507220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8684e1-b8d8-4249-afcd-28a35398ff5e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:54.507447 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8684e1-b8d8-4249-afcd-28a35398ff5e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:54.507720 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8684e1-b8d8-4249-afcd-28a35398ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:54.547169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:54.587460 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-db8684e1-b8d8-4249-afcd-28a35398ff5e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:54.588701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-db8684e1-b8d8-4249-afcd-28a35398ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:54.698340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 682/1370] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:55.032751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30db2-4e55-4e78-966a-26ecf47d0f3f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:55.032751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30db2-4e55-4e78-966a-26ecf47d0f3f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:55.032751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb30db2-4e55-4e78-966a-26ecf47d0f3f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:55.035507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 689/1371] 10.222.0.48 () {54 vars in 964 bytes} [Tue Sep 13 03:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:55.038557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf2110-62b3-4665-94ef-2c545cfc9a88 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:55.038850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf2110-62b3-4665-94ef-2c545cfc9a88 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:55.039125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf2110-62b3-4665-94ef-2c545cfc9a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:55.122135 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-eadf2110-62b3-4665-94ef-2c545cfc9a88 None None] MFA Rules not processed for user `92e0ce020fb448bc9d470e918a022ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:55.123861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eadf2110-62b3-4665-94ef-2c545cfc9a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:55.174085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:55.206844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 683/1372] 10.222.0.48 () {58 vars in 1061 bytes} [Tue Sep 13 03:22:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:55.214049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb30db2-4e55-4e78-966a-26ecf47d0f3f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:55.215561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0eb30db2-4e55-4e78-966a-26ecf47d0f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:55.338417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb30db2-4e55-4e78-966a-26ecf47d0f3f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:55.381382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:55.417227 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44d20d-46ed-441b-9c8a-eb96fb22ec8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:55.417945 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44d20d-46ed-441b-9c8a-eb96fb22ec8e service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:55.418113 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44d20d-46ed-441b-9c8a-eb96fb22ec8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:55.418381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44d20d-46ed-441b-9c8a-eb96fb22ec8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:55.420768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6f44d20d-46ed-441b-9c8a-eb96fb22ec8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:55.552842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44d20d-46ed-441b-9c8a-eb96fb22ec8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:55.554444 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44d20d-46ed-441b-9c8a-eb96fb22ec8e service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:55.581854 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 690/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:56.773308 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575e7f8-38d2-4a9e-a38c-b7a246a46766 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:56.773866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575e7f8-38d2-4a9e-a38c-b7a246a46766 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:56.773866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575e7f8-38d2-4a9e-a38c-b7a246a46766 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:56.775200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 684/1374] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:56.781162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21ac2-90ff-4d7d-bd95-a8906f26933b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:56.781675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21ac2-90ff-4d7d-bd95-a8906f26933b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:56.781789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21ac2-90ff-4d7d-bd95-a8906f26933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:56.847502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a9b21ac2-90ff-4d7d-bd95-a8906f26933b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:56.848712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a9b21ac2-90ff-4d7d-bd95-a8906f26933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:56.869573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:56.946279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 691/1375] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:22:57.236730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575e7f8-38d2-4a9e-a38c-b7a246a46766 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:22:57.238405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9575e7f8-38d2-4a9e-a38c-b7a246a46766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:57.395430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575e7f8-38d2-4a9e-a38c-b7a246a46766 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:22:57.447790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:22:57.512172 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e19e5-d571-4304-9fc3-a73dddfbd072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:22:57.512776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e19e5-d571-4304-9fc3-a73dddfbd072 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:57.513050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e19e5-d571-4304-9fc3-a73dddfbd072 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:57.513342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e19e5-d571-4304-9fc3-a73dddfbd072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:57.514965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-293e19e5-d571-4304-9fc3-a73dddfbd072 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:22:57.609971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e19e5-d571-4304-9fc3-a73dddfbd072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:22:57.611588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e19e5-d571-4304-9fc3-a73dddfbd072 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:22:57.631344 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 685/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:22:59.911147 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735e5b7-e7ad-439d-9c0c-c01aab7c3f4c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:59.911713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735e5b7-e7ad-439d-9c0c-c01aab7c3f4c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:59.911713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735e5b7-e7ad-439d-9c0c-c01aab7c3f4c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:59.912933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 692/1377] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:22:59.918131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26541f32-f8d6-4b43-a7e3-ceb97b100fad None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:22:59.918520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26541f32-f8d6-4b43-a7e3-ceb97b100fad None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:22:59.918674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26541f32-f8d6-4b43-a7e3-ceb97b100fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:22:59.992848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-26541f32-f8d6-4b43-a7e3-ceb97b100fad None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:22:59.994345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-26541f32-f8d6-4b43-a7e3-ceb97b100fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:00.002046 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:00.097395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 686/1378] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:00.383521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735e5b7-e7ad-439d-9c0c-c01aab7c3f4c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:00.385149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0735e5b7-e7ad-439d-9c0c-c01aab7c3f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:00.538736 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735e5b7-e7ad-439d-9c0c-c01aab7c3f4c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:00.542945 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:00.659291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ebd40-3782-49f0-9ec7-cff860932148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:00.659974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ebd40-3782-49f0-9ec7-cff860932148 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:00.660265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ebd40-3782-49f0-9ec7-cff860932148 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:00.660543 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ebd40-3782-49f0-9ec7-cff860932148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:00.662186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3d8ebd40-3782-49f0-9ec7-cff860932148 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:00.760440 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ebd40-3782-49f0-9ec7-cff860932148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:00.762093 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ebd40-3782-49f0-9ec7-cff860932148 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:00.782773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 693/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:03.048831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47486a21-6fb6-48de-894c-968e74290e2d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:03.049342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47486a21-6fb6-48de-894c-968e74290e2d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:03.049541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47486a21-6fb6-48de-894c-968e74290e2d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:03.051061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 687/1380] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:03.056366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7872f-5e27-4d2b-91d8-ba9a5cc65151 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:03.056778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7872f-5e27-4d2b-91d8-ba9a5cc65151 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:03.056963 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7872f-5e27-4d2b-91d8-ba9a5cc65151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:03.068502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:03.132007 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e4a7872f-5e27-4d2b-91d8-ba9a5cc65151 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:03.134596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e4a7872f-5e27-4d2b-91d8-ba9a5cc65151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:03.284211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 694/1381] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:03.631130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47486a21-6fb6-48de-894c-968e74290e2d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:03.633144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-47486a21-6fb6-48de-894c-968e74290e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:03.785102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:03.796182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47486a21-6fb6-48de-894c-968e74290e2d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:03.911373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2bb56-1618-4290-98c3-13184248c653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:03.911915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2bb56-1618-4290-98c3-13184248c653 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:03.912197 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2bb56-1618-4290-98c3-13184248c653 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:03.912474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2bb56-1618-4290-98c3-13184248c653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:03.914132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-08f2bb56-1618-4290-98c3-13184248c653 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:04.009524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2bb56-1618-4290-98c3-13184248c653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:04.011539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2bb56-1618-4290-98c3-13184248c653 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:04.024448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:04.035759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 688/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:06.338490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419eed1-62c9-41f4-9989-bceef72e664c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:06.339156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419eed1-62c9-41f4-9989-bceef72e664c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:06.339156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419eed1-62c9-41f4-9989-bceef72e664c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:06.340387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 695/1383] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:06.346559 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda19cc9-a72f-4fd5-9e3e-a888c088b54e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:06.346985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda19cc9-a72f-4fd5-9e3e-a888c088b54e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:06.347295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda19cc9-a72f-4fd5-9e3e-a888c088b54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:06.419258 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-eda19cc9-a72f-4fd5-9e3e-a888c088b54e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:06.420627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eda19cc9-a72f-4fd5-9e3e-a888c088b54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:06.524656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 689/1384] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:06.815798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419eed1-62c9-41f4-9989-bceef72e664c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:06.817483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7419eed1-62c9-41f4-9989-bceef72e664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:06.915764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:06.987139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419eed1-62c9-41f4-9989-bceef72e664c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:07.104933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374219eb-422d-4d32-9e3c-c6c7de33c288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:07.105575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374219eb-422d-4d32-9e3c-c6c7de33c288 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:07.105850 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374219eb-422d-4d32-9e3c-c6c7de33c288 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:07.106122 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374219eb-422d-4d32-9e3c-c6c7de33c288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:07.108275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-374219eb-422d-4d32-9e3c-c6c7de33c288 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:07.165896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:07.212133 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374219eb-422d-4d32-9e3c-c6c7de33c288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:07.214354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374219eb-422d-4d32-9e3c-c6c7de33c288 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:07.240463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 696/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:09.382315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf8c11-342e-4017-b1eb-55f267515c94 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:09.382844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf8c11-342e-4017-b1eb-55f267515c94 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:09.382844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf8c11-342e-4017-b1eb-55f267515c94 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:09.384218 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 690/1386] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:23:09.389648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845bf7c-7c0c-4b93-ba36-3995bfd3705c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:09.390033 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845bf7c-7c0c-4b93-ba36-3995bfd3705c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:09.390200 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845bf7c-7c0c-4b93-ba36-3995bfd3705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:09.460011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4845bf7c-7c0c-4b93-ba36-3995bfd3705c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:09.461125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4845bf7c-7c0c-4b93-ba36-3995bfd3705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:09.558078 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 697/1387] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:09.846300 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf8c11-342e-4017-b1eb-55f267515c94 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:09.847810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5eaf8c11-342e-4017-b1eb-55f267515c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:09.924792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:09.996172 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf8c11-342e-4017-b1eb-55f267515c94 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:10.108307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36ecff-7078-4878-b9e0-58ce6ffa3607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:10.108839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36ecff-7078-4878-b9e0-58ce6ffa3607 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:10.109116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36ecff-7078-4878-b9e0-58ce6ffa3607 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:10.109424 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36ecff-7078-4878-b9e0-58ce6ffa3607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:10.111024 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7a36ecff-7078-4878-b9e0-58ce6ffa3607 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:10.152697 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:10.204755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36ecff-7078-4878-b9e0-58ce6ffa3607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:10.206378 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36ecff-7078-4878-b9e0-58ce6ffa3607 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:10.224065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 691/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:10.990132 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdc892-328d-4daf-a3a1-8ce087f1cc91 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:10.990698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdc892-328d-4daf-a3a1-8ce087f1cc91 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:10.990698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdc892-328d-4daf-a3a1-8ce087f1cc91 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:10.992307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 698/1389] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:10.997844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a447963-80f0-4c2e-ae0c-f76c572777d2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:10.998294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a447963-80f0-4c2e-ae0c-f76c572777d2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:10.998387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a447963-80f0-4c2e-ae0c-f76c572777d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:11.083163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5a447963-80f0-4c2e-ae0c-f76c572777d2 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:11.084295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5a447963-80f0-4c2e-ae0c-f76c572777d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:11.187086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 692/1390] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:11.491273 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a807b2-76b2-4ca1-a45d-43f4c6992882 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:11.491808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a807b2-76b2-4ca1-a45d-43f4c6992882 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:11.492080 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a807b2-76b2-4ca1-a45d-43f4c6992882 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:11.493427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 699/1391] 10.222.0.48 () {54 vars in 966 bytes} [Tue Sep 13 03:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:11.499273 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e12147-07df-44dc-84a8-441de51a7583 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:11.499617 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e12147-07df-44dc-84a8-441de51a7583 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:11.499952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e12147-07df-44dc-84a8-441de51a7583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:11.516053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:11.577920 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-70e12147-07df-44dc-84a8-441de51a7583 None None] MFA Rules not processed for user `f746dd2ce4404b679db81794c4d23f26`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:11.579134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-70e12147-07df-44dc-84a8-441de51a7583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:11.655037 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 693/1392] 10.222.0.48 () {58 vars in 1063 bytes} [Tue Sep 13 03:23:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:23:11.662946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a807b2-76b2-4ca1-a45d-43f4c6992882 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:11.664512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b7a807b2-76b2-4ca1-a45d-43f4c6992882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:11.696369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:11.770946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a807b2-76b2-4ca1-a45d-43f4c6992882 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:11.846396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed13f2-9e19-430e-b2dd-2a6d0f755584 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f746dd2ce4404b679db81794c4d23f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:11.847000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed13f2-9e19-430e-b2dd-2a6d0f755584 service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:11.847273 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed13f2-9e19-430e-b2dd-2a6d0f755584 service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:11.847540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed13f2-9e19-430e-b2dd-2a6d0f755584 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:11.849145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e6ed13f2-9e19-430e-b2dd-2a6d0f755584 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:11.929273 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:11.961549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed13f2-9e19-430e-b2dd-2a6d0f755584 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:11.962990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed13f2-9e19-430e-b2dd-2a6d0f755584 service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:11.983338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 700/1393] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:12.549306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a566d-29f5-4bb7-97b7-76d42a0f9f31 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:12.549883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a566d-29f5-4bb7-97b7-76d42a0f9f31 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:12.549883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a566d-29f5-4bb7-97b7-76d42a0f9f31 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:12.551229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 694/1394] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:12.556545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc57220-8825-43b6-a914-cec2d490c24e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:12.556986 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc57220-8825-43b6-a914-cec2d490c24e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:12.557211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc57220-8825-43b6-a914-cec2d490c24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:12.627243 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1bc57220-8825-43b6-a914-cec2d490c24e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:12.628456 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1bc57220-8825-43b6-a914-cec2d490c24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:12.736108 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 701/1395] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:12.902539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f2d19-b250-4c0a-8a98-127fd8603f4a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:12.902821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f2d19-b250-4c0a-8a98-127fd8603f4a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:12.903092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f2d19-b250-4c0a-8a98-127fd8603f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:12.969942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a40f2d19-b250-4c0a-8a98-127fd8603f4a None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:12.971127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a40f2d19-b250-4c0a-8a98-127fd8603f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:13.027572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:13.029420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc57220-8825-43b6-a914-cec2d490c24e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:13.030627 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1bc57220-8825-43b6-a914-cec2d490c24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:13.060266 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 695/1396] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:23:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:13.069908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:13.103636 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba59667-85f9-419d-bbc9-759bd21513b8 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:13.103911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba59667-85f9-419d-bbc9-759bd21513b8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:13.104184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba59667-85f9-419d-bbc9-759bd21513b8 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:13.105552 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 696/1397] 10.222.0.48 () {54 vars in 943 bytes} [Tue Sep 13 03:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:23:13.118625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8211f-264f-4d6d-8fe2-1ea4738e3c2d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:13.119037 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8211f-264f-4d6d-8fe2-1ea4738e3c2d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:13.119325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8211f-264f-4d6d-8fe2-1ea4738e3c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:13.157830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc57220-8825-43b6-a914-cec2d490c24e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:13.202217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cff8211f-264f-4d6d-8fe2-1ea4738e3c2d None None] MFA Rules not processed for user `bd3284a5c047425d8148f178eee4069d`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:13.203439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cff8211f-264f-4d6d-8fe2-1ea4738e3c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:13.276201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfb5b9-cfc5-491a-bc9e-0562af0c160a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:13.276725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfb5b9-cfc5-491a-bc9e-0562af0c160a service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:13.277002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfb5b9-cfc5-491a-bc9e-0562af0c160a service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:13.277277 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfb5b9-cfc5-491a-bc9e-0562af0c160a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:13.279423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-34cfb5b9-cfc5-491a-bc9e-0562af0c160a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:13.311403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 697/1398] 10.222.0.48 () {58 vars in 1040 bytes} [Tue Sep 13 03:23:13 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:13.314449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:13.320789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8211f-264f-4d6d-8fe2-1ea4738e3c2d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:13.330887 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8211f-264f-4d6d-8fe2-1ea4738e3c2d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:13.358352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:13.371360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfb5b9-cfc5-491a-bc9e-0562af0c160a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:13.372999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfb5b9-cfc5-491a-bc9e-0562af0c160a service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:13.392013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 702/1399] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:23:13.437233 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29046129-67bd-4c80-bde5-0aeb91287f5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:13.437864 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29046129-67bd-4c80-bde5-0aeb91287f5e service swift] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:13.438140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29046129-67bd-4c80-bde5-0aeb91287f5e service swift] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:13.438409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29046129-67bd-4c80-bde5-0aeb91287f5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:13.440026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-29046129-67bd-4c80-bde5-0aeb91287f5e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:13.527196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29046129-67bd-4c80-bde5-0aeb91287f5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:13.529289 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29046129-67bd-4c80-bde5-0aeb91287f5e service swift] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:13.540417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 698/1400] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:23:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 03:23:15.713922 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a7c79-5a44-422a-8e84-cdccb2ec63c7 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:15.714510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a7c79-5a44-422a-8e84-cdccb2ec63c7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:15.714510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a7c79-5a44-422a-8e84-cdccb2ec63c7 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:15.716103 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 703/1401] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:15.722221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec3a4f-235a-41c5-a5ae-d66f0b428135 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:15.722651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec3a4f-235a-41c5-a5ae-d66f0b428135 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:15.722836 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec3a4f-235a-41c5-a5ae-d66f0b428135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:15.802707 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-59ec3a4f-235a-41c5-a5ae-d66f0b428135 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:15.803990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-59ec3a4f-235a-41c5-a5ae-d66f0b428135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:15.812071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:15.921300 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 699/1402] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:16.201445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a7c79-5a44-422a-8e84-cdccb2ec63c7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:16.203242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4b3a7c79-5a44-422a-8e84-cdccb2ec63c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:16.364172 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a7c79-5a44-422a-8e84-cdccb2ec63c7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:16.377560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:16.499784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9491d0d-cf58-4fa4-b5bb-b282e0c7701c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:16.500398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9491d0d-cf58-4fa4-b5bb-b282e0c7701c service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:16.500682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9491d0d-cf58-4fa4-b5bb-b282e0c7701c service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:16.500956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9491d0d-cf58-4fa4-b5bb-b282e0c7701c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:16.502601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e9491d0d-cf58-4fa4-b5bb-b282e0c7701c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:16.603105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9491d0d-cf58-4fa4-b5bb-b282e0c7701c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:16.605504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9491d0d-cf58-4fa4-b5bb-b282e0c7701c service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:16.630420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 704/1403] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:19.055018 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede2fd2-6daa-41b6-99d0-f365a5fb0b85 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:19.055587 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede2fd2-6daa-41b6-99d0-f365a5fb0b85 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:19.055587 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede2fd2-6daa-41b6-99d0-f365a5fb0b85 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:19.056894 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 700/1404] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:19.062507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5e789-a4d2-45d4-ba84-8f09198d799b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:19.062944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5e789-a4d2-45d4-ba84-8f09198d799b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:19.063044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5e789-a4d2-45d4-ba84-8f09198d799b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:19.084308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:19.134152 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1aa5e789-a4d2-45d4-ba84-8f09198d799b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:19.135392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1aa5e789-a4d2-45d4-ba84-8f09198d799b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:19.247748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 705/1405] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:19.545908 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede2fd2-6daa-41b6-99d0-f365a5fb0b85 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:19.547459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9ede2fd2-6daa-41b6-99d0-f365a5fb0b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:19.703714 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:19.715499 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede2fd2-6daa-41b6-99d0-f365a5fb0b85 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:19.844048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24d556-f92e-485c-a27b-5153e90ebed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:19.844581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24d556-f92e-485c-a27b-5153e90ebed0 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:19.844853 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24d556-f92e-485c-a27b-5153e90ebed0 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:19.845121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24d556-f92e-485c-a27b-5153e90ebed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:19.846752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fa24d556-f92e-485c-a27b-5153e90ebed0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:19.951055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24d556-f92e-485c-a27b-5153e90ebed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:19.952648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24d556-f92e-485c-a27b-5153e90ebed0 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:19.963481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:19.975236 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 701/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:22.884711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2df81-eaa8-4ffa-86e8-c1351e73fdd1 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:22.884711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2df81-eaa8-4ffa-86e8-c1351e73fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:22.884711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2df81-eaa8-4ffa-86e8-c1351e73fdd1 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:22.886121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 706/1407] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:22.892301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e363a67-6806-40b2-b68c-b17f99323287 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:22.892822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e363a67-6806-40b2-b68c-b17f99323287 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:22.892822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e363a67-6806-40b2-b68c-b17f99323287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:22.966105 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9e363a67-6806-40b2-b68c-b17f99323287 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:22.967340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9e363a67-6806-40b2-b68c-b17f99323287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:23.075143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 702/1408] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:23.367214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2df81-eaa8-4ffa-86e8-c1351e73fdd1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:23.368821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8be2df81-eaa8-4ffa-86e8-c1351e73fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:23.464472 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:23.524237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2df81-eaa8-4ffa-86e8-c1351e73fdd1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:23.648726 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4ec74-4d70-47a4-9115-7d5e8247e26f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:23.649398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4ec74-4d70-47a4-9115-7d5e8247e26f service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:23.649676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4ec74-4d70-47a4-9115-7d5e8247e26f service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:23.649947 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4ec74-4d70-47a4-9115-7d5e8247e26f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:23.651546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-41d4ec74-4d70-47a4-9115-7d5e8247e26f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:23.717666 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:23.753693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4ec74-4d70-47a4-9115-7d5e8247e26f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:23.755462 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4ec74-4d70-47a4-9115-7d5e8247e26f service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:23.777136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 707/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:33.073582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=67 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:33.774779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=20 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:37.476375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c873a9-1350-49e5-99af-d5c43cd590e7 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:37.476916 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c873a9-1350-49e5-99af-d5c43cd590e7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:37.476916 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c873a9-1350-49e5-99af-d5c43cd590e7 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:37.478302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 703/1410] 10.222.0.48 () {54 vars in 918 bytes} [Tue Sep 13 03:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:37.483797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf566f-38fd-4d9b-9259-65535c7265d0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:37.484242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf566f-38fd-4d9b-9259-65535c7265d0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:37.484350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf566f-38fd-4d9b-9259-65535c7265d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:37.560263 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1dcf566f-38fd-4d9b-9259-65535c7265d0 None None] MFA Rules not processed for user `e261a9485c3b4d2aa657a931e0388389`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:37.561485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1dcf566f-38fd-4d9b-9259-65535c7265d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:37.667821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 708/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Sep 13 03:23:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:37.682703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ba07b-7a45-4ccc-b595-8a50f242e5f7 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:37.682985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ba07b-7a45-4ccc-b595-8a50f242e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:37.683254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ba07b-7a45-4ccc-b595-8a50f242e5f7 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:37.684604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 704/1412] 10.222.0.48 () {54 vars in 918 bytes} [Tue Sep 13 03:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:37.689283 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a19d91-b55a-43ee-8321-87850defccfa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:37.689566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a19d91-b55a-43ee-8321-87850defccfa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:37.689842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a19d91-b55a-43ee-8321-87850defccfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:37.762066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:37.764993 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d1a19d91-b55a-43ee-8321-87850defccfa None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:37.766222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d1a19d91-b55a-43ee-8321-87850defccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:37.880778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 709/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Sep 13 03:23:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:23:40.435796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ef29b-679e-4b05-aeb5-f62daec8410a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:40.436321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ef29b-679e-4b05-aeb5-f62daec8410a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:40.436321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ef29b-679e-4b05-aeb5-f62daec8410a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:40.437620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:23:40.442823 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825732-2d14-44f4-956e-c1c135594587 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:40.443270 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825732-2d14-44f4-956e-c1c135594587 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:40.443440 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825732-2d14-44f4-956e-c1c135594587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:40.508672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-75825732-2d14-44f4-956e-c1c135594587 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:40.509882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-75825732-2d14-44f4-956e-c1c135594587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:40.565358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:40.607843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:40.895131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ef29b-679e-4b05-aeb5-f62daec8410a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:40.896962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-850ef29b-679e-4b05-aeb5-f62daec8410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:41.040716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ef29b-679e-4b05-aeb5-f62daec8410a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:41.110616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:41.151021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed0c97-8e5d-44ed-ab5d-6b73f69f85a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:41.151567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed0c97-8e5d-44ed-ab5d-6b73f69f85a2 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:41.151847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed0c97-8e5d-44ed-ab5d-6b73f69f85a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:41.152122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed0c97-8e5d-44ed-ab5d-6b73f69f85a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:41.154352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f0ed0c97-8e5d-44ed-ab5d-6b73f69f85a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:41.241584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed0c97-8e5d-44ed-ab5d-6b73f69f85a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:41.243163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed0c97-8e5d-44ed-ab5d-6b73f69f85a2 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:41.260409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 706/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:42.384957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bb268-c2e7-4271-ac16-e698032960d2 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:42.385537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bb268-c2e7-4271-ac16-e698032960d2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:42.385537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bb268-c2e7-4271-ac16-e698032960d2 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:42.386797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 03:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:42.392848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa3cd8-7bde-47e9-b2cb-be622fccc233 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:42.393239 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa3cd8-7bde-47e9-b2cb-be622fccc233 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:42.393537 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa3cd8-7bde-47e9-b2cb-be622fccc233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:42.469839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-23fa3cd8-7bde-47e9-b2cb-be622fccc233 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:42.471094 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-23fa3cd8-7bde-47e9-b2cb-be622fccc233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:42.498677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:42.567294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 03:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:42.715802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bb268-c2e7-4271-ac16-e698032960d2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:42.717368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-625bb268-c2e7-4271-ac16-e698032960d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:42.860665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bb268-c2e7-4271-ac16-e698032960d2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:42.900818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:42.971056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e055a3-c10c-4ac7-8011-7fc30dedb5e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:42.971575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e055a3-c10c-4ac7-8011-7fc30dedb5e0 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:42.971846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e055a3-c10c-4ac7-8011-7fc30dedb5e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:42.972111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e055a3-c10c-4ac7-8011-7fc30dedb5e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:42.973704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b1e055a3-c10c-4ac7-8011-7fc30dedb5e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:43.061001 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e055a3-c10c-4ac7-8011-7fc30dedb5e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:43.070600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e055a3-c10c-4ac7-8011-7fc30dedb5e0 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:43.080429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 712/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:44.205294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27d37c-41a2-4ddd-93e5-9653ec03034f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:44.205764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27d37c-41a2-4ddd-93e5-9653ec03034f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:44.205864 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27d37c-41a2-4ddd-93e5-9653ec03034f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:44.207169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 03:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:44.213406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b45eb-941f-4bd8-8dbe-6e59b27a9082 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:44.213818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b45eb-941f-4bd8-8dbe-6e59b27a9082 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:44.213964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b45eb-941f-4bd8-8dbe-6e59b27a9082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:44.269807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:44.291505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-502b45eb-941f-4bd8-8dbe-6e59b27a9082 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:44.292714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-502b45eb-941f-4bd8-8dbe-6e59b27a9082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:44.389591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 03:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:44.540795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27d37c-41a2-4ddd-93e5-9653ec03034f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:44.542324 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bf27d37c-41a2-4ddd-93e5-9653ec03034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:44.685720 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27d37c-41a2-4ddd-93e5-9653ec03034f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:44.697649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:44.799741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ace6a-bec4-4f32-8346-8bcba7ea4610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:44.800269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ace6a-bec4-4f32-8346-8bcba7ea4610 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:44.800544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ace6a-bec4-4f32-8346-8bcba7ea4610 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:44.800813 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ace6a-bec4-4f32-8346-8bcba7ea4610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:44.802439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-941ace6a-bec4-4f32-8346-8bcba7ea4610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:44.889754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ace6a-bec4-4f32-8346-8bcba7ea4610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:44.891329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ace6a-bec4-4f32-8346-8bcba7ea4610 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:44.909143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 709/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:46.006458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7725893-c748-4dfd-ad81-759ccfee8070 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:46.006848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7725893-c748-4dfd-ad81-759ccfee8070 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:46.007001 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7725893-c748-4dfd-ad81-759ccfee8070 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:46.008369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 03:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:46.014622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51469714-8f59-4e21-85a8-0800faab4f9c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:46.015025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51469714-8f59-4e21-85a8-0800faab4f9c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:46.015158 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51469714-8f59-4e21-85a8-0800faab4f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:46.034843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:46.090208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-51469714-8f59-4e21-85a8-0800faab4f9c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:46.091411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-51469714-8f59-4e21-85a8-0800faab4f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:46.186268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 03:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:46.365692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7725893-c748-4dfd-ad81-759ccfee8070 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:46.365692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f7725893-c748-4dfd-ad81-759ccfee8070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:46.451909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:46.486771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7725893-c748-4dfd-ad81-759ccfee8070 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:46.598564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c78179-d5fb-41b2-bb2c-8156e28bb00e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:46.599174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c78179-d5fb-41b2-bb2c-8156e28bb00e service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:46.599457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c78179-d5fb-41b2-bb2c-8156e28bb00e service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:46.599838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c78179-d5fb-41b2-bb2c-8156e28bb00e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:46.601470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-92c78179-d5fb-41b2-bb2c-8156e28bb00e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:46.679417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:46.692934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c78179-d5fb-41b2-bb2c-8156e28bb00e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:46.694563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c78179-d5fb-41b2-bb2c-8156e28bb00e service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:46.714400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 715/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:47.829576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd251c7-8a87-458b-91a3-8d37e4de4c0d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:47.830220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd251c7-8a87-458b-91a3-8d37e4de4c0d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:47.830220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd251c7-8a87-458b-91a3-8d37e4de4c0d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:47.831449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 03:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:47.837662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0e75e-24c8-47a1-a32e-8d874d105a9e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:47.838138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0e75e-24c8-47a1-a32e-8d874d105a9e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:47.838749 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0e75e-24c8-47a1-a32e-8d874d105a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:47.914159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c4a0e75e-24c8-47a1-a32e-8d874d105a9e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:47.915362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c4a0e75e-24c8-47a1-a32e-8d874d105a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:48.129416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 03:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:48.283143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd251c7-8a87-458b-91a3-8d37e4de4c0d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:48.284659 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fdd251c7-8a87-458b-91a3-8d37e4de4c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:48.368707 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:48.430358 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd251c7-8a87-458b-91a3-8d37e4de4c0d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:48.541740 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931790d-57b2-4d1a-bd3b-74bdab2310cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:48.542357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931790d-57b2-4d1a-bd3b-74bdab2310cd service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:48.542628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931790d-57b2-4d1a-bd3b-74bdab2310cd service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:48.542914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931790d-57b2-4d1a-bd3b-74bdab2310cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:48.544492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e931790d-57b2-4d1a-bd3b-74bdab2310cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:48.591929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:48.631885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931790d-57b2-4d1a-bd3b-74bdab2310cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:48.633759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931790d-57b2-4d1a-bd3b-74bdab2310cd service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:48.652125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 712/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:49.795155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273b882-4dfb-4838-a546-e00a1e9804c9 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:49.795696 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273b882-4dfb-4838-a546-e00a1e9804c9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:49.795696 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273b882-4dfb-4838-a546-e00a1e9804c9 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:49.796942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 03:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:49.803029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5d706-6a32-4f59-9d9f-2bc2a30d07f4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:49.803438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5d706-6a32-4f59-9d9f-2bc2a30d07f4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:49.803576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5d706-6a32-4f59-9d9f-2bc2a30d07f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:49.878575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f3f5d706-6a32-4f59-9d9f-2bc2a30d07f4 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:49.879763 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f3f5d706-6a32-4f59-9d9f-2bc2a30d07f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:49.973366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 03:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:50.124382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273b882-4dfb-4838-a546-e00a1e9804c9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:50.125878 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f273b882-4dfb-4838-a546-e00a1e9804c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:50.173936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:50.268132 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273b882-4dfb-4838-a546-e00a1e9804c9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:50.378749 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c2b64-a713-4bec-8536-1addf880d05e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:50.379278 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c2b64-a713-4bec-8536-1addf880d05e service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:50.379558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c2b64-a713-4bec-8536-1addf880d05e service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:50.379830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c2b64-a713-4bec-8536-1addf880d05e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:50.381458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-109c2b64-a713-4bec-8536-1addf880d05e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:50.388466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:50.471360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c2b64-a713-4bec-8536-1addf880d05e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:50.472938 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c2b64-a713-4bec-8536-1addf880d05e service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:50.491509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 718/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:51.592686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf532873-b4e2-4263-9b8f-2a2dff679ded None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:51.593247 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf532873-b4e2-4263-9b8f-2a2dff679ded None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:51.593247 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf532873-b4e2-4263-9b8f-2a2dff679ded None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:51.594606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 03:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:51.600968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f241f-4638-455d-8e2d-6eee8d01a7f9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:51.601503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f241f-4638-455d-8e2d-6eee8d01a7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:51.601598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f241f-4638-455d-8e2d-6eee8d01a7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:51.676684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cd8f241f-4638-455d-8e2d-6eee8d01a7f9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:51.677909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cd8f241f-4638-455d-8e2d-6eee8d01a7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:51.750771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:51.778489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 03:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:51.929195 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf532873-b4e2-4263-9b8f-2a2dff679ded None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:51.930695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bf532873-b4e2-4263-9b8f-2a2dff679ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:51.947933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:52.075256 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf532873-b4e2-4263-9b8f-2a2dff679ded None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:52.160695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:52.187177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa9f7a-ece8-4e89-9a73-21c8846c53cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:52.187739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa9f7a-ece8-4e89-9a73-21c8846c53cf service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:52.188010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa9f7a-ece8-4e89-9a73-21c8846c53cf service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:52.188277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa9f7a-ece8-4e89-9a73-21c8846c53cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:52.189889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-edfa9f7a-ece8-4e89-9a73-21c8846c53cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:52.276256 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa9f7a-ece8-4e89-9a73-21c8846c53cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:52.278432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa9f7a-ece8-4e89-9a73-21c8846c53cf service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:52.295668 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 715/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:53.394842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6e2e-a81a-4e4f-85de-212f59f89bd4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:53.395428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6e2e-a81a-4e4f-85de-212f59f89bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:53.395428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6e2e-a81a-4e4f-85de-212f59f89bd4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:53.396782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 03:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:53.403506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce33ce-005a-4d66-85b4-a6ca3b1bb82d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:53.403956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce33ce-005a-4d66-85b4-a6ca3b1bb82d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:53.404066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce33ce-005a-4d66-85b4-a6ca3b1bb82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:53.477679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b0ce33ce-005a-4d66-85b4-a6ca3b1bb82d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:53.478905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b0ce33ce-005a-4d66-85b4-a6ca3b1bb82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:53.520510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:53.575234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 03:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:53.725897 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea6e2e-a81a-4e4f-85de-212f59f89bd4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:53.727402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a4ea6e2e-a81a-4e4f-85de-212f59f89bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:53.872384 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea6e2e-a81a-4e4f-85de-212f59f89bd4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:53.926100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:53.983341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7862e9-3784-463c-b3ed-11e64b78e68f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:53.983933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7862e9-3784-463c-b3ed-11e64b78e68f service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:53.984205 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7862e9-3784-463c-b3ed-11e64b78e68f service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:53.984471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7862e9-3784-463c-b3ed-11e64b78e68f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:53.986070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5b7862e9-3784-463c-b3ed-11e64b78e68f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:54.072913 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7862e9-3784-463c-b3ed-11e64b78e68f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:54.075038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7862e9-3784-463c-b3ed-11e64b78e68f service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:54.092981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 721/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:55.201582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70d90c-5145-45d0-84b9-694f863ba62a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:55.202099 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70d90c-5145-45d0-84b9-694f863ba62a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:55.202211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70d90c-5145-45d0-84b9-694f863ba62a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:55.203490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 03:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:55.209582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfd940-c36c-44f4-9cea-441f0c415a00 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:55.210037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfd940-c36c-44f4-9cea-441f0c415a00 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:55.210169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfd940-c36c-44f4-9cea-441f0c415a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:55.285144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3bdfd940-c36c-44f4-9cea-441f0c415a00 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:55.286367 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3bdfd940-c36c-44f4-9cea-441f0c415a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:55.288372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:55.381583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 03:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:55.529516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70d90c-5145-45d0-84b9-694f863ba62a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:55.531060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1b70d90c-5145-45d0-84b9-694f863ba62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:55.676074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70d90c-5145-45d0-84b9-694f863ba62a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:55.703385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:55.796928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f98f43-f0ab-4e59-953e-a8b0d3d59a39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:55.797536 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f98f43-f0ab-4e59-953e-a8b0d3d59a39 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:55.797836 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f98f43-f0ab-4e59-953e-a8b0d3d59a39 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:55.798108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f98f43-f0ab-4e59-953e-a8b0d3d59a39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:55.799735 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-86f98f43-f0ab-4e59-953e-a8b0d3d59a39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:55.886954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f98f43-f0ab-4e59-953e-a8b0d3d59a39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:55.888556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f98f43-f0ab-4e59-953e-a8b0d3d59a39 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:55.906809 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 718/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:23:57.972805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeada78-32df-49a6-9bd9-367a2c3c9cb3 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:57.973392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeada78-32df-49a6-9bd9-367a2c3c9cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:57.973392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeada78-32df-49a6-9bd9-367a2c3c9cb3 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:57.974769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:23:57.980788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7ab89-49d6-47b9-a23b-066e7af68ca1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:57.981217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7ab89-49d6-47b9-a23b-066e7af68ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:57.981345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7ab89-49d6-47b9-a23b-066e7af68ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:58.022037 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:58.048213 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d4d7ab89-49d6-47b9-a23b-066e7af68ca1 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:23:58.050346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d4d7ab89-49d6-47b9-a23b-066e7af68ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:58.146374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:23:58.434174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeada78-32df-49a6-9bd9-367a2c3c9cb3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:23:58.435698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ceeada78-32df-49a6-9bd9-367a2c3c9cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:58.537691 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeada78-32df-49a6-9bd9-367a2c3c9cb3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:23:58.568900 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:23:58.610799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d6efd-75f2-4c36-88dd-401ba2f60d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:23:58.611323 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d6efd-75f2-4c36-88dd-401ba2f60d44 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:23:58.611597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d6efd-75f2-4c36-88dd-401ba2f60d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:23:58.611863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d6efd-75f2-4c36-88dd-401ba2f60d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:23:58.613483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-247d6efd-75f2-4c36-88dd-401ba2f60d44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:23:58.723110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d6efd-75f2-4c36-88dd-401ba2f60d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:23:58.724546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d6efd-75f2-4c36-88dd-401ba2f60d44 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:23:58.742413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 724/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:24:00.999565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d0cd-f2de-425a-8c87-18c9eb61c397 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:01.000134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d0cd-f2de-425a-8c87-18c9eb61c397 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:01.000134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d0cd-f2de-425a-8c87-18c9eb61c397 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:01.001515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:01.006596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92549cf7-395e-4047-ba84-eaab9c4744ef None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:01.006999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92549cf7-395e-4047-ba84-eaab9c4744ef None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:01.007140 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92549cf7-395e-4047-ba84-eaab9c4744ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:01.072383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-92549cf7-395e-4047-ba84-eaab9c4744ef None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:01.074150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-92549cf7-395e-4047-ba84-eaab9c4744ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:01.086525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:01.170432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:01.450961 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96d0cd-f2de-425a-8c87-18c9eb61c397 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:01.452517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3f96d0cd-f2de-425a-8c87-18c9eb61c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:01.553913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96d0cd-f2de-425a-8c87-18c9eb61c397 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:01.566617 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:01.629741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac816f8-1ff6-4f5c-9793-fb2dd65cfe7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:01.630337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac816f8-1ff6-4f5c-9793-fb2dd65cfe7c service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:01.630612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac816f8-1ff6-4f5c-9793-fb2dd65cfe7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:01.630880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac816f8-1ff6-4f5c-9793-fb2dd65cfe7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:01.632462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eac816f8-1ff6-4f5c-9793-fb2dd65cfe7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:01.738155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac816f8-1ff6-4f5c-9793-fb2dd65cfe7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:01.739839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac816f8-1ff6-4f5c-9793-fb2dd65cfe7c service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:01.757791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 721/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:24:04.225287 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dd16e-7c4b-40a6-9fed-e984331a7032 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:04.225789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dd16e-7c4b-40a6-9fed-e984331a7032 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:04.225903 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dd16e-7c4b-40a6-9fed-e984331a7032 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:04.227162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:04.237084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9b48-c14c-4c85-8d91-8f4c281430a3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:04.237549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9b48-c14c-4c85-8d91-8f4c281430a3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:04.237657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9b48-c14c-4c85-8d91-8f4c281430a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:04.284739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:04.302143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e31e9b48-c14c-4c85-8d91-8f4c281430a3 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:04.304857 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e31e9b48-c14c-4c85-8d91-8f4c281430a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:04.398473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:04.684739 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dd16e-7c4b-40a6-9fed-e984331a7032 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:04.686299 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-260dd16e-7c4b-40a6-9fed-e984331a7032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:04.789229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dd16e-7c4b-40a6-9fed-e984331a7032 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:04.829249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:04.863434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca7578-9e1c-4bb0-aa87-03680b286d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:04.864024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca7578-9e1c-4bb0-aa87-03680b286d25 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:04.864562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca7578-9e1c-4bb0-aa87-03680b286d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:04.864830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca7578-9e1c-4bb0-aa87-03680b286d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:04.866437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6eca7578-9e1c-4bb0-aa87-03680b286d25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:04.972079 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca7578-9e1c-4bb0-aa87-03680b286d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:04.973543 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca7578-9e1c-4bb0-aa87-03680b286d25 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:04.992429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 727/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:24:07.256738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319795b-2eef-448c-84db-287f4e30ce35 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:07.257325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319795b-2eef-448c-84db-287f4e30ce35 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:07.257325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319795b-2eef-448c-84db-287f4e30ce35 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:07.258702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:07.263867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121d404-131d-4753-bddf-d0d24c53048d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:07.264265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121d404-131d-4753-bddf-d0d24c53048d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:07.264518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121d404-131d-4753-bddf-d0d24c53048d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:07.330468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f121d404-131d-4753-bddf-d0d24c53048d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:07.331660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f121d404-131d-4753-bddf-d0d24c53048d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:07.351741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:07.429348 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:07.718393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319795b-2eef-448c-84db-287f4e30ce35 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:07.719969 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6319795b-2eef-448c-84db-287f4e30ce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:07.822343 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319795b-2eef-448c-84db-287f4e30ce35 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:07.843058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:07.895600 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3d059-d716-4471-a837-0248f3d9d272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:07.896196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3d059-d716-4471-a837-0248f3d9d272 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:07.896471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3d059-d716-4471-a837-0248f3d9d272 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:07.896738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3d059-d716-4471-a837-0248f3d9d272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:07.898356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-92e3d059-d716-4471-a837-0248f3d9d272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:08.006097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3d059-d716-4471-a837-0248f3d9d272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:08.007457 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3d059-d716-4471-a837-0248f3d9d272 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:08.025596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 724/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:24:10.310944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7de27c-47e6-4cf6-9647-58666e34a3f4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:10.311453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7de27c-47e6-4cf6-9647-58666e34a3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:10.311453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7de27c-47e6-4cf6-9647-58666e34a3f4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:10.312754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:10.318143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277de52-d3e1-416e-a6c6-e8746fe458eb None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:10.318529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277de52-d3e1-416e-a6c6-e8746fe458eb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:10.318684 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277de52-d3e1-416e-a6c6-e8746fe458eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:10.381211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:10.383835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a277de52-d3e1-416e-a6c6-e8746fe458eb None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:10.385061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a277de52-d3e1-416e-a6c6-e8746fe458eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:10.479950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:10.762745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7de27c-47e6-4cf6-9647-58666e34a3f4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:10.764259 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0a7de27c-47e6-4cf6-9647-58666e34a3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:10.865179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7de27c-47e6-4cf6-9647-58666e34a3f4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:10.913389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:10.936711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ccbff-4e7d-4925-a3cb-9b1c195394c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:10.937328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ccbff-4e7d-4925-a3cb-9b1c195394c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:10.937607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ccbff-4e7d-4925-a3cb-9b1c195394c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:10.937875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ccbff-4e7d-4925-a3cb-9b1c195394c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:10.939496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0f5ccbff-4e7d-4925-a3cb-9b1c195394c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:11.044930 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ccbff-4e7d-4925-a3cb-9b1c195394c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:11.046313 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ccbff-4e7d-4925-a3cb-9b1c195394c3 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:11.064249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 730/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:24:13.274794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c97bf5-4871-4874-8684-708a001225fb None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:13.275312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c97bf5-4871-4874-8684-708a001225fb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:13.275425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c97bf5-4871-4874-8684-708a001225fb None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:13.276732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:13.282270 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d77243-86e5-40f1-a63f-14b070da9096 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:13.282668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d77243-86e5-40f1-a63f-14b070da9096 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:13.282816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d77243-86e5-40f1-a63f-14b070da9096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:13.348426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-29d77243-86e5-40f1-a63f-14b070da9096 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:13.349667 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-29d77243-86e5-40f1-a63f-14b070da9096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:13.379506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:13.447738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:13.729414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c97bf5-4871-4874-8684-708a001225fb None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:13.730993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-56c97bf5-4871-4874-8684-708a001225fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:13.832094 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c97bf5-4871-4874-8684-708a001225fb None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:13.860609 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:13.904322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51d2b2-151d-4d93-818a-79b020ebfdb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:13.904912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51d2b2-151d-4d93-818a-79b020ebfdb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:13.905185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51d2b2-151d-4d93-818a-79b020ebfdb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:13.905478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51d2b2-151d-4d93-818a-79b020ebfdb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:13.907053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4a51d2b2-151d-4d93-818a-79b020ebfdb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:14.013128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51d2b2-151d-4d93-818a-79b020ebfdb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:14.014553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51d2b2-151d-4d93-818a-79b020ebfdb3 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:14.033653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 727/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:24:16.204868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f292e78-0ad9-40c8-9abd-dc3d02e3773d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:16.205400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f292e78-0ad9-40c8-9abd-dc3d02e3773d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:16.205510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f292e78-0ad9-40c8-9abd-dc3d02e3773d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:16.206781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:16.212048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e964e-18da-4ecd-8d8b-afb8a2363296 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:16.212468 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e964e-18da-4ecd-8d8b-afb8a2363296 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:16.212615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e964e-18da-4ecd-8d8b-afb8a2363296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:16.278455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-094e964e-18da-4ecd-8d8b-afb8a2363296 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:16.279580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-094e964e-18da-4ecd-8d8b-afb8a2363296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:16.287739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:16.375083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:16.661538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f292e78-0ad9-40c8-9abd-dc3d02e3773d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:16.663117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2f292e78-0ad9-40c8-9abd-dc3d02e3773d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:16.769608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f292e78-0ad9-40c8-9abd-dc3d02e3773d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:16.826217 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:16.843544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8158002-e8b4-4d54-b1fd-b8f75687501f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:16.844135 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8158002-e8b4-4d54-b1fd-b8f75687501f service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:16.844402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8158002-e8b4-4d54-b1fd-b8f75687501f service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:16.844678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8158002-e8b4-4d54-b1fd-b8f75687501f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:16.846319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d8158002-e8b4-4d54-b1fd-b8f75687501f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:16.956445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8158002-e8b4-4d54-b1fd-b8f75687501f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:16.957864 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8158002-e8b4-4d54-b1fd-b8f75687501f service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:16.982064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 733/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:24:19.163115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e183a-8693-49e0-965d-eca623b7c358 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:19.163622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e183a-8693-49e0-965d-eca623b7c358 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:19.163731 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e183a-8693-49e0-965d-eca623b7c358 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:19.164985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:19.170432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded982-f0e2-4f78-b767-c207b3c47e13 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:19.170833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded982-f0e2-4f78-b767-c207b3c47e13 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:19.170988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ded982-f0e2-4f78-b767-c207b3c47e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:19.237114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-29ded982-f0e2-4f78-b767-c207b3c47e13 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:19.238343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-29ded982-f0e2-4f78-b767-c207b3c47e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:19.276115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:19.333922 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:19.615018 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e183a-8693-49e0-965d-eca623b7c358 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:19.616543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2a1e183a-8693-49e0-965d-eca623b7c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:19.718030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e183a-8693-49e0-965d-eca623b7c358 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:19.756198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:19.792131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c590a9-b323-4692-8fe5-0784e7140c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:19.792731 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c590a9-b323-4692-8fe5-0784e7140c95 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:19.793011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c590a9-b323-4692-8fe5-0784e7140c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:19.793368 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c590a9-b323-4692-8fe5-0784e7140c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:19.794977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-31c590a9-b323-4692-8fe5-0784e7140c95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:19.902988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c590a9-b323-4692-8fe5-0784e7140c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:19.904350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c590a9-b323-4692-8fe5-0784e7140c95 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:19.924367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 730/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:24:22.070101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d33ca-93c7-43e9-9956-6670974761ee None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:22.070605 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d33ca-93c7-43e9-9956-6670974761ee None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:22.070704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d33ca-93c7-43e9-9956-6670974761ee None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:22.072561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:22.077805 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8c4b4-1cbd-4953-9929-c443a26815d2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:22.078243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8c4b4-1cbd-4953-9929-c443a26815d2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:22.078380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8c4b4-1cbd-4953-9929-c443a26815d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:22.144094 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1dd8c4b4-1cbd-4953-9929-c443a26815d2 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:22.145371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1dd8c4b4-1cbd-4953-9929-c443a26815d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:22.163452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:22.241763 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:22.521961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d33ca-93c7-43e9-9956-6670974761ee None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:22.523546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-424d33ca-93c7-43e9-9956-6670974761ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:22.629377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d33ca-93c7-43e9-9956-6670974761ee None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:22.694919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:22.701355 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974ab87-4498-48c4-962b-85743765ccdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:22.712151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974ab87-4498-48c4-962b-85743765ccdc service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:22.712151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974ab87-4498-48c4-962b-85743765ccdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:22.712151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974ab87-4498-48c4-962b-85743765ccdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:22.712151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2974ab87-4498-48c4-962b-85743765ccdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:22.814307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974ab87-4498-48c4-962b-85743765ccdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:22.815656 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974ab87-4498-48c4-962b-85743765ccdc service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:22.833461 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 736/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:24:24.977954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77b414-55a9-4046-8f5f-b6512fcbbb98 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:24.978525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77b414-55a9-4046-8f5f-b6512fcbbb98 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:24.978525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77b414-55a9-4046-8f5f-b6512fcbbb98 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:24.979860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:24.985042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948adb1a-9a6c-487e-a2ee-4762554471d0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:24.985475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948adb1a-9a6c-487e-a2ee-4762554471d0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:24.985630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948adb1a-9a6c-487e-a2ee-4762554471d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:25.051552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-948adb1a-9a6c-487e-a2ee-4762554471d0 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:25.052746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-948adb1a-9a6c-487e-a2ee-4762554471d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:25.100585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:25.149601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:25.428228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77b414-55a9-4046-8f5f-b6512fcbbb98 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:25.429829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9c77b414-55a9-4046-8f5f-b6512fcbbb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:25.530278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77b414-55a9-4046-8f5f-b6512fcbbb98 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:25.577221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:25.602563 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46da926-44d6-445f-9e26-f4db1ee5edd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:25.603766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46da926-44d6-445f-9e26-f4db1ee5edd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:25.604321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46da926-44d6-445f-9e26-f4db1ee5edd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:25.604592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46da926-44d6-445f-9e26-f4db1ee5edd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:25.606209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b46da926-44d6-445f-9e26-f4db1ee5edd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:25.712143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46da926-44d6-445f-9e26-f4db1ee5edd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:25.714146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46da926-44d6-445f-9e26-f4db1ee5edd3 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:25.732772 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 733/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:24:35.148009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=22 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:35.730520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=66 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:45.523948 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796e3d-0d2e-42fb-8da2-cda49b8dfebc None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:45.525042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796e3d-0d2e-42fb-8da2-cda49b8dfebc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:45.525243 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796e3d-0d2e-42fb-8da2-cda49b8dfebc None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:45.526663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 738/1471] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:45.532015 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd642588-77d4-4830-ace3-33a099280bea None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:45.532434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd642588-77d4-4830-ace3-33a099280bea None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:45.532947 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd642588-77d4-4830-ace3-33a099280bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:45.599412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fd642588-77d4-4830-ace3-33a099280bea None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:45.600607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fd642588-77d4-4830-ace3-33a099280bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:45.693658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 734/1472] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:45.988239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d30bc-48ce-4e4f-8d44-c601b221885a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:45.988553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d30bc-48ce-4e4f-8d44-c601b221885a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:45.988828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d30bc-48ce-4e4f-8d44-c601b221885a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:45.990203 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 739/1473] 10.222.0.48 () {54 vars in 966 bytes} [Tue Sep 13 03:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:45.995922 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72121797-1853-4b5e-9230-b9224acf2c6e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:45.996203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72121797-1853-4b5e-9230-b9224acf2c6e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:45.996476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72121797-1853-4b5e-9230-b9224acf2c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:46.072079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-72121797-1853-4b5e-9230-b9224acf2c6e None None] MFA Rules not processed for user `f746dd2ce4404b679db81794c4d23f26`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:46.073288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-72121797-1853-4b5e-9230-b9224acf2c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:46.093279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:46.148419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 735/1474] 10.222.0.48 () {58 vars in 1063 bytes} [Tue Sep 13 03:24:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:46.157852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d30bc-48ce-4e4f-8d44-c601b221885a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:46.159370 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bd1d30bc-48ce-4e4f-8d44-c601b221885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:46.262996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d30bc-48ce-4e4f-8d44-c601b221885a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:46.335099 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a696ef4-a077-45bb-8e4a-7d4e6e71873d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f746dd2ce4404b679db81794c4d23f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:46.335699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696ef4-a077-45bb-8e4a-7d4e6e71873d service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:46.335977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696ef4-a077-45bb-8e4a-7d4e6e71873d service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:46.336246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696ef4-a077-45bb-8e4a-7d4e6e71873d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:46.337851 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2a696ef4-a077-45bb-8e4a-7d4e6e71873d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:46.391314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:46.446102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a696ef4-a077-45bb-8e4a-7d4e6e71873d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:46.447534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a696ef4-a077-45bb-8e4a-7d4e6e71873d service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:46.465842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 740/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:24:48.708019 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540de0a8-f683-4298-99b4-b098c5df4c33 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:48.708586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540de0a8-f683-4298-99b4-b098c5df4c33 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:48.708586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540de0a8-f683-4298-99b4-b098c5df4c33 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:48.709849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 736/1476] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:48.715895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84d7fe-aa69-4200-a57e-adfa662ee60a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:48.716386 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84d7fe-aa69-4200-a57e-adfa662ee60a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:48.716495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84d7fe-aa69-4200-a57e-adfa662ee60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:48.783753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2b84d7fe-aa69-4200-a57e-adfa662ee60a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:48.784962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2b84d7fe-aa69-4200-a57e-adfa662ee60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:48.883474 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 741/1477] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:49.165084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540de0a8-f683-4298-99b4-b098c5df4c33 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:49.166769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-540de0a8-f683-4298-99b4-b098c5df4c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:49.292222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540de0a8-f683-4298-99b4-b098c5df4c33 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:49.341594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:49.384835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349a856-221e-4c4b-993e-98d3a15b2bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:49.385463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349a856-221e-4c4b-993e-98d3a15b2bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:49.385739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349a856-221e-4c4b-993e-98d3a15b2bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:49.386007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349a856-221e-4c4b-993e-98d3a15b2bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:49.386637 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349a856-221e-4c4b-993e-98d3a15b2bfa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:49.388450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-6349a856-221e-4c4b-993e-98d3a15b2bfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:24:49.388450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 13 03:24:49.388450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: Sep 13 03:24:49.389613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349a856-221e-4c4b-993e-98d3a15b2bfa admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:49.525378 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 737/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Sep 13 03:24:49 2022] GET /identity/v3/projects => generated 2553 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:24:51.651274 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab677-789d-48a3-a74a-230349216733 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:51.651839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab677-789d-48a3-a74a-230349216733 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:51.651839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ab677-789d-48a3-a74a-230349216733 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:51.653173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 742/1479] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:51.658423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767569bc-0a14-4ef5-8822-9063fbdf539b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:51.658846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767569bc-0a14-4ef5-8822-9063fbdf539b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:51.658956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767569bc-0a14-4ef5-8822-9063fbdf539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:51.723710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-767569bc-0a14-4ef5-8822-9063fbdf539b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:51.724917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-767569bc-0a14-4ef5-8822-9063fbdf539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:51.819977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 738/1480] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:52.109801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ab677-789d-48a3-a74a-230349216733 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:52.111334 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-050ab677-789d-48a3-a74a-230349216733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:52.121426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:52.257091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ab677-789d-48a3-a74a-230349216733 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:52.335490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:52.368539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577fc26-5bd2-4f56-b8e1-0878df2e1f01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:52.369176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577fc26-5bd2-4f56-b8e1-0878df2e1f01 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:52.369510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577fc26-5bd2-4f56-b8e1-0878df2e1f01 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:52.369779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577fc26-5bd2-4f56-b8e1-0878df2e1f01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:52.371361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7577fc26-5bd2-4f56-b8e1-0878df2e1f01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:52.462018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577fc26-5bd2-4f56-b8e1-0878df2e1f01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:52.463711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577fc26-5bd2-4f56-b8e1-0878df2e1f01 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:52.482060 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 743/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:24:54.794671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770a24-5bf5-4d4d-b9b7-88a9358d27fd None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:54.795250 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770a24-5bf5-4d4d-b9b7-88a9358d27fd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:54.795250 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8770a24-5bf5-4d4d-b9b7-88a9358d27fd None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:54.796555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 739/1482] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:54.802022 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cbf1c-44be-43eb-9ab5-4f09f962a397 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:54.802433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cbf1c-44be-43eb-9ab5-4f09f962a397 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:54.803577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cbf1c-44be-43eb-9ab5-4f09f962a397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:54.869846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d58cbf1c-44be-43eb-9ab5-4f09f962a397 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:54.871047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d58cbf1c-44be-43eb-9ab5-4f09f962a397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:54.917173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:54.966128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 744/1483] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:55.251958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8770a24-5bf5-4d4d-b9b7-88a9358d27fd None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:55.253523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d8770a24-5bf5-4d4d-b9b7-88a9358d27fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:55.277528 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:55.355433 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8770a24-5bf5-4d4d-b9b7-88a9358d27fd None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:55.426871 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f813c3-fba0-4910-b014-8e4d681ebf20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:55.427397 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f813c3-fba0-4910-b014-8e4d681ebf20 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:55.427674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f813c3-fba0-4910-b014-8e4d681ebf20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:55.427947 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f813c3-fba0-4910-b014-8e4d681ebf20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:55.429603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-44f813c3-fba0-4910-b014-8e4d681ebf20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:55.502471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:55.536773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f813c3-fba0-4910-b014-8e4d681ebf20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:55.538241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f813c3-fba0-4910-b014-8e4d681ebf20 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:55.555760 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 740/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:24:57.737247 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fa032-fdfd-4867-9e82-9e128bcdf071 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:57.737828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fa032-fdfd-4867-9e82-9e128bcdf071 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:57.737828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fa032-fdfd-4867-9e82-9e128bcdf071 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:57.739154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 745/1485] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:24:57.744372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3de82b-2b11-498e-ad4c-46ac41c4589d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:57.750191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3de82b-2b11-498e-ad4c-46ac41c4589d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:57.750191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3de82b-2b11-498e-ad4c-46ac41c4589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:57.810227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ad3de82b-2b11-498e-ad4c-46ac41c4589d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:24:57.811445 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ad3de82b-2b11-498e-ad4c-46ac41c4589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:57.906559 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 741/1486] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:24:58.199353 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fa032-fdfd-4867-9e82-9e128bcdf071 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:24:58.200872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7a4fa032-fdfd-4867-9e82-9e128bcdf071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:58.303843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fa032-fdfd-4867-9e82-9e128bcdf071 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:24:58.376360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:24:58.377918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c5a75-5294-4db0-ac01-dbb43ad384c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:24:58.378519 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c5a75-5294-4db0-ac01-dbb43ad384c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:24:58.378794 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c5a75-5294-4db0-ac01-dbb43ad384c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:24:58.379063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c5a75-5294-4db0-ac01-dbb43ad384c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:24:58.380648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-052c5a75-5294-4db0-ac01-dbb43ad384c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:24:58.493014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c5a75-5294-4db0-ac01-dbb43ad384c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:24:58.494531 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c5a75-5294-4db0-ac01-dbb43ad384c5 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:24:58.512156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 746/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:25:00.728125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72a032-2419-4f31-aed3-3b5f8a4bbc46 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:25:00.728705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72a032-2419-4f31-aed3-3b5f8a4bbc46 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:25:00.728705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72a032-2419-4f31-aed3-3b5f8a4bbc46 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:25:00.730016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 742/1488] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:25:00.735267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2366dcc-6bd2-4e34-b1bf-52554e8d7d10 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:25:00.735726 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2366dcc-6bd2-4e34-b1bf-52554e8d7d10 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:25:00.735853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2366dcc-6bd2-4e34-b1bf-52554e8d7d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:25:00.801106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c2366dcc-6bd2-4e34-b1bf-52554e8d7d10 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:25:00.802332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c2366dcc-6bd2-4e34-b1bf-52554e8d7d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:25:00.856738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:25:00.900182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 747/1489] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:25:01.197378 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72a032-2419-4f31-aed3-3b5f8a4bbc46 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:25:01.198950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5b72a032-2419-4f31-aed3-3b5f8a4bbc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:25:01.234272 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:25:01.299936 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72a032-2419-4f31-aed3-3b5f8a4bbc46 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:25:01.372206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997a23c-5488-47af-b3c7-eb27a012ab46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:25:01.372806 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a23c-5488-47af-b3c7-eb27a012ab46 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:25:01.373084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a23c-5488-47af-b3c7-eb27a012ab46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:25:01.373382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997a23c-5488-47af-b3c7-eb27a012ab46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:25:01.374966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f997a23c-5488-47af-b3c7-eb27a012ab46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:25:01.455949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:25:01.484472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997a23c-5488-47af-b3c7-eb27a012ab46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:25:01.486070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997a23c-5488-47af-b3c7-eb27a012ab46 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:25:01.504829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 743/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:25:04.255657 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1578c-9066-44dc-afa9-381ce4b70113 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:25:04.256214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1578c-9066-44dc-afa9-381ce4b70113 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:25:04.256214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1578c-9066-44dc-afa9-381ce4b70113 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:25:04.257606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 748/1491] 10.222.0.48 () {54 vars in 927 bytes} [Tue Sep 13 03:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:25:04.262712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72dc42-8475-4462-8aef-515c41a54ecd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:25:04.263131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72dc42-8475-4462-8aef-515c41a54ecd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:25:04.263244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72dc42-8475-4462-8aef-515c41a54ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:25:04.328096 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bc72dc42-8475-4462-8aef-515c41a54ecd None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:25:04.329226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bc72dc42-8475-4462-8aef-515c41a54ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:25:04.422279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 744/1492] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Sep 13 03:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:25:04.712822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1578c-9066-44dc-afa9-381ce4b70113 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:25:04.714377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-38d1578c-9066-44dc-afa9-381ce4b70113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:25:04.817609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1578c-9066-44dc-afa9-381ce4b70113 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:25:04.891890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26add2-208d-4f43-aa6c-4241c67d8ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:25:04.892496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26add2-208d-4f43-aa6c-4241c67d8ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:25:04.892769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26add2-208d-4f43-aa6c-4241c67d8ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:25:04.893034 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26add2-208d-4f43-aa6c-4241c67d8ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:25:04.894636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bd26add2-208d-4f43-aa6c-4241c67d8ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:25:04.903990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:25:05.003215 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26add2-208d-4f43-aa6c-4241c67d8ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:25:05.004637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26add2-208d-4f43-aa6c-4241c67d8ffd service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:25:05.023554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 749/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:25:14.420846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=82 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:25:15.020683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=50 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:25.918149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af983d-5685-42ca-b940-4dcdfdbf8eee None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:25.918851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af983d-5685-42ca-b940-4dcdfdbf8eee None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:25.918851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af983d-5685-42ca-b940-4dcdfdbf8eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:25.993810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-44af983d-5685-42ca-b940-4dcdfdbf8eee None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:26:25.995001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-44af983d-5685-42ca-b940-4dcdfdbf8eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:26.090415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 745/1494] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:26:26.098291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a490d41-3184-4daf-81e1-b72a138b9365 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:26.098778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a490d41-3184-4daf-81e1-b72a138b9365 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:26.098884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a490d41-3184-4daf-81e1-b72a138b9365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:26.173907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0a490d41-3184-4daf-81e1-b72a138b9365 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:26:26.175064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0a490d41-3184-4daf-81e1-b72a138b9365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:26.270028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 750/1495] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:26:26.274581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af983d-5685-42ca-b940-4dcdfdbf8eee None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:26:26.275773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-44af983d-5685-42ca-b940-4dcdfdbf8eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:26.286999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af983d-5685-42ca-b940-4dcdfdbf8eee None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:26:26.346436 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:26.380948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfbd7f-d1c8-4d06-b595-3d24c7a66138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:26:26.381569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfbd7f-d1c8-4d06-b595-3d24c7a66138 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:26.381842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfbd7f-d1c8-4d06-b595-3d24c7a66138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:26.382109 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfbd7f-d1c8-4d06-b595-3d24c7a66138 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:26.382738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfbd7f-d1c8-4d06-b595-3d24c7a66138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:26:26.383035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfbd7f-d1c8-4d06-b595-3d24c7a66138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:26:26.384033 dv-cinder-857075-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-c8dfbd7f-d1c8-4d06-b595-3d24c7a66138 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:26:26.384033 dv-cinder-857075-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 13 03:26:26.384033 dv-cinder-857075-2-smb devstack@keystone.service[81586]: Sep 13 03:26:26.384906 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfbd7f-d1c8-4d06-b595-3d24c7a66138 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:26:26.395958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 746/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:26:26.404318 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a490d41-3184-4daf-81e1-b72a138b9365 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:26:26.413275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a490d41-3184-4daf-81e1-b72a138b9365 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:26:26.473079 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:26.506652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e4f15-ee28-44bf-b96d-d4e6c2258a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:26:26.507242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4f15-ee28-44bf-b96d-d4e6c2258a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:26.507514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4f15-ee28-44bf-b96d-d4e6c2258a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:26.507781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4f15-ee28-44bf-b96d-d4e6c2258a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:26.508392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e4f15-ee28-44bf-b96d-d4e6c2258a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:26:26.510131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-5c8e4f15-ee28-44bf-b96d-d4e6c2258a08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:26:26.510131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 13 03:26:26.510131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: Sep 13 03:26:26.511320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e4f15-ee28-44bf-b96d-d4e6c2258a08 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:26:26.649892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 751/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:26:26 2022] POST /identity/v3/projects => generated 375 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:26:26.654087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfbd7f-d1c8-4d06-b595-3d24c7a66138 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:26:26.655722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c8dfbd7f-d1c8-4d06-b595-3d24c7a66138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:26.688462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfbd7f-d1c8-4d06-b595-3d24c7a66138 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:26:26.779857 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd5679-b370-4505-9691-fde16985a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:26:26.780381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd5679-b370-4505-9691-fde16985a1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:26.780657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd5679-b370-4505-9691-fde16985a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:26.780923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd5679-b370-4505-9691-fde16985a1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:26.781587 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd5679-b370-4505-9691-fde16985a1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:26:26.782601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-25dd5679-b370-4505-9691-fde16985a1f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:26:26.782601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 13 03:26:26.782601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: Sep 13 03:26:26.784334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd5679-b370-4505-9691-fde16985a1f6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:26:26.878372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 747/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:26:26 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:26:26.882540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e4f15-ee28-44bf-b96d-d4e6c2258a08 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:26:26.884016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5c8e4f15-ee28-44bf-b96d-d4e6c2258a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:26.944189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e4f15-ee28-44bf-b96d-d4e6c2258a08 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:26:27.030896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:27.041112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caceabbc-9f60-4bee-81d1-06ab5cf037e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:26:27.044832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caceabbc-9f60-4bee-81d1-06ab5cf037e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:27.044832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caceabbc-9f60-4bee-81d1-06ab5cf037e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:27.044832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caceabbc-9f60-4bee-81d1-06ab5cf037e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:27.044832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caceabbc-9f60-4bee-81d1-06ab5cf037e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:26:27.044832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-caceabbc-9f60-4bee-81d1-06ab5cf037e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:26:27.044832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 13 03:26:27.044832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: Sep 13 03:26:27.045348 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caceabbc-9f60-4bee-81d1-06ab5cf037e7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:26:27.058556 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 752/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:26:27.062500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd5679-b370-4505-9691-fde16985a1f6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:26:27.063984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-25dd5679-b370-4505-9691-fde16985a1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:27.075347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd5679-b370-4505-9691-fde16985a1f6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:26:27.100512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:27.169393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6957d5-4a86-4c1f-9752-a031ae6e6e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:26:27.170001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6957d5-4a86-4c1f-9752-a031ae6e6e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:27.170276 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6957d5-4a86-4c1f-9752-a031ae6e6e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:27.170545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6957d5-4a86-4c1f-9752-a031ae6e6e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:27.171212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6957d5-4a86-4c1f-9752-a031ae6e6e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:26:27.172227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-de6957d5-4a86-4c1f-9752-a031ae6e6e4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:26:27.172227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 13 03:26:27.172227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: Sep 13 03:26:27.173111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6957d5-4a86-4c1f-9752-a031ae6e6e4a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:26:27.185137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 748/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:26:27.189545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caceabbc-9f60-4bee-81d1-06ab5cf037e7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:26:27.191088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-caceabbc-9f60-4bee-81d1-06ab5cf037e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:27.224318 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caceabbc-9f60-4bee-81d1-06ab5cf037e7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:26:27.315874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0869ce-bf7b-4b1a-9ca6-f63e32ff1180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:26:27.316449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0869ce-bf7b-4b1a-9ca6-f63e32ff1180 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:27.316722 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0869ce-bf7b-4b1a-9ca6-f63e32ff1180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:27.316990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0869ce-bf7b-4b1a-9ca6-f63e32ff1180 admin admin] PATH_INFO: `/v3/projects/5271ff93a982405dabb902ab0f2c56a9/users/b357b4ac047a497db2f7f428a6207ec1/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:27.339168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0869ce-bf7b-4b1a-9ca6-f63e32ff1180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5271ff93a982405dabb902ab0f2c56a9, user_id=b357b4ac047a497db2f7f428a6207ec1, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:26:27.340175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-ce0869ce-bf7b-4b1a-9ca6-f63e32ff1180 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:26:27.340175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 13 03:26:27.340175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: Sep 13 03:26:27.342135 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0869ce-bf7b-4b1a-9ca6-f63e32ff1180 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:26:27.424552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 753/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:26:27 2022] PUT /identity/v3/projects/5271ff93a982405dabb902ab0f2c56a9/users/b357b4ac047a497db2f7f428a6207ec1/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:26:27.436653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b996d-d127-43ba-828b-99365ba5b07b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:27.436937 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b996d-d127-43ba-828b-99365ba5b07b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:27.437220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b996d-d127-43ba-828b-99365ba5b07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:27.493356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-652b996d-d127-43ba-828b-99365ba5b07b None None] MFA Rules not processed for user `b357b4ac047a497db2f7f428a6207ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:26:27.494561 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-652b996d-d127-43ba-828b-99365ba5b07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:27.571259 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 749/1502] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:26:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:26:27.585280 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f40d1c-0be1-40ca-8f49-6fd3beba70ba None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:27.585641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f40d1c-0be1-40ca-8f49-6fd3beba70ba None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:27.585988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f40d1c-0be1-40ca-8f49-6fd3beba70ba None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:27.587397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 754/1503] 10.222.0.48 () {54 vars in 964 bytes} [Tue Sep 13 03:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:26:27.592181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3840f9f-f987-4fe8-b286-1ed09d4254a3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:27.592470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3840f9f-f987-4fe8-b286-1ed09d4254a3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:27.592776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3840f9f-f987-4fe8-b286-1ed09d4254a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:27.623346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:27.667968 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b3840f9f-f987-4fe8-b286-1ed09d4254a3 None None] MFA Rules not processed for user `92e0ce020fb448bc9d470e918a022ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:26:27.669171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b3840f9f-f987-4fe8-b286-1ed09d4254a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:27.742572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 750/1504] 10.222.0.48 () {58 vars in 1061 bytes} [Tue Sep 13 03:26:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:26:27.750351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f40d1c-0be1-40ca-8f49-6fd3beba70ba None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:26:27.751912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-14f40d1c-0be1-40ca-8f49-6fd3beba70ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:27.810356 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:27.864805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f40d1c-0be1-40ca-8f49-6fd3beba70ba None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:26:27.936062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69003d83-3263-470b-a841-dc3ad3337455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:26:27.936657 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69003d83-3263-470b-a841-dc3ad3337455 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:27.936934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69003d83-3263-470b-a841-dc3ad3337455 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:27.937204 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69003d83-3263-470b-a841-dc3ad3337455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:27.938795 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-69003d83-3263-470b-a841-dc3ad3337455 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:28.034980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69003d83-3263-470b-a841-dc3ad3337455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:26:28.036388 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69003d83-3263-470b-a841-dc3ad3337455 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:26:28.039817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:28.054176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 755/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:26:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:26:28.101934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b296d-183a-45bb-b91f-2195c412b920 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:28.102426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b296d-183a-45bb-b91f-2195c412b920 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:28.108588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b296d-183a-45bb-b91f-2195c412b920 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:28.108588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 751/1506] 10.222.0.48 () {52 vars in 830 bytes} [Tue Sep 13 03:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:26:28.108775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69003d83-3263-470b-a841-dc3ad3337455 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:26:28.108951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-69003d83-3263-470b-a841-dc3ad3337455 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:28.208904 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69003d83-3263-470b-a841-dc3ad3337455 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:26:28.301048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:26:28.301693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:28.301968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:28.302230 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] PATH_INFO: `/v3/users/b357b4ac047a497db2f7f428a6207ec1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:28.314597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b357b4ac047a497db2f7f428a6207ec1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:26:28.315601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:26:28.315601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 13 03:26:28.315601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: Sep 13 03:26:28.316804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:26:28.326229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:28.556613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b357b4ac047a497db2f7f428a6207ec1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:26:28.653797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b357b4ac047a497db2f7f428a6207ec1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:26:28.654228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b357b4ac047a497db2f7f428a6207ec1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:26:28.654738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b357b4ac047a497db2f7f428a6207ec1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:26:28.670030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b357b4ac047a497db2f7f428a6207ec1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:26:28.698330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 756/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:26:28 2022] DELETE /identity/v3/users/b357b4ac047a497db2f7f428a6207ec1 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:26:28.702742 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e099ce-3c70-4601-afc6-c00e1a5a1021 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:28.703027 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e099ce-3c70-4601-afc6-c00e1a5a1021 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:28.704780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e099ce-3c70-4601-afc6-c00e1a5a1021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:28.760308 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-11e099ce-3c70-4601-afc6-c00e1a5a1021 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:26:28.761543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-11e099ce-3c70-4601-afc6-c00e1a5a1021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:28.838141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:28.850499 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 752/1508] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:26:28.860348 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:26:28.861595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:28.958990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74146cfa-00a3-4497-bc73-6818df4e121d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:26:29.012396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:29.031251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25697f13-0dcc-4db6-9aba-3ae79773bc3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:26:29.031887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25697f13-0dcc-4db6-9aba-3ae79773bc3c service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:29.032163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25697f13-0dcc-4db6-9aba-3ae79773bc3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:29.032433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25697f13-0dcc-4db6-9aba-3ae79773bc3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:29.034174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-25697f13-0dcc-4db6-9aba-3ae79773bc3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:29.142949 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25697f13-0dcc-4db6-9aba-3ae79773bc3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:26:29.144869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25697f13-0dcc-4db6-9aba-3ae79773bc3c service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:26:29.163247 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 757/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:26:29.650073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e099ce-3c70-4601-afc6-c00e1a5a1021 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:26:29.651245 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-11e099ce-3c70-4601-afc6-c00e1a5a1021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:26:29.662829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e099ce-3c70-4601-afc6-c00e1a5a1021 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:26:29.758937 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9536aa7-14bc-4fee-a921-71b4469d01f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:26:29.759559 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536aa7-14bc-4fee-a921-71b4469d01f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:26:29.759831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536aa7-14bc-4fee-a921-71b4469d01f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:26:29.760098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536aa7-14bc-4fee-a921-71b4469d01f0 admin admin] PATH_INFO: `/v3/projects/5271ff93a982405dabb902ab0f2c56a9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:26:29.769923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9536aa7-14bc-4fee-a921-71b4469d01f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5271ff93a982405dabb902ab0f2c56a9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:26:29.771147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-e9536aa7-14bc-4fee-a921-71b4469d01f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:26:29.771147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 13 03:26:29.771147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: Sep 13 03:26:29.772325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9536aa7-14bc-4fee-a921-71b4469d01f0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:26:29.881815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e9536aa7-14bc-4fee-a921-71b4469d01f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5271ff93a982405dabb902ab0f2c56a9', 'request_id': 'req-e9536aa7-14bc-4fee-a921-71b4469d01f0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:26:29.895858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e9536aa7-14bc-4fee-a921-71b4469d01f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5271ff93a982405dabb902ab0f2c56a9', 'request_id': 'req-e9536aa7-14bc-4fee-a921-71b4469d01f0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:26:29.956548 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e9536aa7-14bc-4fee-a921-71b4469d01f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5271ff93a982405dabb902ab0f2c56a9', 'request_id': 'req-e9536aa7-14bc-4fee-a921-71b4469d01f0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:26:29.979839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e9536aa7-14bc-4fee-a921-71b4469d01f0 admin admin] The token cache is being invalidate because project 5271ff93a982405dabb902ab0f2c56a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:26:29.980204 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e9536aa7-14bc-4fee-a921-71b4469d01f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:26:29.980628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e9536aa7-14bc-4fee-a921-71b4469d01f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:26:29.982037 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 753/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:26:29 2022] DELETE /identity/v3/projects/5271ff93a982405dabb902ab0f2c56a9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:26:39.160918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=62 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:26:39.977667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:02.746899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b534702-a13b-41b6-bfd8-ced173b8ec1b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:02.747488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b534702-a13b-41b6-bfd8-ced173b8ec1b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:02.747488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b534702-a13b-41b6-bfd8-ced173b8ec1b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:02.748810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 03:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:28:02.753871 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf2ed0-2077-414b-be91-db89f99a284a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:02.754324 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf2ed0-2077-414b-be91-db89f99a284a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:02.754433 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf2ed0-2077-414b-be91-db89f99a284a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:02.836048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e9cf2ed0-2077-414b-be91-db89f99a284a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:28:02.837301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e9cf2ed0-2077-414b-be91-db89f99a284a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:02.939827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 03:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:28:03.091415 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b534702-a13b-41b6-bfd8-ced173b8ec1b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:28:03.093580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0b534702-a13b-41b6-bfd8-ced173b8ec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:03.213457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b534702-a13b-41b6-bfd8-ced173b8ec1b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:28:03.219014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cca3f-81cc-4379-86aa-06a8d8096081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:28:03.219614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cca3f-81cc-4379-86aa-06a8d8096081 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:03.219896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cca3f-81cc-4379-86aa-06a8d8096081 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:03.220172 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cca3f-81cc-4379-86aa-06a8d8096081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:03.228977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cca3f-81cc-4379-86aa-06a8d8096081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:28:03.230584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cca3f-81cc-4379-86aa-06a8d8096081 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:28:03.239878 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 759/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:28:04.323564 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06114f28-da0d-4cd4-bc63-84c60984228f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:04.324138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06114f28-da0d-4cd4-bc63-84c60984228f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:04.324138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06114f28-da0d-4cd4-bc63-84c60984228f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:04.325505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 03:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:28:04.331910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeafa43-206f-4c32-b61a-43381ded2db1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:04.332345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeafa43-206f-4c32-b61a-43381ded2db1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:04.332446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeafa43-206f-4c32-b61a-43381ded2db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:04.352467 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bdeafa43-206f-4c32-b61a-43381ded2db1 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:28:04.354018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bdeafa43-206f-4c32-b61a-43381ded2db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:04.361910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 03:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:28:04.516469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06114f28-da0d-4cd4-bc63-84c60984228f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:28:04.532898 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06114f28-da0d-4cd4-bc63-84c60984228f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:28:04.538747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497ea65-1242-4daf-a60f-a4f2ffe52bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:28:04.539361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ea65-1242-4daf-a60f-a4f2ffe52bd3 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:04.539633 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ea65-1242-4daf-a60f-a4f2ffe52bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:04.539901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ea65-1242-4daf-a60f-a4f2ffe52bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:04.548121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497ea65-1242-4daf-a60f-a4f2ffe52bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:28:04.549725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497ea65-1242-4daf-a60f-a4f2ffe52bd3 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:28:04.559376 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 756/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:28:04.564639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0306-823f-4bd4-857e-05e2eabe5aea None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:04.565327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0306-823f-4bd4-857e-05e2eabe5aea None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:04.565327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0306-823f-4bd4-857e-05e2eabe5aea None None] PATH_INFO: `/v3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:04.566476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 761/1517] 10.222.0.55 () {54 vars in 925 bytes} [Tue Sep 13 03:28:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:28:04.574594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cb036-ac3e-4a01-acaa-baba31e1c235 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:04.574878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cb036-ac3e-4a01-acaa-baba31e1c235 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:04.575157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cb036-ac3e-4a01-acaa-baba31e1c235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:04.641507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7f0cb036-ac3e-4a01-acaa-baba31e1c235 None None] MFA Rules not processed for user `e261a9485c3b4d2aa657a931e0388389`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:28:04.642741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7f0cb036-ac3e-4a01-acaa-baba31e1c235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:04.662253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:04.719278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 757/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Tue Sep 13 03:28:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:28:08.473933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d329da-ceac-4ca9-b808-1dc16f80a61c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:08.474397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d329da-ceac-4ca9-b808-1dc16f80a61c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:08.475030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d329da-ceac-4ca9-b808-1dc16f80a61c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:08.476388 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 762/1519] 10.222.0.48 () {54 vars in 961 bytes} [Tue Sep 13 03:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:28:08.481613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60052f-c402-4fe8-ae51-18a9e5b6e24d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:08.482069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60052f-c402-4fe8-ae51-18a9e5b6e24d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:08.482174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60052f-c402-4fe8-ae51-18a9e5b6e24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:08.501882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9f60052f-c402-4fe8-ae51-18a9e5b6e24d None None] MFA Rules not processed for user `e261a9485c3b4d2aa657a931e0388389`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:28:08.503065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9f60052f-c402-4fe8-ae51-18a9e5b6e24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:08.511352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 758/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Sep 13 03:28:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:28:08.518628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d329da-ceac-4ca9-b808-1dc16f80a61c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:28:08.531786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d329da-ceac-4ca9-b808-1dc16f80a61c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:28:08.536597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9ec55-b9e6-4cce-a07d-84778c141751 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261a9485c3b4d2aa657a931e0388389', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:28:08.537685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9ec55-b9e6-4cce-a07d-84778c141751 service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:08.537959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9ec55-b9e6-4cce-a07d-84778c141751 service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:08.538226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9ec55-b9e6-4cce-a07d-84778c141751 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:08.546147 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9ec55-b9e6-4cce-a07d-84778c141751 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:28:08.547703 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9ec55-b9e6-4cce-a07d-84778c141751 service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:28:08.557703 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 763/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:28:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:28:16.040691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b500d69-8ab8-424f-8f08-fd50d1f137b4 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:16.041248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b500d69-8ab8-424f-8f08-fd50d1f137b4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:16.041248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b500d69-8ab8-424f-8f08-fd50d1f137b4 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:16.042596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 03:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:28:16.048634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d63508-7165-4d3f-b8c9-a3a1c7921234 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:16.049071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d63508-7165-4d3f-b8c9-a3a1c7921234 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:16.049189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d63508-7165-4d3f-b8c9-a3a1c7921234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:16.068735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a7d63508-7165-4d3f-b8c9-a3a1c7921234 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:28:16.069946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a7d63508-7165-4d3f-b8c9-a3a1c7921234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:16.077560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 03:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:28:16.230579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b500d69-8ab8-424f-8f08-fd50d1f137b4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:28:16.245932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b500d69-8ab8-424f-8f08-fd50d1f137b4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:28:16.251425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995a446-4d3d-423b-aabf-a0c2a9bc0d6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:28:16.252021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995a446-4d3d-423b-aabf-a0c2a9bc0d6e service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:16.252305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995a446-4d3d-423b-aabf-a0c2a9bc0d6e service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:16.252580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995a446-4d3d-423b-aabf-a0c2a9bc0d6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:16.260781 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995a446-4d3d-423b-aabf-a0c2a9bc0d6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:28:16.263887 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995a446-4d3d-423b-aabf-a0c2a9bc0d6e service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:28:16.272297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 760/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:28:17.337116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b359161-7712-4ad5-8a95-9f03d12f4ba6 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:17.337695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b359161-7712-4ad5-8a95-9f03d12f4ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:17.337695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b359161-7712-4ad5-8a95-9f03d12f4ba6 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:17.339019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 03:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:28:17.344912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d4d39-fcf9-4272-bf1b-08691cc61b8f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:17.345315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d4d39-fcf9-4272-bf1b-08691cc61b8f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:17.345484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d4d39-fcf9-4272-bf1b-08691cc61b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:17.365173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-211d4d39-fcf9-4272-bf1b-08691cc61b8f None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:28:17.366377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-211d4d39-fcf9-4272-bf1b-08691cc61b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:17.374032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 03:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:28:17.525343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b359161-7712-4ad5-8a95-9f03d12f4ba6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:28:17.539249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b359161-7712-4ad5-8a95-9f03d12f4ba6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:28:17.544546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6a837-0c94-4273-a44b-d4650d0f11cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:28:17.545122 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6a837-0c94-4273-a44b-d4650d0f11cb service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:17.545432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6a837-0c94-4273-a44b-d4650d0f11cb service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:17.545701 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6a837-0c94-4273-a44b-d4650d0f11cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:17.553512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6a837-0c94-4273-a44b-d4650d0f11cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:28:17.555072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6a837-0c94-4273-a44b-d4650d0f11cb service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:28:17.564121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 766/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:28:21.459931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d90b-82ae-47bb-9cef-d73b10df946e None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:21.460470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d90b-82ae-47bb-9cef-d73b10df946e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:21.460470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d90b-82ae-47bb-9cef-d73b10df946e None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:21.461818 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:28:21.466917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d077be-5e53-4184-ba96-2e849b23c619 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:21.467309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d077be-5e53-4184-ba96-2e849b23c619 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:21.467485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d077be-5e53-4184-ba96-2e849b23c619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:21.487276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-02d077be-5e53-4184-ba96-2e849b23c619 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:28:21.488476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-02d077be-5e53-4184-ba96-2e849b23c619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:21.496821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:28:21.783635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6d90b-82ae-47bb-9cef-d73b10df946e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:28:21.785397 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-67e6d90b-82ae-47bb-9cef-d73b10df946e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:21.864479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6d90b-82ae-47bb-9cef-d73b10df946e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:28:21.867996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d987c6-9753-4eb5-8f55-f3714d1988f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:28:21.868586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d987c6-9753-4eb5-8f55-f3714d1988f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:21.868887 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d987c6-9753-4eb5-8f55-f3714d1988f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:21.869156 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d987c6-9753-4eb5-8f55-f3714d1988f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:21.877958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d987c6-9753-4eb5-8f55-f3714d1988f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:28:21.879381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d987c6-9753-4eb5-8f55-f3714d1988f9 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:28:21.888559 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 763/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:28:24.003612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb5964-f80a-4782-b519-94f9d5f4a419 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:24.004220 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb5964-f80a-4782-b519-94f9d5f4a419 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:24.004220 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb5964-f80a-4782-b519-94f9d5f4a419 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:24.006058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:28:24.011874 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606f3a4-504d-4108-b467-af4d9bf8f4b4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:24.012315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606f3a4-504d-4108-b467-af4d9bf8f4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:24.012432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606f3a4-504d-4108-b467-af4d9bf8f4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:24.031817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a606f3a4-504d-4108-b467-af4d9bf8f4b4 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:28:24.033011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a606f3a4-504d-4108-b467-af4d9bf8f4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:24.040734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:28:24.327980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb5964-f80a-4782-b519-94f9d5f4a419 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:28:24.338892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb5964-f80a-4782-b519-94f9d5f4a419 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:28:24.342556 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032789eb-a45e-4eb6-ad97-3758a1189182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:28:24.343175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032789eb-a45e-4eb6-ad97-3758a1189182 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:24.343470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032789eb-a45e-4eb6-ad97-3758a1189182 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:24.343725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032789eb-a45e-4eb6-ad97-3758a1189182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:24.353452 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032789eb-a45e-4eb6-ad97-3758a1189182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:28:24.354877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032789eb-a45e-4eb6-ad97-3758a1189182 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:28:24.365001 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 769/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:28:28.415849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adf93a-4049-4314-8809-c0e55d4d7099 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:28.416390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adf93a-4049-4314-8809-c0e55d4d7099 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:28.416390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adf93a-4049-4314-8809-c0e55d4d7099 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:28.417716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:28:28.423028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147177b-5dfd-4a49-b76e-c78b75c63674 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:28.423477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147177b-5dfd-4a49-b76e-c78b75c63674 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:28.423588 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147177b-5dfd-4a49-b76e-c78b75c63674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:28.443658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3147177b-5dfd-4a49-b76e-c78b75c63674 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:28:28.444852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3147177b-5dfd-4a49-b76e-c78b75c63674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:28.452968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:28:28.751438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adf93a-4049-4314-8809-c0e55d4d7099 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:28:28.753152 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f7adf93a-4049-4314-8809-c0e55d4d7099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:28.816854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:28.829782 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adf93a-4049-4314-8809-c0e55d4d7099 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:28:28.833342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11e14c-9a17-4214-870f-656757d8cac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:28:28.833941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e14c-9a17-4214-870f-656757d8cac9 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:28.834217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e14c-9a17-4214-870f-656757d8cac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:28.834488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e14c-9a17-4214-870f-656757d8cac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:28.843301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11e14c-9a17-4214-870f-656757d8cac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:28:28.844726 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11e14c-9a17-4214-870f-656757d8cac9 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:28:28.854940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 766/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:28:30.980437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbd780-c63f-4884-b1c1-d3b4e993fb1d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:30.981008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbd780-c63f-4884-b1c1-d3b4e993fb1d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:30.981008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbd780-c63f-4884-b1c1-d3b4e993fb1d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:30.982459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 03:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:28:30.987544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aae88d-bc10-401a-9b5d-27774cdb1694 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:30.987977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aae88d-bc10-401a-9b5d-27774cdb1694 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:30.988103 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aae88d-bc10-401a-9b5d-27774cdb1694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:31.007738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-90aae88d-bc10-401a-9b5d-27774cdb1694 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:28:31.009210 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-90aae88d-bc10-401a-9b5d-27774cdb1694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:31.016845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 03:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:28:31.314319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbd780-c63f-4884-b1c1-d3b4e993fb1d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:28:31.315960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-61bbd780-c63f-4884-b1c1-d3b4e993fb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:28:31.324114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:31.329576 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbd780-c63f-4884-b1c1-d3b4e993fb1d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:28:31.333694 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e69cad-4e14-446b-b963-22363706da01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:28:31.334271 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69cad-4e14-446b-b963-22363706da01 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:28:31.334543 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69cad-4e14-446b-b963-22363706da01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:28:31.334809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69cad-4e14-446b-b963-22363706da01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:28:31.343362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e69cad-4e14-446b-b963-22363706da01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:28:31.344766 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e69cad-4e14-446b-b963-22363706da01 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:28:31.354249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 772/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:28:41.002413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=11 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:28:41.367893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:58.865929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b8482-2db4-4c11-89bb-e5003be58a3f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:58.866614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b8482-2db4-4c11-89bb-e5003be58a3f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:58.866614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b8482-2db4-4c11-89bb-e5003be58a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:58.890379 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-250b8482-2db4-4c11-89bb-e5003be58a3f None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:58.891601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-250b8482-2db4-4c11-89bb-e5003be58a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:58.904911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 768/1540] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:58.914591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd00b8-b104-47b5-9042-3ebd70abc531 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:58.920141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd00b8-b104-47b5-9042-3ebd70abc531 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:58.920141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd00b8-b104-47b5-9042-3ebd70abc531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:58.937613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4edd00b8-b104-47b5-9042-3ebd70abc531 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:58.938805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4edd00b8-b104-47b5-9042-3ebd70abc531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:58.952840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 773/1541] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:58.955089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f3f1-6cd7-414c-92c2-da1a47bce927 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:58.955375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f3f1-6cd7-414c-92c2-da1a47bce927 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:58.955686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913f3f1-6cd7-414c-92c2-da1a47bce927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:58.962641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd00b8-b104-47b5-9042-3ebd70abc531 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:58.983969 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a913f3f1-6cd7-414c-92c2-da1a47bce927 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:58.985588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a913f3f1-6cd7-414c-92c2-da1a47bce927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:58.986130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd00b8-b104-47b5-9042-3ebd70abc531 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:58.994901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e11785-ab4e-49ea-ad4c-77f49e185c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:58.995784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e11785-ab4e-49ea-ad4c-77f49e185c53 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:58.996269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e11785-ab4e-49ea-ad4c-77f49e185c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:58.996734 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e11785-ab4e-49ea-ad4c-77f49e185c53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:58.997591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e11785-ab4e-49ea-ad4c-77f49e185c53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:29:58.998290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e11785-ab4e-49ea-ad4c-77f49e185c53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:58.999609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-d5e11785-ab4e-49ea-ad4c-77f49e185c53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:29:58.999609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 13 03:29:58.999609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: Sep 13 03:29:59.000186 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 769/1542] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.006382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e11785-ab4e-49ea-ad4c-77f49e185c53 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.007923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b9a01-7f36-4af2-a4dc-bf3214e056b9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.008440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b9a01-7f36-4af2-a4dc-bf3214e056b9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.008912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b9a01-7f36-4af2-a4dc-bf3214e056b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.020618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 774/1543] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:29:59.029115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e11785-ab4e-49ea-ad4c-77f49e185c53 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.038581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6b1b9a01-7f36-4af2-a4dc-bf3214e056b9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:59.040012 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6b1b9a01-7f36-4af2-a4dc-bf3214e056b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:59.044233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e11785-ab4e-49ea-ad4c-77f49e185c53 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.061765 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192a6cd-585e-473e-a054-9d1408979a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.062770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192a6cd-585e-473e-a054-9d1408979a21 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.063252 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192a6cd-585e-473e-a054-9d1408979a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.063741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192a6cd-585e-473e-a054-9d1408979a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.064595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192a6cd-585e-473e-a054-9d1408979a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.066908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192a6cd-585e-473e-a054-9d1408979a21 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.067243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 770/1544] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.072061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b9a01-7f36-4af2-a4dc-bf3214e056b9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.087836 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b9a01-7f36-4af2-a4dc-bf3214e056b9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.106777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7685d71-38ef-4dc2-9f0c-3b523a5cde2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.107673 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685d71-38ef-4dc2-9f0c-3b523a5cde2d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.108115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685d71-38ef-4dc2-9f0c-3b523a5cde2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.108564 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7685d71-38ef-4dc2-9f0c-3b523a5cde2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.109412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7685d71-38ef-4dc2-9f0c-3b523a5cde2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:29:59.109874 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7685d71-38ef-4dc2-9f0c-3b523a5cde2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.111648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7685d71-38ef-4dc2-9f0c-3b523a5cde2d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.135012 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 771/1545] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:29:59.136513 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc25f0-a764-47a9-a444-f22f11f74073 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.136965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc25f0-a764-47a9-a444-f22f11f74073 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.137423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc25f0-a764-47a9-a444-f22f11f74073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.168840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-21cc25f0-a764-47a9-a444-f22f11f74073 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:59.170113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-21cc25f0-a764-47a9-a444-f22f11f74073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:59.178971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 772/1546] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.180163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed1f9-dc19-40e7-a26c-492c73b6e107 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.180441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed1f9-dc19-40e7-a26c-492c73b6e107 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.180712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bed1f9-dc19-40e7-a26c-492c73b6e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.202358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 775/1547] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:29:59.203292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192a6cd-585e-473e-a054-9d1408979a21 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.208119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-44bed1f9-dc19-40e7-a26c-492c73b6e107 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:59.209600 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-44bed1f9-dc19-40e7-a26c-492c73b6e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:59.269704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192a6cd-585e-473e-a054-9d1408979a21 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.271582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 773/1548] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.272816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc06564-930b-4ee8-8aed-1749cc4b8ccf None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.273101 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc06564-930b-4ee8-8aed-1749cc4b8ccf None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.273405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc06564-930b-4ee8-8aed-1749cc4b8ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.281776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756dd93-878d-4305-8fce-56fadcb7af51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.282395 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756dd93-878d-4305-8fce-56fadcb7af51 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.282679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756dd93-878d-4305-8fce-56fadcb7af51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.282950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756dd93-878d-4305-8fce-56fadcb7af51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.283628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756dd93-878d-4305-8fce-56fadcb7af51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.286138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756dd93-878d-4305-8fce-56fadcb7af51 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.295991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-edc06564-930b-4ee8-8aed-1749cc4b8ccf None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:59.297177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-edc06564-930b-4ee8-8aed-1749cc4b8ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:59.304995 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 774/1549] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.306391 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bd576-a68b-493a-8b0e-a5b47084c969 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.306674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bd576-a68b-493a-8b0e-a5b47084c969 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.306943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bd576-a68b-493a-8b0e-a5b47084c969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.325861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-381bd576-a68b-493a-8b0e-a5b47084c969 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:59.327138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-381bd576-a68b-493a-8b0e-a5b47084c969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:59.335331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 775/1550] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.336616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b01c-217f-4744-b3eb-f8c33884bd2f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.336892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b01c-217f-4744-b3eb-f8c33884bd2f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.337161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36b01c-217f-4744-b3eb-f8c33884bd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.357703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7c36b01c-217f-4744-b3eb-f8c33884bd2f None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:59.358867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7c36b01c-217f-4744-b3eb-f8c33884bd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:59.366535 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 776/1551] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.367663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97399c7-8267-4d27-b68a-1b027e742d4b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.367972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97399c7-8267-4d27-b68a-1b027e742d4b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.368247 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97399c7-8267-4d27-b68a-1b027e742d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.383213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 776/1552] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:29:59.384136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756dd93-878d-4305-8fce-56fadcb7af51 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.394598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e97399c7-8267-4d27-b68a-1b027e742d4b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:59.394598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e97399c7-8267-4d27-b68a-1b027e742d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:59.446324 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756dd93-878d-4305-8fce-56fadcb7af51 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.450215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 777/1553] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.451322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9abf5f-f99b-474c-abe5-48a17cc48367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.451466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009823-27cc-4784-b282-98c8e6cecacd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.451716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009823-27cc-4784-b282-98c8e6cecacd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.451986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009823-27cc-4784-b282-98c8e6cecacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.452096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9abf5f-f99b-474c-abe5-48a17cc48367 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.452332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9abf5f-f99b-474c-abe5-48a17cc48367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.452609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9abf5f-f99b-474c-abe5-48a17cc48367 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.453292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9abf5f-f99b-474c-abe5-48a17cc48367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.454308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-cb9abf5f-f99b-474c-abe5-48a17cc48367 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:29:59.454308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 13 03:29:59.454308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: Sep 13 03:29:59.456149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9abf5f-f99b-474c-abe5-48a17cc48367 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.472109 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-87009823-27cc-4784-b282-98c8e6cecacd None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:59.473365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-87009823-27cc-4784-b282-98c8e6cecacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:59.481631 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 778/1554] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.482745 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13cd0-8ea6-4c5a-8539-2391733d338c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.483018 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13cd0-8ea6-4c5a-8539-2391733d338c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.483286 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13cd0-8ea6-4c5a-8539-2391733d338c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.502115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-68f13cd0-8ea6-4c5a-8539-2391733d338c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:59.503805 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-68f13cd0-8ea6-4c5a-8539-2391733d338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:59.511588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 779/1555] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.512698 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c2d95-efa0-4314-acdc-83f0dc6fa9de None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.512971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c2d95-efa0-4314-acdc-83f0dc6fa9de None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.513240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c2d95-efa0-4314-acdc-83f0dc6fa9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.532224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-728c2d95-efa0-4314-acdc-83f0dc6fa9de None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:59.533451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-728c2d95-efa0-4314-acdc-83f0dc6fa9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:59.538115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 777/1556] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:29:59.538115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9abf5f-f99b-474c-abe5-48a17cc48367 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.542129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 780/1557] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.543301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e02149-b2e1-4b31-bc5d-9b91899cc31c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.543626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e02149-b2e1-4b31-bc5d-9b91899cc31c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.543897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e02149-b2e1-4b31-bc5d-9b91899cc31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.545974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9abf5f-f99b-474c-abe5-48a17cc48367 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.550600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400393e5-b34d-4df1-8efd-0995dd3ea632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.551188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400393e5-b34d-4df1-8efd-0995dd3ea632 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.551465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400393e5-b34d-4df1-8efd-0995dd3ea632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.551736 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400393e5-b34d-4df1-8efd-0995dd3ea632 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.552366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400393e5-b34d-4df1-8efd-0995dd3ea632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:29:59.552667 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400393e5-b34d-4df1-8efd-0995dd3ea632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.554294 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400393e5-b34d-4df1-8efd-0995dd3ea632 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.564620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-69e02149-b2e1-4b31-bc5d-9b91899cc31c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:59.566387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-69e02149-b2e1-4b31-bc5d-9b91899cc31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:59.567034 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 778/1558] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:29:59.567807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400393e5-b34d-4df1-8efd-0995dd3ea632 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.577251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400393e5-b34d-4df1-8efd-0995dd3ea632 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.581794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 781/1559] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.582748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace03355-ff27-4588-b4b7-cd492093d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.583379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace03355-ff27-4588-b4b7-cd492093d159 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.583658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace03355-ff27-4588-b4b7-cd492093d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.583928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace03355-ff27-4588-b4b7-cd492093d159 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.584617 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace03355-ff27-4588-b4b7-cd492093d159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.586392 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be83cc-d7e4-4300-9de8-3e187a768c26 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.586676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be83cc-d7e4-4300-9de8-3e187a768c26 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.586774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace03355-ff27-4588-b4b7-cd492093d159 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.586954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be83cc-d7e4-4300-9de8-3e187a768c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.598183 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:59.607003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-94be83cc-d7e4-4300-9de8-3e187a768c26 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:59.608171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-94be83cc-d7e4-4300-9de8-3e187a768c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:59.615992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 782/1560] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.617120 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf607e-886f-413c-b81d-22b8a09c3a7d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.617432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf607e-886f-413c-b81d-22b8a09c3a7d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.617707 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf607e-886f-413c-b81d-22b8a09c3a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.636376 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-07cf607e-886f-413c-b81d-22b8a09c3a7d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:29:59.637546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-07cf607e-886f-413c-b81d-22b8a09c3a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:29:59.645682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 783/1561] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:29:59.646368 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf607e-886f-413c-b81d-22b8a09c3a7d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.650712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:29:59.655710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf607e-886f-413c-b81d-22b8a09c3a7d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.660145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465d5ec-4970-44c2-a8ea-4f4f7e3b7ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.660700 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465d5ec-4970-44c2-a8ea-4f4f7e3b7ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.660978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465d5ec-4970-44c2-a8ea-4f4f7e3b7ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.661245 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465d5ec-4970-44c2-a8ea-4f4f7e3b7ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.661890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465d5ec-4970-44c2-a8ea-4f4f7e3b7ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:29:59.662187 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465d5ec-4970-44c2-a8ea-4f4f7e3b7ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.663793 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465d5ec-4970-44c2-a8ea-4f4f7e3b7ee4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.674854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 784/1562] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:29:59.675599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465d5ec-4970-44c2-a8ea-4f4f7e3b7ee4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.684516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465d5ec-4970-44c2-a8ea-4f4f7e3b7ee4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.690669 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19860965-f7db-490d-92d4-c24cd445d6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.691304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19860965-f7db-490d-92d4-c24cd445d6fa admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.691583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19860965-f7db-490d-92d4-c24cd445d6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.691855 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19860965-f7db-490d-92d4-c24cd445d6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.692530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19860965-f7db-490d-92d4-c24cd445d6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.696795 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 779/1563] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:29:59.696971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19860965-f7db-490d-92d4-c24cd445d6fa admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.697069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace03355-ff27-4588-b4b7-cd492093d159 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.704607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 785/1564] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:29:59.704750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace03355-ff27-4588-b4b7-cd492093d159 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.705407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19860965-f7db-490d-92d4-c24cd445d6fa admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.710193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b344dc3-2294-4ef8-9e74-6e4bd33ac7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.715216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344dc3-2294-4ef8-9e74-6e4bd33ac7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.715216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344dc3-2294-4ef8-9e74-6e4bd33ac7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.715216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344dc3-2294-4ef8-9e74-6e4bd33ac7b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.715216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b344dc3-2294-4ef8-9e74-6e4bd33ac7b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:29:59.715216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b344dc3-2294-4ef8-9e74-6e4bd33ac7b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.715216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b344dc3-2294-4ef8-9e74-6e4bd33ac7b5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.715764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19860965-f7db-490d-92d4-c24cd445d6fa admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.719857 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727ce4f-847a-4bcd-9b7f-ed6577591ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.720683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727ce4f-847a-4bcd-9b7f-ed6577591ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.720964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727ce4f-847a-4bcd-9b7f-ed6577591ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.721243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727ce4f-847a-4bcd-9b7f-ed6577591ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.721884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727ce4f-847a-4bcd-9b7f-ed6577591ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.722884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-f727ce4f-847a-4bcd-9b7f-ed6577591ae4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:29:59.722884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 13 03:29:59.722884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: Sep 13 03:29:59.724066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727ce4f-847a-4bcd-9b7f-ed6577591ae4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.734814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 780/1565] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:29:59.734814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b344dc3-2294-4ef8-9e74-6e4bd33ac7b5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.738585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b344dc3-2294-4ef8-9e74-6e4bd33ac7b5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.743202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d160f64-118d-4191-80aa-0c5cca713115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.743840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d160f64-118d-4191-80aa-0c5cca713115 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.744150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d160f64-118d-4191-80aa-0c5cca713115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.744422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d160f64-118d-4191-80aa-0c5cca713115 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.745047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d160f64-118d-4191-80aa-0c5cca713115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:29:59.745384 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d160f64-118d-4191-80aa-0c5cca713115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.746958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d160f64-118d-4191-80aa-0c5cca713115 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.758972 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 781/1566] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:29:59.759582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d160f64-118d-4191-80aa-0c5cca713115 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.769130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d160f64-118d-4191-80aa-0c5cca713115 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.773696 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40084a2-d789-4224-9d4f-7aca31276d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.774248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40084a2-d789-4224-9d4f-7aca31276d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.774524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40084a2-d789-4224-9d4f-7aca31276d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.774794 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40084a2-d789-4224-9d4f-7aca31276d9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.775405 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40084a2-d789-4224-9d4f-7aca31276d9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:29:59.775702 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40084a2-d789-4224-9d4f-7aca31276d9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.777292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40084a2-d789-4224-9d4f-7aca31276d9e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.789909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 782/1567] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:29:59.795254 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40084a2-d789-4224-9d4f-7aca31276d9e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.800485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40084a2-d789-4224-9d4f-7aca31276d9e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.805047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b166b-87b6-439a-9f6c-0af0e7772619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.805626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b166b-87b6-439a-9f6c-0af0e7772619 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.805903 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b166b-87b6-439a-9f6c-0af0e7772619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.806168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b166b-87b6-439a-9f6c-0af0e7772619 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.806836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b166b-87b6-439a-9f6c-0af0e7772619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:29:59.807135 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b166b-87b6-439a-9f6c-0af0e7772619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.808638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b166b-87b6-439a-9f6c-0af0e7772619 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.820246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 783/1568] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:29:59.820970 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b166b-87b6-439a-9f6c-0af0e7772619 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.830055 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b166b-87b6-439a-9f6c-0af0e7772619 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.834653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2036f-9ff4-4f2c-b0fe-3e94139b85ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.835329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2036f-9ff4-4f2c-b0fe-3e94139b85ca admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.835506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2036f-9ff4-4f2c-b0fe-3e94139b85ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.835772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2036f-9ff4-4f2c-b0fe-3e94139b85ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.836363 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2036f-9ff4-4f2c-b0fe-3e94139b85ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.838258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2036f-9ff4-4f2c-b0fe-3e94139b85ca admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.862712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 786/1569] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:29:59.863395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727ce4f-847a-4bcd-9b7f-ed6577591ae4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.922417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727ce4f-847a-4bcd-9b7f-ed6577591ae4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:29:59.927414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda19b-9d01-43b4-90e5-8f79894db3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:29:59.928004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda19b-9d01-43b4-90e5-8f79894db3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:29:59.928282 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda19b-9d01-43b4-90e5-8f79894db3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:29:59.928554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda19b-9d01-43b4-90e5-8f79894db3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:29:59.929184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dda19b-9d01-43b4-90e5-8f79894db3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:29:59.930819 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dda19b-9d01-43b4-90e5-8f79894db3f8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:29:59.941284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 787/1570] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:29:59.942231 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda19b-9d01-43b4-90e5-8f79894db3f8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.949158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 784/1571] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:29:59.949816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2036f-9ff4-4f2c-b0fe-3e94139b85ca admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:29:59.952510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda19b-9d01-43b4-90e5-8f79894db3f8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.012648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2036f-9ff4-4f2c-b0fe-3e94139b85ca admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.012900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d595b80-4ca5-4645-b859-d0aa7ba64746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.013508 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d595b80-4ca5-4645-b859-d0aa7ba64746 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.013789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d595b80-4ca5-4645-b859-d0aa7ba64746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.014058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d595b80-4ca5-4645-b859-d0aa7ba64746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.014689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d595b80-4ca5-4645-b859-d0aa7ba64746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.016283 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d595b80-4ca5-4645-b859-d0aa7ba64746 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.017379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180273-7ca0-4caa-b459-b1b2644af7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.018009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180273-7ca0-4caa-b459-b1b2644af7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.018282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180273-7ca0-4caa-b459-b1b2644af7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.018564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180273-7ca0-4caa-b459-b1b2644af7c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.019190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d180273-7ca0-4caa-b459-b1b2644af7c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.021092 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d180273-7ca0-4caa-b459-b1b2644af7c2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.026329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 788/1572] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:00.030207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d595b80-4ca5-4645-b859-d0aa7ba64746 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.040351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d595b80-4ca5-4645-b859-d0aa7ba64746 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.045119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc012491-2d00-4b9f-bd5b-66b9ab77306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.045816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc012491-2d00-4b9f-bd5b-66b9ab77306c admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.046089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc012491-2d00-4b9f-bd5b-66b9ab77306c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.046358 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc012491-2d00-4b9f-bd5b-66b9ab77306c admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.046970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc012491-2d00-4b9f-bd5b-66b9ab77306c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.048879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc012491-2d00-4b9f-bd5b-66b9ab77306c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.131875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 785/1573] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:29:59 2022] POST /identity/v3/projects => generated 393 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:00.131875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180273-7ca0-4caa-b459-b1b2644af7c2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.156768 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 789/1574] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:00 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:00.157621 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc012491-2d00-4b9f-bd5b-66b9ab77306c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.190108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:00.195054 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180273-7ca0-4caa-b459-b1b2644af7c2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.203822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:00.222415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc012491-2d00-4b9f-bd5b-66b9ab77306c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.227304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8dc5d-09c4-4a1b-a45d-fd2aa6d368e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.228025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8dc5d-09c4-4a1b-a45d-fd2aa6d368e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.228304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8dc5d-09c4-4a1b-a45d-fd2aa6d368e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.228576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8dc5d-09c4-4a1b-a45d-fd2aa6d368e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.229200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8dc5d-09c4-4a1b-a45d-fd2aa6d368e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.231151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8dc5d-09c4-4a1b-a45d-fd2aa6d368e5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.253154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09a4a1-5af2-471e-bda9-69e11848732a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.253795 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09a4a1-5af2-471e-bda9-69e11848732a admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.254076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09a4a1-5af2-471e-bda9-69e11848732a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.254347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09a4a1-5af2-471e-bda9-69e11848732a admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.254973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09a4a1-5af2-471e-bda9-69e11848732a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.256872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09a4a1-5af2-471e-bda9-69e11848732a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.351904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 790/1575] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:00 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:00.352708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8dc5d-09c4-4a1b-a45d-fd2aa6d368e5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.363666 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 786/1576] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:00 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:00.364718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09a4a1-5af2-471e-bda9-69e11848732a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.417863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8dc5d-09c4-4a1b-a45d-fd2aa6d368e5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.422425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285f0ff-5cc2-4e89-823e-81bfb32554f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.423026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285f0ff-5cc2-4e89-823e-81bfb32554f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.423301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285f0ff-5cc2-4e89-823e-81bfb32554f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.423569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285f0ff-5cc2-4e89-823e-81bfb32554f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.424236 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285f0ff-5cc2-4e89-823e-81bfb32554f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.424857 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09a4a1-5af2-471e-bda9-69e11848732a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.426982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285f0ff-5cc2-4e89-823e-81bfb32554f0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.429564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8778c7c-f494-49ae-82ac-ac159e10aed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.430165 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8778c7c-f494-49ae-82ac-ac159e10aed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.430443 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8778c7c-f494-49ae-82ac-ac159e10aed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.430716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8778c7c-f494-49ae-82ac-ac159e10aed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.431351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8778c7c-f494-49ae-82ac-ac159e10aed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.432934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8778c7c-f494-49ae-82ac-ac159e10aed9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.444777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 787/1577] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:00.444777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8778c7c-f494-49ae-82ac-ac159e10aed9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.453618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8778c7c-f494-49ae-82ac-ac159e10aed9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.458202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c37fa-88fb-4f12-afa1-1c6007d3fb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.458762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c37fa-88fb-4f12-afa1-1c6007d3fb8e admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.459037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c37fa-88fb-4f12-afa1-1c6007d3fb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.459329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c37fa-88fb-4f12-afa1-1c6007d3fb8e admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.459935 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c37fa-88fb-4f12-afa1-1c6007d3fb8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.461855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c37fa-88fb-4f12-afa1-1c6007d3fb8e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.522327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 791/1578] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:00 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:00.523131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285f0ff-5cc2-4e89-823e-81bfb32554f0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.532622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285f0ff-5cc2-4e89-823e-81bfb32554f0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.537841 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebbe02-1a7a-453f-ad8d-6d4feaba1aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.542390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebbe02-1a7a-453f-ad8d-6d4feaba1aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.542390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebbe02-1a7a-453f-ad8d-6d4feaba1aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.542390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebbe02-1a7a-453f-ad8d-6d4feaba1aaa admin admin] PATH_INFO: `/v3/projects/754ff09d6f454f6eb28e741830a68d2c/users/229f111cbc87457c9b66ef69b6cff365/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.544083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 788/1579] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:00 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:00.544884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c37fa-88fb-4f12-afa1-1c6007d3fb8e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.554544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c37fa-88fb-4f12-afa1-1c6007d3fb8e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.554715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebbe02-1a7a-453f-ad8d-6d4feaba1aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=754ff09d6f454f6eb28e741830a68d2c, user_id=229f111cbc87457c9b66ef69b6cff365, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.555604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-51ebbe02-1a7a-453f-ad8d-6d4feaba1aaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:30:00.555604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 13 03:30:00.555604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: Sep 13 03:30:00.557585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebbe02-1a7a-453f-ad8d-6d4feaba1aaa admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.559486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f3e2c-22ad-4855-a502-f1d11b53a290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.560128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f3e2c-22ad-4855-a502-f1d11b53a290 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.560405 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f3e2c-22ad-4855-a502-f1d11b53a290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.560675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f3e2c-22ad-4855-a502-f1d11b53a290 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.561378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f3e2c-22ad-4855-a502-f1d11b53a290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.563299 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f3e2c-22ad-4855-a502-f1d11b53a290 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.641484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 792/1580] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:00 2022] PUT /identity/v3/projects/754ff09d6f454f6eb28e741830a68d2c/users/229f111cbc87457c9b66ef69b6cff365/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:00.641933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 789/1581] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:00 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:00.642421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebbe02-1a7a-453f-ad8d-6d4feaba1aaa admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.643382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f3e2c-22ad-4855-a502-f1d11b53a290 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.652977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f3e2c-22ad-4855-a502-f1d11b53a290 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.705818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:00.707652 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebbe02-1a7a-453f-ad8d-6d4feaba1aaa admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.711452 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea3c60-5774-44de-9f7d-f1c3e00caedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.712068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea3c60-5774-44de-9f7d-f1c3e00caedf admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.712262 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa179c90-4629-4979-ae2e-69069b3580e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.712405 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea3c60-5774-44de-9f7d-f1c3e00caedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.712601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea3c60-5774-44de-9f7d-f1c3e00caedf admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.712877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa179c90-4629-4979-ae2e-69069b3580e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.713176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa179c90-4629-4979-ae2e-69069b3580e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.715251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea3c60-5774-44de-9f7d-f1c3e00caedf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.715369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa179c90-4629-4979-ae2e-69069b3580e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.715369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa179c90-4629-4979-ae2e-69069b3580e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.715546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea3c60-5774-44de-9f7d-f1c3e00caedf admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.716080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa179c90-4629-4979-ae2e-69069b3580e3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.806370 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 790/1582] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:00 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:00.806370 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea3c60-5774-44de-9f7d-f1c3e00caedf admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.813569 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea3c60-5774-44de-9f7d-f1c3e00caedf admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.818074 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91295d61-000e-4d24-b639-73ba8c94651c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.818633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91295d61-000e-4d24-b639-73ba8c94651c admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.818929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91295d61-000e-4d24-b639-73ba8c94651c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.819180 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91295d61-000e-4d24-b639-73ba8c94651c admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.819775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91295d61-000e-4d24-b639-73ba8c94651c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.821702 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91295d61-000e-4d24-b639-73ba8c94651c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.836164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 793/1583] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:00 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:00.836164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa179c90-4629-4979-ae2e-69069b3580e3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.843459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa179c90-4629-4979-ae2e-69069b3580e3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.848902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2c381-f91b-4071-9a1c-7ffeb348d5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.849581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2c381-f91b-4071-9a1c-7ffeb348d5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.849836 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2c381-f91b-4071-9a1c-7ffeb348d5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.850106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2c381-f91b-4071-9a1c-7ffeb348d5a6 admin admin] PATH_INFO: `/v3/projects/138038e814134c45a1c7e534eefd175e/users/76119e4c14a84e8cacfe80ebb1e07031/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.852245 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:00.864789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2c381-f91b-4071-9a1c-7ffeb348d5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=138038e814134c45a1c7e534eefd175e, user_id=76119e4c14a84e8cacfe80ebb1e07031, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.867484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2c381-f91b-4071-9a1c-7ffeb348d5a6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.932649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 791/1584] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:00 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:00.932649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91295d61-000e-4d24-b639-73ba8c94651c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.940699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91295d61-000e-4d24-b639-73ba8c94651c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.945224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e2e95-c932-4cf9-8b1b-d1c0c9ab6a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.945815 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2e95-c932-4cf9-8b1b-d1c0c9ab6a01 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.946097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2e95-c932-4cf9-8b1b-d1c0c9ab6a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.946366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2e95-c932-4cf9-8b1b-d1c0c9ab6a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.946986 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e2e95-c932-4cf9-8b1b-d1c0c9ab6a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.948556 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e2e95-c932-4cf9-8b1b-d1c0c9ab6a01 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.959557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 792/1585] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:00.960423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e2e95-c932-4cf9-8b1b-d1c0c9ab6a01 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.969634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e2e95-c932-4cf9-8b1b-d1c0c9ab6a01 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:00.974417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30322516-fc2a-4840-b86d-d8a741a4f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:00.974955 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30322516-fc2a-4840-b86d-d8a741a4f9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:00.975234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30322516-fc2a-4840-b86d-d8a741a4f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:00.975502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30322516-fc2a-4840-b86d-d8a741a4f9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:00.976101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30322516-fc2a-4840-b86d-d8a741a4f9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:00.977654 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30322516-fc2a-4840-b86d-d8a741a4f9d0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:00.987126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 793/1586] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:00.987998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30322516-fc2a-4840-b86d-d8a741a4f9d0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:00.997013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30322516-fc2a-4840-b86d-d8a741a4f9d0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.001611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea77f5-6f1f-4dee-96a7-88f2f2014ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.014011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea77f5-6f1f-4dee-96a7-88f2f2014ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.014011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea77f5-6f1f-4dee-96a7-88f2f2014ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.014011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea77f5-6f1f-4dee-96a7-88f2f2014ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.014011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea77f5-6f1f-4dee-96a7-88f2f2014ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.014011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea77f5-6f1f-4dee-96a7-88f2f2014ba4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.014492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 794/1587] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:00 2022] PUT /identity/v3/projects/138038e814134c45a1c7e534eefd175e/users/76119e4c14a84e8cacfe80ebb1e07031/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:01.014492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecc005-f024-4b98-a162-6e749a1ee39e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.014492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecc005-f024-4b98-a162-6e749a1ee39e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.014492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecc005-f024-4b98-a162-6e749a1ee39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.024252 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 794/1588] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:01.025423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea77f5-6f1f-4dee-96a7-88f2f2014ba4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.036015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea77f5-6f1f-4dee-96a7-88f2f2014ba4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.039958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-05ecc005-f024-4b98-a162-6e749a1ee39e None None] MFA Rules not processed for user `229f111cbc87457c9b66ef69b6cff365`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:01.041160 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-05ecc005-f024-4b98-a162-6e749a1ee39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:01.091617 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eea8df-7a0f-4acc-8dce-1699aa849917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.092216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eea8df-7a0f-4acc-8dce-1699aa849917 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.092491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eea8df-7a0f-4acc-8dce-1699aa849917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.092878 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eea8df-7a0f-4acc-8dce-1699aa849917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.093532 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eea8df-7a0f-4acc-8dce-1699aa849917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.095117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eea8df-7a0f-4acc-8dce-1699aa849917 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.108012 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 795/1589] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:01.108186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 795/1590] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:01.108186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eea8df-7a0f-4acc-8dce-1699aa849917 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.108384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecc005-f024-4b98-a162-6e749a1ee39e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.118366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eea8df-7a0f-4acc-8dce-1699aa849917 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.121333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecc005-f024-4b98-a162-6e749a1ee39e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.122974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a648a-fd08-4653-a9b2-f543634b4f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.123562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a648a-fd08-4653-a9b2-f543634b4f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.123859 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a648a-fd08-4653-a9b2-f543634b4f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.124124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a648a-fd08-4653-a9b2-f543634b4f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.124740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a648a-fd08-4653-a9b2-f543634b4f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.125869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0dac3-218e-4f9a-a462-202eb2255906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.126396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a648a-fd08-4653-a9b2-f543634b4f46 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.126509 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0dac3-218e-4f9a-a462-202eb2255906 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.126692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0dac3-218e-4f9a-a462-202eb2255906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.126931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0dac3-218e-4f9a-a462-202eb2255906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.128095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0dac3-218e-4f9a-a462-202eb2255906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.129731 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0dac3-218e-4f9a-a462-202eb2255906 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.138877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 796/1591] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:01.140725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a648a-fd08-4653-a9b2-f543634b4f46 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.140859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 796/1592] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:01.141501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0dac3-218e-4f9a-a462-202eb2255906 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.153181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0dac3-218e-4f9a-a462-202eb2255906 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.153399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a648a-fd08-4653-a9b2-f543634b4f46 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.159206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a042b3-962e-407a-ab5c-a0f1c4d5343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.159918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5238071-8b22-4917-b2f6-f98073827585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.160065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a042b3-962e-407a-ab5c-a0f1c4d5343e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.160368 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a042b3-962e-407a-ab5c-a0f1c4d5343e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.160641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a042b3-962e-407a-ab5c-a0f1c4d5343e admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.160856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5238071-8b22-4917-b2f6-f98073827585 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.161142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5238071-8b22-4917-b2f6-f98073827585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.161339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a042b3-962e-407a-ab5c-a0f1c4d5343e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.161453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5238071-8b22-4917-b2f6-f98073827585 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.162420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5238071-8b22-4917-b2f6-f98073827585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.162905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a042b3-962e-407a-ab5c-a0f1c4d5343e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.164080 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5238071-8b22-4917-b2f6-f98073827585 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.173373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 797/1593] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:01.174600 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f21a10-38ad-4abb-9cc1-105cd06bf74a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.181290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f21a10-38ad-4abb-9cc1-105cd06bf74a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.181290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f21a10-38ad-4abb-9cc1-105cd06bf74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.181521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 797/1594] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:01.181521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5238071-8b22-4917-b2f6-f98073827585 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.186676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5238071-8b22-4917-b2f6-f98073827585 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.191837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a48c56-cc91-4f2e-9846-a95d0892e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.192421 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a48c56-cc91-4f2e-9846-a95d0892e15e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.192705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a48c56-cc91-4f2e-9846-a95d0892e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.192974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a48c56-cc91-4f2e-9846-a95d0892e15e admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.193640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a48c56-cc91-4f2e-9846-a95d0892e15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.195222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a48c56-cc91-4f2e-9846-a95d0892e15e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.204127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-95f21a10-38ad-4abb-9cc1-105cd06bf74a None None] MFA Rules not processed for user `76119e4c14a84e8cacfe80ebb1e07031`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:01.206378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 798/1595] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:01.206487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-95f21a10-38ad-4abb-9cc1-105cd06bf74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:01.206695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a48c56-cc91-4f2e-9846-a95d0892e15e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.216262 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a48c56-cc91-4f2e-9846-a95d0892e15e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.221247 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9c552-9c58-406d-9350-da331055b778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.221892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9c552-9c58-406d-9350-da331055b778 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.222170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9c552-9c58-406d-9350-da331055b778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.222438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9c552-9c58-406d-9350-da331055b778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.223216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9c552-9c58-406d-9350-da331055b778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.224701 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9c552-9c58-406d-9350-da331055b778 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.236137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 799/1596] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:01.237478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9c552-9c58-406d-9350-da331055b778 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.246677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9c552-9c58-406d-9350-da331055b778 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.251173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac67656-46de-439d-8229-39b00f9b562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.251788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac67656-46de-439d-8229-39b00f9b562c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.252130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac67656-46de-439d-8229-39b00f9b562c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.252942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac67656-46de-439d-8229-39b00f9b562c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.253618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac67656-46de-439d-8229-39b00f9b562c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.255168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac67656-46de-439d-8229-39b00f9b562c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.264960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 800/1597] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:01.264960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac67656-46de-439d-8229-39b00f9b562c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.272668 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 798/1598] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:01.273948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8765c2-a2a7-45d2-aceb-be148fc3ede6 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.274354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8765c2-a2a7-45d2-aceb-be148fc3ede6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.274629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8765c2-a2a7-45d2-aceb-be148fc3ede6 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.275990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 799/1599] 10.222.0.48 () {54 vars in 962 bytes} [Tue Sep 13 03:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:30:01.276112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac67656-46de-439d-8229-39b00f9b562c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.276573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8765c2-a2a7-45d2-aceb-be148fc3ede6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.281136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ca241-61df-4d71-989c-82067351d9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.281647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ca241-61df-4d71-989c-82067351d9ae admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.281958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ca241-61df-4d71-989c-82067351d9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.282231 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ca241-61df-4d71-989c-82067351d9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.282856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ca241-61df-4d71-989c-82067351d9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.284470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ca241-61df-4d71-989c-82067351d9ae admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.288924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8765c2-a2a7-45d2-aceb-be148fc3ede6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.293610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664bdd9-5fa5-48d6-a72f-fd5f7d532a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.294277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664bdd9-5fa5-48d6-a72f-fd5f7d532a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.297967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664bdd9-5fa5-48d6-a72f-fd5f7d532a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.298086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 801/1600] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:01.298193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664bdd9-5fa5-48d6-a72f-fd5f7d532a61 admin admin] PATH_INFO: `/v3/projects/516145265738464ea7cbeec751e53264/users/1398646888214f8a9ed7be5648a9a231/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.298282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ca241-61df-4d71-989c-82067351d9ae admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.305455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ca241-61df-4d71-989c-82067351d9ae admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.309998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc91041-f26e-4f08-a8d3-9f6e26a81b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.310619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc91041-f26e-4f08-a8d3-9f6e26a81b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.310893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc91041-f26e-4f08-a8d3-9f6e26a81b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.311162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc91041-f26e-4f08-a8d3-9f6e26a81b88 admin admin] PATH_INFO: `/v3/projects/88e7ab95d68b461182bf1b7cbd08f5de/users/c83b01ab2d254b0a9e44caee9db02ed4/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.312525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664bdd9-5fa5-48d6-a72f-fd5f7d532a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=516145265738464ea7cbeec751e53264, user_id=1398646888214f8a9ed7be5648a9a231, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.315799 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664bdd9-5fa5-48d6-a72f-fd5f7d532a61 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.325825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc91041-f26e-4f08-a8d3-9f6e26a81b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e7ab95d68b461182bf1b7cbd08f5de, user_id=c83b01ab2d254b0a9e44caee9db02ed4, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.328440 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc91041-f26e-4f08-a8d3-9f6e26a81b88 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.431802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 800/1601] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:01 2022] PUT /identity/v3/projects/516145265738464ea7cbeec751e53264/users/1398646888214f8a9ed7be5648a9a231/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:01.432615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664bdd9-5fa5-48d6-a72f-fd5f7d532a61 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.444178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 802/1602] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:01 2022] PUT /identity/v3/projects/88e7ab95d68b461182bf1b7cbd08f5de/users/c83b01ab2d254b0a9e44caee9db02ed4/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:01.451144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc91041-f26e-4f08-a8d3-9f6e26a81b88 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.451144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:01.451357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:01.495394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664bdd9-5fa5-48d6-a72f-fd5f7d532a61 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.510418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc91041-f26e-4f08-a8d3-9f6e26a81b88 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.515086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e8c86-9088-4246-9e86-071b445b852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.515744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e8c86-9088-4246-9e86-071b445b852e admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.516072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e8c86-9088-4246-9e86-071b445b852e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.516344 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e8c86-9088-4246-9e86-071b445b852e admin admin] PATH_INFO: `/v3/projects/5f4689ac3ec44a88a740c1016dc4dfe9/users/a0e6526c76984cc7a6a4c14c840f7c8b/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.530587 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e8c86-9088-4246-9e86-071b445b852e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4689ac3ec44a88a740c1016dc4dfe9, user_id=a0e6526c76984cc7a6a4c14c840f7c8b, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.533235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e8c86-9088-4246-9e86-071b445b852e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.551196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d98e4-cc8b-4e17-9612-0eb296d41579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.551852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d98e4-cc8b-4e17-9612-0eb296d41579 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.552150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d98e4-cc8b-4e17-9612-0eb296d41579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.552424 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d98e4-cc8b-4e17-9612-0eb296d41579 admin admin] PATH_INFO: `/v3/projects/f12b3d34c9004770ac32556d0744c0de/users/9f181af31fb245bba4158e89e58704d3/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.566789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d98e4-cc8b-4e17-9612-0eb296d41579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12b3d34c9004770ac32556d0744c0de, user_id=9f181af31fb245bba4158e89e58704d3, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.569487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d98e4-cc8b-4e17-9612-0eb296d41579 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.666386 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 803/1603] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:01 2022] PUT /identity/v3/projects/5f4689ac3ec44a88a740c1016dc4dfe9/users/a0e6526c76984cc7a6a4c14c840f7c8b/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:01.670283 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e8c86-9088-4246-9e86-071b445b852e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.679542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 801/1604] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:01 2022] PUT /identity/v3/projects/f12b3d34c9004770ac32556d0744c0de/users/9f181af31fb245bba4158e89e58704d3/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:01.680364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d98e4-cc8b-4e17-9612-0eb296d41579 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.732039 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e8c86-9088-4246-9e86-071b445b852e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.741790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d98e4-cc8b-4e17-9612-0eb296d41579 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.746403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90629-5a24-4a1b-ada1-0e32836f97a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.746921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90629-5a24-4a1b-ada1-0e32836f97a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.747196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90629-5a24-4a1b-ada1-0e32836f97a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.747466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90629-5a24-4a1b-ada1-0e32836f97a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.748085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd90629-5a24-4a1b-ada1-0e32836f97a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.750020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd90629-5a24-4a1b-ada1-0e32836f97a2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.787294 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d9016-ccaf-4ad1-8678-975b647cbf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.787942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d9016-ccaf-4ad1-8678-975b647cbf2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.788216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d9016-ccaf-4ad1-8678-975b647cbf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.788485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d9016-ccaf-4ad1-8678-975b647cbf2d admin admin] PATH_INFO: `/v3/projects/0665f64976134cc3a1d9ef1aaf7675b7/users/6357a9d1f8b546249448ec2ae7196bda/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.802898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d9016-ccaf-4ad1-8678-975b647cbf2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0665f64976134cc3a1d9ef1aaf7675b7, user_id=6357a9d1f8b546249448ec2ae7196bda, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.807255 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d9016-ccaf-4ad1-8678-975b647cbf2d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.833013 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 802/1605] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:01 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:01.834289 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bc2d4-df9b-4e9d-b536-e35cfb79dd10 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.834585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bc2d4-df9b-4e9d-b536-e35cfb79dd10 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.834849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bc2d4-df9b-4e9d-b536-e35cfb79dd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.872067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b11bc2d4-df9b-4e9d-b536-e35cfb79dd10 None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:01.873344 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b11bc2d4-df9b-4e9d-b536-e35cfb79dd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:01.877961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 804/1606] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:01 2022] PUT /identity/v3/projects/0665f64976134cc3a1d9ef1aaf7675b7/users/6357a9d1f8b546249448ec2ae7196bda/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:01.878846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d9016-ccaf-4ad1-8678-975b647cbf2d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:01.892404 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:01.899320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:01.942848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d9016-ccaf-4ad1-8678-975b647cbf2d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:01.947716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc9c7a-af20-4599-a6ce-bcf4aa00d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:01.950236 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9c7a-af20-4599-a6ce-bcf4aa00d319 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.950236 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9c7a-af20-4599-a6ce-bcf4aa00d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.950236 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9c7a-af20-4599-a6ce-bcf4aa00d319 admin admin] PATH_INFO: `/v3/projects/878aabdec4dd481ab783248280b97225/users/7b0af609d24e4cbb956bb0a0c02d2871/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.953559 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 803/1607] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Sep 13 03:30:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:01.954768 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73305f5b-6759-4038-a563-d819fafb9095 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.955055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73305f5b-6759-4038-a563-d819fafb9095 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.955329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73305f5b-6759-4038-a563-d819fafb9095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:01.963635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc9c7a-af20-4599-a6ce-bcf4aa00d319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=878aabdec4dd481ab783248280b97225, user_id=7b0af609d24e4cbb956bb0a0c02d2871, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:01.966322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc9c7a-af20-4599-a6ce-bcf4aa00d319 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:01.974492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-73305f5b-6759-4038-a563-d819fafb9095 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:01.975676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-73305f5b-6759-4038-a563-d819fafb9095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:01.983161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 804/1608] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:01.984297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cae90-fdf2-4536-af9a-fa7a09bed308 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:01.984582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cae90-fdf2-4536-af9a-fa7a09bed308 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:01.984853 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cae90-fdf2-4536-af9a-fa7a09bed308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.003720 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0b4cae90-fdf2-4536-af9a-fa7a09bed308 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:02.004820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0b4cae90-fdf2-4536-af9a-fa7a09bed308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:02.012265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 805/1609] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:02.013426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898fd50-22ec-4f41-bf0e-aff039b40ba8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.013705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898fd50-22ec-4f41-bf0e-aff039b40ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.013976 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898fd50-22ec-4f41-bf0e-aff039b40ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.032347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1898fd50-22ec-4f41-bf0e-aff039b40ba8 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:02.033623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1898fd50-22ec-4f41-bf0e-aff039b40ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:02.041481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 806/1610] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:02.042601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c245a7e-1ab7-447a-9f50-c524090794e9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.042876 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c245a7e-1ab7-447a-9f50-c524090794e9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.043146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c245a7e-1ab7-447a-9f50-c524090794e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.053365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 805/1611] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:01 2022] PUT /identity/v3/projects/878aabdec4dd481ab783248280b97225/users/7b0af609d24e4cbb956bb0a0c02d2871/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:02.054291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc9c7a-af20-4599-a6ce-bcf4aa00d319 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.061355 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3c245a7e-1ab7-447a-9f50-c524090794e9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:02.062617 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3c245a7e-1ab7-447a-9f50-c524090794e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:02.116391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc9c7a-af20-4599-a6ce-bcf4aa00d319 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.121464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8e6ff-c74b-4bfc-a2ae-a55619fd0582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.122208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8e6ff-c74b-4bfc-a2ae-a55619fd0582 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.122602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8e6ff-c74b-4bfc-a2ae-a55619fd0582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.122917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8e6ff-c74b-4bfc-a2ae-a55619fd0582 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.123279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 807/1612] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:02.123612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8e6ff-c74b-4bfc-a2ae-a55619fd0582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.124634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec78bc4-dccc-4051-a8fd-2ef64cc8f0f9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.124919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec78bc4-dccc-4051-a8fd-2ef64cc8f0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.125191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec78bc4-dccc-4051-a8fd-2ef64cc8f0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.125492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8e6ff-c74b-4bfc-a2ae-a55619fd0582 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.153784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cec78bc4-dccc-4051-a8fd-2ef64cc8f0f9 None None] MFA Rules not processed for user `6357a9d1f8b546249448ec2ae7196bda`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:02.155073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cec78bc4-dccc-4051-a8fd-2ef64cc8f0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:02.219165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 808/1613] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:02.220192 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec78bc4-dccc-4051-a8fd-2ef64cc8f0f9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.225814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 806/1614] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:02 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:02.226723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8e6ff-c74b-4bfc-a2ae-a55619fd0582 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.242402 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:02.280702 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8e6ff-c74b-4bfc-a2ae-a55619fd0582 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.284956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75fbf5-f1b1-46da-8d77-ba154f850765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.285592 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75fbf5-f1b1-46da-8d77-ba154f850765 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.285902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75fbf5-f1b1-46da-8d77-ba154f850765 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.286172 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75fbf5-f1b1-46da-8d77-ba154f850765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.292491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec78bc4-dccc-4051-a8fd-2ef64cc8f0f9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.295272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75fbf5-f1b1-46da-8d77-ba154f850765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.296708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75fbf5-f1b1-46da-8d77-ba154f850765 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.298478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b9205-3690-4c55-944d-3163988017ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.299106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b9205-3690-4c55-944d-3163988017ae service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.299407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b9205-3690-4c55-944d-3163988017ae service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.299776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b9205-3690-4c55-944d-3163988017ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.306353 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 807/1615] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:02.307148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75fbf5-f1b1-46da-8d77-ba154f850765 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.315069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75fbf5-f1b1-46da-8d77-ba154f850765 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.319063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a363c3-b6a0-4cce-9f24-8ebed9323b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.319646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a363c3-b6a0-4cce-9f24-8ebed9323b83 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.319922 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a363c3-b6a0-4cce-9f24-8ebed9323b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.320190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a363c3-b6a0-4cce-9f24-8ebed9323b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.329602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a363c3-b6a0-4cce-9f24-8ebed9323b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.331562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a363c3-b6a0-4cce-9f24-8ebed9323b83 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.341048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 808/1616] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:02.341861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a363c3-b6a0-4cce-9f24-8ebed9323b83 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.350269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a363c3-b6a0-4cce-9f24-8ebed9323b83 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.354154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1c41-4325-4f9d-80c4-36fe7b278e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.354535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1c41-4325-4f9d-80c4-36fe7b278e5d service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.354810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1c41-4325-4f9d-80c4-36fe7b278e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.355080 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1c41-4325-4f9d-80c4-36fe7b278e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.361634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b9205-3690-4c55-944d-3163988017ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.363372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b9205-3690-4c55-944d-3163988017ae service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.364743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d1c41-4325-4f9d-80c4-36fe7b278e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.366214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d1c41-4325-4f9d-80c4-36fe7b278e5d service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.373158 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 809/1617] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:02.374522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99b5d1-7f97-452e-bd37-5c6a6d969c3a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.375312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99b5d1-7f97-452e-bd37-5c6a6d969c3a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.375312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99b5d1-7f97-452e-bd37-5c6a6d969c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.376509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 809/1618] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:02.377826 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1c41-4325-4f9d-80c4-36fe7b278e5d service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.383202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:02.387220 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1c41-4325-4f9d-80c4-36fe7b278e5d service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.393780 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6b288-9a18-4ffb-ad53-8db30dbd0035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.394846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b288-9a18-4ffb-ad53-8db30dbd0035 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.395328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b288-9a18-4ffb-ad53-8db30dbd0035 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.395820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b288-9a18-4ffb-ad53-8db30dbd0035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.406503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6b288-9a18-4ffb-ad53-8db30dbd0035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.408367 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6b288-9a18-4ffb-ad53-8db30dbd0035 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.409473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bc99b5d1-7f97-452e-bd37-5c6a6d969c3a None None] MFA Rules not processed for user `7b0af609d24e4cbb956bb0a0c02d2871`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:02.410814 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bc99b5d1-7f97-452e-bd37-5c6a6d969c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:02.421500 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 810/1619] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:02.422638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6b288-9a18-4ffb-ad53-8db30dbd0035 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.433946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6b288-9a18-4ffb-ad53-8db30dbd0035 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.439338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92927c4e-51cc-4289-8331-c83f7471774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.440964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92927c4e-51cc-4289-8331-c83f7471774d admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.441370 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92927c4e-51cc-4289-8331-c83f7471774d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.441876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92927c4e-51cc-4289-8331-c83f7471774d admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.442591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92927c4e-51cc-4289-8331-c83f7471774d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.444958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92927c4e-51cc-4289-8331-c83f7471774d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.497225 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 810/1620] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:02.498161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99b5d1-7f97-452e-bd37-5c6a6d969c3a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.510031 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99b5d1-7f97-452e-bd37-5c6a6d969c3a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.515227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4f355-1d83-4b4e-889a-528377678cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.515909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4f355-1d83-4b4e-889a-528377678cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.516163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4f355-1d83-4b4e-889a-528377678cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.516545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4f355-1d83-4b4e-889a-528377678cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.517136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4f355-1d83-4b4e-889a-528377678cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.519498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4f355-1d83-4b4e-889a-528377678cdb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.540044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 811/1621] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:02.540044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4f355-1d83-4b4e-889a-528377678cdb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.542030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4f355-1d83-4b4e-889a-528377678cdb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.547615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8df9-8f5d-4eea-a96e-23fcd5d04de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.548270 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8df9-8f5d-4eea-a96e-23fcd5d04de3 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.548548 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8df9-8f5d-4eea-a96e-23fcd5d04de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.548822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8df9-8f5d-4eea-a96e-23fcd5d04de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.549581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a8df9-8f5d-4eea-a96e-23fcd5d04de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.551678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a8df9-8f5d-4eea-a96e-23fcd5d04de3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.573114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 811/1622] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:02 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:02.574565 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92927c4e-51cc-4289-8331-c83f7471774d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.652425 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92927c4e-51cc-4289-8331-c83f7471774d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.657095 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab4943-fe54-4297-b93b-85072355a6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.657787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab4943-fe54-4297-b93b-85072355a6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.658061 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab4943-fe54-4297-b93b-85072355a6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.658365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab4943-fe54-4297-b93b-85072355a6ee admin admin] PATH_INFO: `/v3/projects/d073106dffe045559f6e4d970e0a21d1/users/e338de4597a446a28b4920bdc993eb1c/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.674604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab4943-fe54-4297-b93b-85072355a6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d073106dffe045559f6e4d970e0a21d1, user_id=e338de4597a446a28b4920bdc993eb1c, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.677339 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab4943-fe54-4297-b93b-85072355a6ee admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.702336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 812/1623] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:02 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:02.703154 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8df9-8f5d-4eea-a96e-23fcd5d04de3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.718931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:02.768289 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8df9-8f5d-4eea-a96e-23fcd5d04de3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.775200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91c701-eef3-426a-b7a3-9dba3953e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.784624 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91c701-eef3-426a-b7a3-9dba3953e522 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.784624 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91c701-eef3-426a-b7a3-9dba3953e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.784624 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91c701-eef3-426a-b7a3-9dba3953e522 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.784624 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91c701-eef3-426a-b7a3-9dba3953e522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.784624 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91c701-eef3-426a-b7a3-9dba3953e522 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.785161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 812/1624] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:02 2022] PUT /identity/v3/projects/d073106dffe045559f6e4d970e0a21d1/users/e338de4597a446a28b4920bdc993eb1c/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:02.785161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50126b-a32a-4686-aba4-6d79670b9d3e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.785161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50126b-a32a-4686-aba4-6d79670b9d3e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.785161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50126b-a32a-4686-aba4-6d79670b9d3e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.785161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 813/1625] 10.222.0.48 () {54 vars in 912 bytes} [Tue Sep 13 03:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:30:02.785161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50126b-a32a-4686-aba4-6d79670b9d3e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.854521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50126b-a32a-4686-aba4-6d79670b9d3e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.861314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f161a-6a6e-46bd-affe-103a512a7c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.861314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f161a-6a6e-46bd-affe-103a512a7c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.861314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f161a-6a6e-46bd-affe-103a512a7c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.861314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f161a-6a6e-46bd-affe-103a512a7c06 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.862206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f161a-6a6e-46bd-affe-103a512a7c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.864035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f161a-6a6e-46bd-affe-103a512a7c06 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.884554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 813/1626] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:02 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:02.885838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91c701-eef3-426a-b7a3-9dba3953e522 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.897455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91c701-eef3-426a-b7a3-9dba3953e522 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.902580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11308df-0bd2-441b-96a3-1d143f67f0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.903181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11308df-0bd2-441b-96a3-1d143f67f0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.903458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11308df-0bd2-441b-96a3-1d143f67f0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.903733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11308df-0bd2-441b-96a3-1d143f67f0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.904732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11308df-0bd2-441b-96a3-1d143f67f0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.906149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11308df-0bd2-441b-96a3-1d143f67f0b3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.916934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 814/1627] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:02.918568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5f58b-9c95-4024-ab23-e50a7f3f3f25 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.919040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5f58b-9c95-4024-ab23-e50a7f3f3f25 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.920060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5f58b-9c95-4024-ab23-e50a7f3f3f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.942345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-75a5f58b-9c95-4024-ab23-e50a7f3f3f25 None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:02.943905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-75a5f58b-9c95-4024-ab23-e50a7f3f3f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:02.951803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 814/1628] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:02 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:02.951803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f161a-6a6e-46bd-affe-103a512a7c06 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:02.963716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f161a-6a6e-46bd-affe-103a512a7c06 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:02.969875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7f8bc-1d6e-45a7-9ed6-192112a9b4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:02.970901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f8bc-1d6e-45a7-9ed6-192112a9b4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:02.971707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f8bc-1d6e-45a7-9ed6-192112a9b4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:02.972134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f8bc-1d6e-45a7-9ed6-192112a9b4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:02.972790 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7f8bc-1d6e-45a7-9ed6-192112a9b4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:02.974594 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7f8bc-1d6e-45a7-9ed6-192112a9b4f0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:02.987517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 815/1629] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:02.990333 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7f8bc-1d6e-45a7-9ed6-192112a9b4f0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:03.002823 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7f8bc-1d6e-45a7-9ed6-192112a9b4f0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:03.007925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37a68c-215b-43f1-a6ee-c1d48981803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:03.008582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37a68c-215b-43f1-a6ee-c1d48981803e admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:03.008863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37a68c-215b-43f1-a6ee-c1d48981803e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:03.009133 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37a68c-215b-43f1-a6ee-c1d48981803e admin admin] PATH_INFO: `/v3/projects/d073106dffe045559f6e4d970e0a21d1/users/e338de4597a446a28b4920bdc993eb1c/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:03.011931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37a68c-215b-43f1-a6ee-c1d48981803e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d073106dffe045559f6e4d970e0a21d1, user_id=e338de4597a446a28b4920bdc993eb1c, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:03.014297 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37a68c-215b-43f1-a6ee-c1d48981803e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:03.026316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 816/1630] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:02 2022] PUT /identity/v3/projects/d073106dffe045559f6e4d970e0a21d1/users/e338de4597a446a28b4920bdc993eb1c/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:03.027134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37a68c-215b-43f1-a6ee-c1d48981803e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:03.047423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 815/1631] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:30:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:03.056058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5f58b-9c95-4024-ab23-e50a7f3f3f25 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:03.062670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:03.068175 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5f58b-9c95-4024-ab23-e50a7f3f3f25 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:03.114246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37a68c-215b-43f1-a6ee-c1d48981803e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:03.120510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d173fa1-bb49-4536-b46a-7dd956116e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:03.121353 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d173fa1-bb49-4536-b46a-7dd956116e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:03.121618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d173fa1-bb49-4536-b46a-7dd956116e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:03.121895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d173fa1-bb49-4536-b46a-7dd956116e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:03.122688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d173fa1-bb49-4536-b46a-7dd956116e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:03.124315 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d173fa1-bb49-4536-b46a-7dd956116e15 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:03.140305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc2528-0c91-42ec-ac87-019a236dc1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:03.140541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 817/1632] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:03.140541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087c2d5-7ce3-4f9b-917b-2f9e45be3a1e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:03.140711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087c2d5-7ce3-4f9b-917b-2f9e45be3a1e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:03.141481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087c2d5-7ce3-4f9b-917b-2f9e45be3a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:03.142964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc2528-0c91-42ec-ac87-019a236dc1d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:03.143392 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc2528-0c91-42ec-ac87-019a236dc1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:03.143668 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc2528-0c91-42ec-ac87-019a236dc1d9 admin admin] PATH_INFO: `/v3/projects/855a67c5e2ee4f30aa90d8acfac5dbab/users/6eb482fdb85c4e13b0a4218799a8a2f0/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:03.165549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc2528-0c91-42ec-ac87-019a236dc1d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855a67c5e2ee4f30aa90d8acfac5dbab, user_id=6eb482fdb85c4e13b0a4218799a8a2f0, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:03.172677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc2528-0c91-42ec-ac87-019a236dc1d9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:03.181891 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f087c2d5-7ce3-4f9b-917b-2f9e45be3a1e None None] MFA Rules not processed for user `e338de4597a446a28b4920bdc993eb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:03.183126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f087c2d5-7ce3-4f9b-917b-2f9e45be3a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:03.262777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 818/1633] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:03.262777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087c2d5-7ce3-4f9b-917b-2f9e45be3a1e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:03.293778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 816/1634] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:03 2022] PUT /identity/v3/projects/855a67c5e2ee4f30aa90d8acfac5dbab/users/6eb482fdb85c4e13b0a4218799a8a2f0/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:03.294757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc2528-0c91-42ec-ac87-019a236dc1d9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:03.310040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:03.331160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087c2d5-7ce3-4f9b-917b-2f9e45be3a1e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:03.397931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4d5c8-36ea-4c77-9006-563d49b8176a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:03.398549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4d5c8-36ea-4c77-9006-563d49b8176a service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:03.398829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4d5c8-36ea-4c77-9006-563d49b8176a service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:03.399108 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4d5c8-36ea-4c77-9006-563d49b8176a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:03.405465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc2528-0c91-42ec-ac87-019a236dc1d9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:03.411852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e11e8-684c-4b01-a847-d8140239f965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:03.412532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e11e8-684c-4b01-a847-d8140239f965 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:03.412812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e11e8-684c-4b01-a847-d8140239f965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:03.413522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e11e8-684c-4b01-a847-d8140239f965 admin admin] PATH_INFO: `/v3/projects/2c73d7296e85466a834261d255017c68/users/ab531a4de8a245e6b0ac1e3ab95e36f2/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:03.435584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e11e8-684c-4b01-a847-d8140239f965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c73d7296e85466a834261d255017c68, user_id=ab531a4de8a245e6b0ac1e3ab95e36f2, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:03.438318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e11e8-684c-4b01-a847-d8140239f965 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:03.457950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:03.524435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4d5c8-36ea-4c77-9006-563d49b8176a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:03.531177 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4d5c8-36ea-4c77-9006-563d49b8176a service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:03.531303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 817/1635] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:03 2022] PUT /identity/v3/projects/2c73d7296e85466a834261d255017c68/users/ab531a4de8a245e6b0ac1e3ab95e36f2/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:03.534759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e11e8-684c-4b01-a847-d8140239f965 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:03.557362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 819/1636] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:03.558936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4d5c8-36ea-4c77-9006-563d49b8176a service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:03.592491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4d5c8-36ea-4c77-9006-563d49b8176a service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:03.633481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e11e8-684c-4b01-a847-d8140239f965 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:03.639155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880b569-9ca1-40ee-bcf1-8f1d4ae33ff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:03.639940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880b569-9ca1-40ee-bcf1-8f1d4ae33ff2 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:03.640224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880b569-9ca1-40ee-bcf1-8f1d4ae33ff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:03.641391 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880b569-9ca1-40ee-bcf1-8f1d4ae33ff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:03.706450 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96dfb6-9811-4168-bbae-45fb4827bb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:03.707219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96dfb6-9811-4168-bbae-45fb4827bb16 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:03.707595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96dfb6-9811-4168-bbae-45fb4827bb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:03.707964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96dfb6-9811-4168-bbae-45fb4827bb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:03.709297 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96dfb6-9811-4168-bbae-45fb4827bb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:03.711295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96dfb6-9811-4168-bbae-45fb4827bb16 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:03.725864 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 820/1637] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:03.726873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96dfb6-9811-4168-bbae-45fb4827bb16 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:03.739210 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96dfb6-9811-4168-bbae-45fb4827bb16 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:03.746264 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96726a49-2d82-4282-a5cd-0ed4acc7d736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:03.749085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96726a49-2d82-4282-a5cd-0ed4acc7d736 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:03.749085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96726a49-2d82-4282-a5cd-0ed4acc7d736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:03.749085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96726a49-2d82-4282-a5cd-0ed4acc7d736 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:03.749085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96726a49-2d82-4282-a5cd-0ed4acc7d736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:03.751488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96726a49-2d82-4282-a5cd-0ed4acc7d736 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:03.770415 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 821/1638] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:03.770415 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96726a49-2d82-4282-a5cd-0ed4acc7d736 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:03.787225 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96726a49-2d82-4282-a5cd-0ed4acc7d736 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:03.796176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880b569-9ca1-40ee-bcf1-8f1d4ae33ff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:03.798462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880b569-9ca1-40ee-bcf1-8f1d4ae33ff2 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:03.802825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a54c03-155f-4243-bc97-712aa651724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:03.803516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54c03-155f-4243-bc97-712aa651724f admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:03.803794 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54c03-155f-4243-bc97-712aa651724f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:03.804067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54c03-155f-4243-bc97-712aa651724f admin admin] PATH_INFO: `/v3/projects/855a67c5e2ee4f30aa90d8acfac5dbab/users/6eb482fdb85c4e13b0a4218799a8a2f0/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:03.817710 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a54c03-155f-4243-bc97-712aa651724f admin admin] RBAC: Authorizing `identity:create_grant(project_id=855a67c5e2ee4f30aa90d8acfac5dbab, user_id=6eb482fdb85c4e13b0a4218799a8a2f0, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:03.817832 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 818/1639] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:03.817832 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880b569-9ca1-40ee-bcf1-8f1d4ae33ff2 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:03.828030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a54c03-155f-4243-bc97-712aa651724f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:03.829886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880b569-9ca1-40ee-bcf1-8f1d4ae33ff2 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:03.838455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdb989-b273-4045-ad2b-efc2f2c5f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:03.839570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb989-b273-4045-ad2b-efc2f2c5f51b admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:03.842350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb989-b273-4045-ad2b-efc2f2c5f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:03.845635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb989-b273-4045-ad2b-efc2f2c5f51b admin admin] PATH_INFO: `/v3/projects/2c73d7296e85466a834261d255017c68/users/ab531a4de8a245e6b0ac1e3ab95e36f2/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:03.847185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdb989-b273-4045-ad2b-efc2f2c5f51b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c73d7296e85466a834261d255017c68, user_id=ab531a4de8a245e6b0ac1e3ab95e36f2, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:03.856960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdb989-b273-4045-ad2b-efc2f2c5f51b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:03.874359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 822/1640] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:03 2022] PUT /identity/v3/projects/855a67c5e2ee4f30aa90d8acfac5dbab/users/6eb482fdb85c4e13b0a4218799a8a2f0/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:03.884821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46ec7d-fcbe-4f9a-88f2-bd08ec6b3681 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:03.885618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46ec7d-fcbe-4f9a-88f2-bd08ec6b3681 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:03.886126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46ec7d-fcbe-4f9a-88f2-bd08ec6b3681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:03.890580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 819/1641] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:03 2022] PUT /identity/v3/projects/2c73d7296e85466a834261d255017c68/users/ab531a4de8a245e6b0ac1e3ab95e36f2/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:03.902308 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e9329-5b85-4dc2-9a94-5bc54cbd87bf None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:03.902590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e9329-5b85-4dc2-9a94-5bc54cbd87bf None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:03.902873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e9329-5b85-4dc2-9a94-5bc54cbd87bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:03.948494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a26e9329-5b85-4dc2-9a94-5bc54cbd87bf None None] MFA Rules not processed for user `ab531a4de8a245e6b0ac1e3ab95e36f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:03.950467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a26e9329-5b85-4dc2-9a94-5bc54cbd87bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:03.983270 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:03.990933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9d46ec7d-fcbe-4f9a-88f2-bd08ec6b3681 None None] MFA Rules not processed for user `6eb482fdb85c4e13b0a4218799a8a2f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:03.991977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9d46ec7d-fcbe-4f9a-88f2-bd08ec6b3681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:04.090191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:04.102445 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 820/1642] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:04.105119 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 823/1643] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:04.143537 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e9329-5b85-4dc2-9a94-5bc54cbd87bf None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:04.216729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e9329-5b85-4dc2-9a94-5bc54cbd87bf None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:04.240935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d01d87-0a62-4e7a-9676-5e5e7bc7d57e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:04.241683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d01d87-0a62-4e7a-9676-5e5e7bc7d57e service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:04.241966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d01d87-0a62-4e7a-9676-5e5e7bc7d57e service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:04.242240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d01d87-0a62-4e7a-9676-5e5e7bc7d57e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:04.276337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d01d87-0a62-4e7a-9676-5e5e7bc7d57e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:04.282069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d01d87-0a62-4e7a-9676-5e5e7bc7d57e service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:04.323077 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 821/1644] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:04.422720 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46ec7d-fcbe-4f9a-88f2-bd08ec6b3681 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:04.433839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46ec7d-fcbe-4f9a-88f2-bd08ec6b3681 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:04.438275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79660e66-939c-4410-a92f-173c7ecf6142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:04.440330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79660e66-939c-4410-a92f-173c7ecf6142 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:04.440638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79660e66-939c-4410-a92f-173c7ecf6142 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:04.440912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79660e66-939c-4410-a92f-173c7ecf6142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:04.458037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79660e66-939c-4410-a92f-173c7ecf6142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:04.460872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79660e66-939c-4410-a92f-173c7ecf6142 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:04.476205 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 824/1645] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:04.523045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d01d87-0a62-4e7a-9676-5e5e7bc7d57e service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:04.543516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d01d87-0a62-4e7a-9676-5e5e7bc7d57e service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:04.550486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ec4a3-1a73-43e4-95b1-1398b6b593f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:04.559542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ec4a3-1a73-43e4-95b1-1398b6b593f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:04.559542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ec4a3-1a73-43e4-95b1-1398b6b593f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:04.559542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ec4a3-1a73-43e4-95b1-1398b6b593f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:04.611202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ec4a3-1a73-43e4-95b1-1398b6b593f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:04.612640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ec4a3-1a73-43e4-95b1-1398b6b593f9 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:04.622021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 822/1646] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:05.517156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36023e1f-2872-40e2-9533-0dac88697670 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:05.517156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36023e1f-2872-40e2-9533-0dac88697670 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:05.517156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36023e1f-2872-40e2-9533-0dac88697670 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:05.517156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 825/1647] 10.222.0.48 () {54 vars in 962 bytes} [Tue Sep 13 03:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:30:05.537183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e88e9e-c802-4879-8d06-bb34b172e0b8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:05.538597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e88e9e-c802-4879-8d06-bb34b172e0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:05.539095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e88e9e-c802-4879-8d06-bb34b172e0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:05.605896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b8e88e9e-c802-4879-8d06-bb34b172e0b8 None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:05.607168 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b8e88e9e-c802-4879-8d06-bb34b172e0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:05.726994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:05.763445 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 823/1648] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Sep 13 03:30:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:05.764574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9183e-2906-47f0-8a91-bb11c2e6c26a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:05.764932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9183e-2906-47f0-8a91-bb11c2e6c26a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:05.765298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9183e-2906-47f0-8a91-bb11c2e6c26a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:05.767045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 826/1649] 10.222.0.48 () {54 vars in 912 bytes} [Tue Sep 13 03:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:30:05.779067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fed3ce-5079-4e8e-ab58-4e8cb2839775 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:05.779529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fed3ce-5079-4e8e-ab58-4e8cb2839775 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:05.780210 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fed3ce-5079-4e8e-ab58-4e8cb2839775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:05.809466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f8fed3ce-5079-4e8e-ab58-4e8cb2839775 None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:05.811352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f8fed3ce-5079-4e8e-ab58-4e8cb2839775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:05.833231 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 824/1650] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:30:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:05.952435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9183e-2906-47f0-8a91-bb11c2e6c26a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:05.969873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9183e-2906-47f0-8a91-bb11c2e6c26a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:05.976570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d65f9b-27e0-4b11-82b9-8031902ccd35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:05.977540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d65f9b-27e0-4b11-82b9-8031902ccd35 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:05.977821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d65f9b-27e0-4b11-82b9-8031902ccd35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:05.978094 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d65f9b-27e0-4b11-82b9-8031902ccd35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:05.991648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d65f9b-27e0-4b11-82b9-8031902ccd35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:05.993340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d65f9b-27e0-4b11-82b9-8031902ccd35 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:06.006702 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 827/1651] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:06.640377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fed3ce-5079-4e8e-ab58-4e8cb2839775 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:06.659760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d65f9b-27e0-4b11-82b9-8031902ccd35 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:06.667464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fed3ce-5079-4e8e-ab58-4e8cb2839775 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:06.685995 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd72e7-d55f-447e-8e65-8b4270c5e393 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb482fdb85c4e13b0a4218799a8a2f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '855a67c5e2ee4f30aa90d8acfac5dbab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:06.686591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd72e7-d55f-447e-8e65-8b4270c5e393 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:06.686877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd72e7-d55f-447e-8e65-8b4270c5e393 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:06.687155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd72e7-d55f-447e-8e65-8b4270c5e393 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:06.687817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd72e7-d55f-447e-8e65-8b4270c5e393 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:30:06.688122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd72e7-d55f-447e-8e65-8b4270c5e393 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:06.690331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd72e7-d55f-447e-8e65-8b4270c5e393 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:06.721765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 825/1652] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:30:06.723330 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd72e7-d55f-447e-8e65-8b4270c5e393 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:06.746340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd72e7-d55f-447e-8e65-8b4270c5e393 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:06.761023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15affcb8-1b86-467b-867e-b8c5f34d9e36 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb482fdb85c4e13b0a4218799a8a2f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '855a67c5e2ee4f30aa90d8acfac5dbab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:06.761195 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15affcb8-1b86-467b-867e-b8c5f34d9e36 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:06.761472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15affcb8-1b86-467b-867e-b8c5f34d9e36 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:06.761979 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15affcb8-1b86-467b-867e-b8c5f34d9e36 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:06.762641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15affcb8-1b86-467b-867e-b8c5f34d9e36 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:06.764601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15affcb8-1b86-467b-867e-b8c5f34d9e36 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:06.809063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d65f9b-27e0-4b11-82b9-8031902ccd35 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:06.834214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675b9ba-8492-49a8-bd8d-935389ad79ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:06.838083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675b9ba-8492-49a8-bd8d-935389ad79ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:06.838391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675b9ba-8492-49a8-bd8d-935389ad79ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:06.839784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675b9ba-8492-49a8-bd8d-935389ad79ff admin admin] PATH_INFO: `/v3/users/7b0af609d24e4cbb956bb0a0c02d2871` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:06.841976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675b9ba-8492-49a8-bd8d-935389ad79ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0af609d24e4cbb956bb0a0c02d2871)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:06.844300 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675b9ba-8492-49a8-bd8d-935389ad79ff admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:06.919527 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 826/1653] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:06 2022] POST /identity/v3/projects => generated 352 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:06.924387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15affcb8-1b86-467b-867e-b8c5f34d9e36 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:07.062825 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15affcb8-1b86-467b-867e-b8c5f34d9e36 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:07.069586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb11fc4-12cc-4220-97b7-cc27a163457e tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb482fdb85c4e13b0a4218799a8a2f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '855a67c5e2ee4f30aa90d8acfac5dbab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:07.070466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb11fc4-12cc-4220-97b7-cc27a163457e tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:07.070888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb11fc4-12cc-4220-97b7-cc27a163457e tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:07.076453 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb11fc4-12cc-4220-97b7-cc27a163457e tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:07.077625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb11fc4-12cc-4220-97b7-cc27a163457e tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:30:07.078097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb11fc4-12cc-4220-97b7-cc27a163457e tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:07.080069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb11fc4-12cc-4220-97b7-cc27a163457e tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:07.100989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 827/1654] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:30:07.216428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2675b9ba-8492-49a8-bd8d-935389ad79ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0af609d24e4cbb956bb0a0c02d2871'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:07.254618 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb11fc4-12cc-4220-97b7-cc27a163457e tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:07.272417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb11fc4-12cc-4220-97b7-cc27a163457e tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:07.282027 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb482fdb85c4e13b0a4218799a8a2f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '855a67c5e2ee4f30aa90d8acfac5dbab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:07.283701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:07.283701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:07.283902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] PATH_INFO: `/v3/projects/b732ecf3907f427eb626fbc86f1cd2c1` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:07.290815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b732ecf3907f427eb626fbc86f1cd2c1)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:07.292792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:07.347144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2675b9ba-8492-49a8-bd8d-935389ad79ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0af609d24e4cbb956bb0a0c02d2871'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:07.347928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2675b9ba-8492-49a8-bd8d-935389ad79ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0af609d24e4cbb956bb0a0c02d2871'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:07.348669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2675b9ba-8492-49a8-bd8d-935389ad79ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0af609d24e4cbb956bb0a0c02d2871'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:07.378016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2675b9ba-8492-49a8-bd8d-935389ad79ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0af609d24e4cbb956bb0a0c02d2871'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:07.422156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 828/1655] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:06 2022] DELETE /identity/v3/users/7b0af609d24e4cbb956bb0a0c02d2871 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:30:07.426731 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe142-9c40-420b-9b22-fcc3fc01eab4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:07.427141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe142-9c40-420b-9b22-fcc3fc01eab4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:07.427736 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe142-9c40-420b-9b22-fcc3fc01eab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:07.462543 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-133fe142-9c40-420b-9b22-fcc3fc01eab4 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:07.464376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-133fe142-9c40-420b-9b22-fcc3fc01eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:07.505902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b732ecf3907f427eb626fbc86f1cd2c1', 'request_id': 'req-066cbf6c-628b-4c00-acd5-8c1722bc2391'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:07.515108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b732ecf3907f427eb626fbc86f1cd2c1', 'request_id': 'req-066cbf6c-628b-4c00-acd5-8c1722bc2391'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:07.550695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:07.586199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 829/1656] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:07.605798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fe142-9c40-420b-9b22-fcc3fc01eab4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:07.607698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-133fe142-9c40-420b-9b22-fcc3fc01eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:07.617156 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b732ecf3907f427eb626fbc86f1cd2c1', 'request_id': 'req-066cbf6c-628b-4c00-acd5-8c1722bc2391'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:07.652739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] The token cache is being invalidate because project b732ecf3907f427eb626fbc86f1cd2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:07.654875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:07.655973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:07.659070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 828/1657] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:07 2022] DELETE /identity/v3/projects/b732ecf3907f427eb626fbc86f1cd2c1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:07.707617 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fe142-9c40-420b-9b22-fcc3fc01eab4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:07.785097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af897ae6-17ab-416a-85ff-488cb770816c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:07.785942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af897ae6-17ab-416a-85ff-488cb770816c service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:07.786351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af897ae6-17ab-416a-85ff-488cb770816c service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:07.786721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af897ae6-17ab-416a-85ff-488cb770816c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:07.788799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-af897ae6-17ab-416a-85ff-488cb770816c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:07.970549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af897ae6-17ab-416a-85ff-488cb770816c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:07.975113 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af897ae6-17ab-416a-85ff-488cb770816c service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:08.019554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 830/1658] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:09.078999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:09.080883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:09.106834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cbf6c-628b-4c00-acd5-8c1722bc2391 tempest-VolumeQuotaClassesTest-1568550413 tempest-VolumeQuotaClassesTest-1568550413-project-admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:09.127209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:09.127950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:09.129097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:09.129545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] PATH_INFO: `/v3/users/6357a9d1f8b546249448ec2ae7196bda` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:09.137444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6357a9d1f8b546249448ec2ae7196bda)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:09.144516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:30:09.144516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 13 03:30:09.144516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: Sep 13 03:30:09.145920 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:09.194416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:09.522869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6357a9d1f8b546249448ec2ae7196bda'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:09.523567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6357a9d1f8b546249448ec2ae7196bda'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:09.524180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6357a9d1f8b546249448ec2ae7196bda'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:09.553752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6357a9d1f8b546249448ec2ae7196bda'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:09.593122 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6357a9d1f8b546249448ec2ae7196bda'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:09.678442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 829/1659] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:09 2022] DELETE /identity/v3/users/6357a9d1f8b546249448ec2ae7196bda => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:09.683757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe217653-ab66-45fc-a324-910b2d5cd95d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:09.684289 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe217653-ab66-45fc-a324-910b2d5cd95d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:09.684442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe217653-ab66-45fc-a324-910b2d5cd95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:09.717874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fe217653-ab66-45fc-a324-910b2d5cd95d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:09.722365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fe217653-ab66-45fc-a324-910b2d5cd95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:09.850205 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:09.864305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 831/1660] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:09.894556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:09.898548 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:10.043467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90112231-2b8d-4303-ab9e-cd9f7d421311 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:10.053045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d734bb-cbb9-4ae8-a72d-43cda8059aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:10.054903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d734bb-cbb9-4ae8-a72d-43cda8059aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:10.056073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d734bb-cbb9-4ae8-a72d-43cda8059aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:10.060368 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d734bb-cbb9-4ae8-a72d-43cda8059aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:10.096459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d734bb-cbb9-4ae8-a72d-43cda8059aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:10.099973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d734bb-cbb9-4ae8-a72d-43cda8059aa7 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:10.133344 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 830/1661] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:30:10.503717 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe217653-ab66-45fc-a324-910b2d5cd95d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:10.516403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fe217653-ab66-45fc-a324-910b2d5cd95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:10.543139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe217653-ab66-45fc-a324-910b2d5cd95d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:10.557523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:10.557523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:10.557523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:10.557523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] PATH_INFO: `/v3/projects/878aabdec4dd481ab783248280b97225` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:10.560569 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=878aabdec4dd481ab783248280b97225)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:10.561577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 03:30:10.561577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 13 03:30:10.561577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: Sep 13 03:30:10.562974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:10.836450 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '878aabdec4dd481ab783248280b97225', 'request_id': 'req-65e163db-5250-478e-a0f2-efd321cd2a35'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:10.863997 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '878aabdec4dd481ab783248280b97225', 'request_id': 'req-65e163db-5250-478e-a0f2-efd321cd2a35'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:10.934888 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '878aabdec4dd481ab783248280b97225', 'request_id': 'req-65e163db-5250-478e-a0f2-efd321cd2a35'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:10.956924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] The token cache is being invalidate because project 878aabdec4dd481ab783248280b97225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:10.957760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:10.960139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:10.962887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 832/1662] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:10 2022] DELETE /identity/v3/projects/878aabdec4dd481ab783248280b97225 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:10.968870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d734bb-cbb9-4ae8-a72d-43cda8059aa7 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:10.996792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d734bb-cbb9-4ae8-a72d-43cda8059aa7 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:11.142937 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:11.145185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:11.145185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:11.145185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] PATH_INFO: `/v3/users/ab531a4de8a245e6b0ac1e3ab95e36f2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:11.149725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab531a4de8a245e6b0ac1e3ab95e36f2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:11.154745 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:11.420179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:11.428798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:11.431759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:11.476005 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e163db-5250-478e-a0f2-efd321cd2a35 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:11.477768 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab531a4de8a245e6b0ac1e3ab95e36f2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:11.478530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab531a4de8a245e6b0ac1e3ab95e36f2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:11.479190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab531a4de8a245e6b0ac1e3ab95e36f2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:11.489970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab531a4de8a245e6b0ac1e3ab95e36f2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:11.490813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25e264-42af-439b-8885-d4ba6a044b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:11.491461 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25e264-42af-439b-8885-d4ba6a044b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:11.491740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25e264-42af-439b-8885-d4ba6a044b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:11.492010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25e264-42af-439b-8885-d4ba6a044b5e admin admin] PATH_INFO: `/v3/projects/0665f64976134cc3a1d9ef1aaf7675b7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:11.494548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25e264-42af-439b-8885-d4ba6a044b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0665f64976134cc3a1d9ef1aaf7675b7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:11.496752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25e264-42af-439b-8885-d4ba6a044b5e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:11.506810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab531a4de8a245e6b0ac1e3ab95e36f2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:11.590041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 831/1663] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:10 2022] DELETE /identity/v3/users/ab531a4de8a245e6b0ac1e3ab95e36f2 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:11.675874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dc25e264-42af-439b-8885-d4ba6a044b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0665f64976134cc3a1d9ef1aaf7675b7', 'request_id': 'req-dc25e264-42af-439b-8885-d4ba6a044b5e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:11.690510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dc25e264-42af-439b-8885-d4ba6a044b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0665f64976134cc3a1d9ef1aaf7675b7', 'request_id': 'req-dc25e264-42af-439b-8885-d4ba6a044b5e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:11.815024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dc25e264-42af-439b-8885-d4ba6a044b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0665f64976134cc3a1d9ef1aaf7675b7', 'request_id': 'req-dc25e264-42af-439b-8885-d4ba6a044b5e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:11.835793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dc25e264-42af-439b-8885-d4ba6a044b5e admin admin] The token cache is being invalidate because project 0665f64976134cc3a1d9ef1aaf7675b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:11.836118 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dc25e264-42af-439b-8885-d4ba6a044b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:11.838758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dc25e264-42af-439b-8885-d4ba6a044b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:11.841828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 833/1664] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:11 2022] DELETE /identity/v3/projects/0665f64976134cc3a1d9ef1aaf7675b7 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:11.850128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:11.852124 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:12.096751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35575866-165a-4c5a-a27b-e78f63d38b6a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:12.248664 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:12.249335 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:12.251949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:12.252361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] PATH_INFO: `/v3/users/6eb482fdb85c4e13b0a4218799a8a2f0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:12.256922 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb482fdb85c4e13b0a4218799a8a2f0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:12.259205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:12.512036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb482fdb85c4e13b0a4218799a8a2f0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:12.518863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb482fdb85c4e13b0a4218799a8a2f0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:12.518863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb482fdb85c4e13b0a4218799a8a2f0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:12.529201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb482fdb85c4e13b0a4218799a8a2f0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:12.551635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb482fdb85c4e13b0a4218799a8a2f0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:12.655503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ad4fa-599a-4ad7-be28-864ef9aa75e3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:12.655777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ad4fa-599a-4ad7-be28-864ef9aa75e3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:12.656052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ad4fa-599a-4ad7-be28-864ef9aa75e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:12.668074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 832/1665] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:11 2022] DELETE /identity/v3/users/6eb482fdb85c4e13b0a4218799a8a2f0 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:12.748478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c11ad4fa-599a-4ad7-be28-864ef9aa75e3 None None] MFA Rules not processed for user `9f181af31fb245bba4158e89e58704d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:12.749827 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c11ad4fa-599a-4ad7-be28-864ef9aa75e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:12.771090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:12.775076 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:12.907350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:12.920198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa4bd4-b6e6-4d6e-9d96-24dda53aadc5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:12.928317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a39c1-9f92-4d13-a0af-09400b571f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:12.929418 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a39c1-9f92-4d13-a0af-09400b571f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:12.929842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a39c1-9f92-4d13-a0af-09400b571f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:12.930254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a39c1-9f92-4d13-a0af-09400b571f66 admin admin] PATH_INFO: `/v3/projects/2c73d7296e85466a834261d255017c68` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:12.931683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a39c1-9f92-4d13-a0af-09400b571f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c73d7296e85466a834261d255017c68)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:12.938026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a39c1-9f92-4d13-a0af-09400b571f66 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:12.955224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 834/1666] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:12.956714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b85643-4684-41bb-8bef-03a3b00e7551 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:12.957008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b85643-4684-41bb-8bef-03a3b00e7551 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:12.957308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b85643-4684-41bb-8bef-03a3b00e7551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:12.993466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-95b85643-4684-41bb-8bef-03a3b00e7551 None None] MFA Rules not processed for user `9f181af31fb245bba4158e89e58704d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:12.996485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-95b85643-4684-41bb-8bef-03a3b00e7551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:13.015699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 835/1667] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:13.029180 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b85643-4684-41bb-8bef-03a3b00e7551 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:13.031613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-95b85643-4684-41bb-8bef-03a3b00e7551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:13.092533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3b7a39c1-9f92-4d13-a0af-09400b571f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c73d7296e85466a834261d255017c68', 'request_id': 'req-3b7a39c1-9f92-4d13-a0af-09400b571f66'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:13.124688 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3b7a39c1-9f92-4d13-a0af-09400b571f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c73d7296e85466a834261d255017c68', 'request_id': 'req-3b7a39c1-9f92-4d13-a0af-09400b571f66'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:13.193170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b85643-4684-41bb-8bef-03a3b00e7551 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:13.239164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3b7a39c1-9f92-4d13-a0af-09400b571f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c73d7296e85466a834261d255017c68', 'request_id': 'req-3b7a39c1-9f92-4d13-a0af-09400b571f66'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:13.276812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3b7a39c1-9f92-4d13-a0af-09400b571f66 admin admin] The token cache is being invalidate because project 2c73d7296e85466a834261d255017c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:13.277777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3b7a39c1-9f92-4d13-a0af-09400b571f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:13.278794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3b7a39c1-9f92-4d13-a0af-09400b571f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:13.281611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 833/1668] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:12 2022] DELETE /identity/v3/projects/2c73d7296e85466a834261d255017c68 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:30:13.289345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f9a1-3132-4852-b7ec-7c91daec26f5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:13.289636 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f9a1-3132-4852-b7ec-7c91daec26f5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:13.289915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f9a1-3132-4852-b7ec-7c91daec26f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:13.342420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-59c8f9a1-3132-4852-b7ec-7c91daec26f5 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:13.343634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-59c8f9a1-3132-4852-b7ec-7c91daec26f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:13.414584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0a4da-1362-48d9-83da-8e1f00099267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:13.417946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a4da-1362-48d9-83da-8e1f00099267 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:13.418236 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a4da-1362-48d9-83da-8e1f00099267 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:13.418516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0a4da-1362-48d9-83da-8e1f00099267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:13.424832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f1c0a4da-1362-48d9-83da-8e1f00099267 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:13.467790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:13.500211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 834/1669] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:13.500211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8f9a1-3132-4852-b7ec-7c91daec26f5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:13.500211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-59c8f9a1-3132-4852-b7ec-7c91daec26f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:13.550668 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8f9a1-3132-4852-b7ec-7c91daec26f5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:13.568752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416eef1-279d-4083-b931-d1f0abc404ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:13.569743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416eef1-279d-4083-b931-d1f0abc404ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:13.570529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416eef1-279d-4083-b931-d1f0abc404ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:13.571159 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416eef1-279d-4083-b931-d1f0abc404ed admin admin] PATH_INFO: `/v3/users/229f111cbc87457c9b66ef69b6cff365` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:13.573076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0a4da-1362-48d9-83da-8e1f00099267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:13.574249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416eef1-279d-4083-b931-d1f0abc404ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=229f111cbc87457c9b66ef69b6cff365)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:13.574764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0a4da-1362-48d9-83da-8e1f00099267 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:13.577449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416eef1-279d-4083-b931-d1f0abc404ed admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:13.588980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 836/1670] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:30:13.592845 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620868a8-f5aa-4047-b74f-1a3d0d583d8e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:13.593124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620868a8-f5aa-4047-b74f-1a3d0d583d8e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:13.593805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620868a8-f5aa-4047-b74f-1a3d0d583d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:13.656538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-620868a8-f5aa-4047-b74f-1a3d0d583d8e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:13.657863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-620868a8-f5aa-4047-b74f-1a3d0d583d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:13.680129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 837/1671] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:13.684000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620868a8-f5aa-4047-b74f-1a3d0d583d8e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:13.685417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-620868a8-f5aa-4047-b74f-1a3d0d583d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:13.717074 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620868a8-f5aa-4047-b74f-1a3d0d583d8e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:13.732340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:13.733199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:13.733636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:13.734035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] PATH_INFO: `/v3/projects/855a67c5e2ee4f30aa90d8acfac5dbab` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:13.735447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855a67c5e2ee4f30aa90d8acfac5dbab)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:13.737594 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:13.919249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6416eef1-279d-4083-b931-d1f0abc404ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229f111cbc87457c9b66ef69b6cff365'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:13.920008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6416eef1-279d-4083-b931-d1f0abc404ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229f111cbc87457c9b66ef69b6cff365'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:13.920628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6416eef1-279d-4083-b931-d1f0abc404ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229f111cbc87457c9b66ef69b6cff365'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:13.927513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855a67c5e2ee4f30aa90d8acfac5dbab', 'request_id': 'req-f984481c-6481-4d82-8118-132c28c36b33'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:13.939584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855a67c5e2ee4f30aa90d8acfac5dbab', 'request_id': 'req-f984481c-6481-4d82-8118-132c28c36b33'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:13.942143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6416eef1-279d-4083-b931-d1f0abc404ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229f111cbc87457c9b66ef69b6cff365'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:14.000152 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6416eef1-279d-4083-b931-d1f0abc404ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229f111cbc87457c9b66ef69b6cff365'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:14.020409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855a67c5e2ee4f30aa90d8acfac5dbab', 'request_id': 'req-f984481c-6481-4d82-8118-132c28c36b33'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:14.039129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] The token cache is being invalidate because project 855a67c5e2ee4f30aa90d8acfac5dbab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:14.039627 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:14.042387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:14.046524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 838/1672] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:13 2022] DELETE /identity/v3/projects/855a67c5e2ee4f30aa90d8acfac5dbab => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:14.050782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:14.052899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:14.101992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 835/1673] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:13 2022] DELETE /identity/v3/users/229f111cbc87457c9b66ef69b6cff365 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:14.103529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfe11d-592b-4ab6-b87e-9293297ec12a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:14.103983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfe11d-592b-4ab6-b87e-9293297ec12a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:14.104412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfe11d-592b-4ab6-b87e-9293297ec12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:14.168521 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-56bfe11d-592b-4ab6-b87e-9293297ec12a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:14.172491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-56bfe11d-592b-4ab6-b87e-9293297ec12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:14.268918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984481c-6481-4d82-8118-132c28c36b33 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:14.346267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 836/1674] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:14.346267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953d81e-0f30-4d01-9e4b-98f2747275eb None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:14.346267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953d81e-0f30-4d01-9e4b-98f2747275eb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:14.346267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953d81e-0f30-4d01-9e4b-98f2747275eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:14.387879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5953d81e-0f30-4d01-9e4b-98f2747275eb None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:14.389201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5953d81e-0f30-4d01-9e4b-98f2747275eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:14.422337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 837/1675] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:14.424502 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41711920-3310-4152-a320-2000d1e6b353 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:14.426696 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41711920-3310-4152-a320-2000d1e6b353 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:14.427238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41711920-3310-4152-a320-2000d1e6b353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:14.445878 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6992f-12cf-44d9-8f94-de4aee71e464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:14.449504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6992f-12cf-44d9-8f94-de4aee71e464 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:14.449504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6992f-12cf-44d9-8f94-de4aee71e464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:14.449504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6992f-12cf-44d9-8f94-de4aee71e464 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:14.449504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6992f-12cf-44d9-8f94-de4aee71e464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:30:14.449504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6992f-12cf-44d9-8f94-de4aee71e464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:14.455826 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6992f-12cf-44d9-8f94-de4aee71e464 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:14.484736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-41711920-3310-4152-a320-2000d1e6b353 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:14.489803 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-41711920-3310-4152-a320-2000d1e6b353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:14.496263 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 839/1676] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:30:14.500826 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6992f-12cf-44d9-8f94-de4aee71e464 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:14.516492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 838/1677] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:14.519148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41711920-3310-4152-a320-2000d1e6b353 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:14.520603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-41711920-3310-4152-a320-2000d1e6b353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:14.531053 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6992f-12cf-44d9-8f94-de4aee71e464 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:14.556114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0e60c-d8b5-44c0-a528-3a11c04920ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:14.558056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0e60c-d8b5-44c0-a528-3a11c04920ab admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:14.558491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0e60c-d8b5-44c0-a528-3a11c04920ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:14.558593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0e60c-d8b5-44c0-a528-3a11c04920ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:14.562174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0e60c-d8b5-44c0-a528-3a11c04920ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:14.566400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0e60c-d8b5-44c0-a528-3a11c04920ab admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:14.664013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:14.684463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41711920-3310-4152-a320-2000d1e6b353 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:14.690530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faaccd-4296-4ab8-8881-04b552995d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:14.693424 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faaccd-4296-4ab8-8881-04b552995d96 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:14.693728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faaccd-4296-4ab8-8881-04b552995d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:14.694057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faaccd-4296-4ab8-8881-04b552995d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:14.719485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 840/1678] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:14 2022] POST /identity/v3/projects => generated 355 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:14.722210 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0e60c-d8b5-44c0-a528-3a11c04920ab admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:14.749190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1faaccd-4296-4ab8-8881-04b552995d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:14.757612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1faaccd-4296-4ab8-8881-04b552995d96 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:14.824004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 839/1679] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:14.828494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faaccd-4296-4ab8-8881-04b552995d96 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:14.884019 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faaccd-4296-4ab8-8881-04b552995d96 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:14.931501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0e60c-d8b5-44c0-a528-3a11c04920ab admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:14.943913 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98074f-fc3f-4f7f-8288-c8dd972db247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:14.945882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98074f-fc3f-4f7f-8288-c8dd972db247 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:14.946165 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98074f-fc3f-4f7f-8288-c8dd972db247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:14.947653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98074f-fc3f-4f7f-8288-c8dd972db247 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:14.947911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98074f-fc3f-4f7f-8288-c8dd972db247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:30:14.948214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98074f-fc3f-4f7f-8288-c8dd972db247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:14.953722 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98074f-fc3f-4f7f-8288-c8dd972db247 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:14.987317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 841/1680] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:30:14.988048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e40f2-1338-4ab9-8d5d-ee89f2a6fd5b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:14.990455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e40f2-1338-4ab9-8d5d-ee89f2a6fd5b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:14.990771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e40f2-1338-4ab9-8d5d-ee89f2a6fd5b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:14.995371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 842/1681] 10.222.0.48 () {54 vars in 912 bytes} [Tue Sep 13 03:30:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:30:14.996385 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e40f2-1338-4ab9-8d5d-ee89f2a6fd5b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:15.028784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e40f2-1338-4ab9-8d5d-ee89f2a6fd5b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:15.035760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b27d4-bdd3-4c61-8c30-eafc40473725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:15.036743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b27d4-bdd3-4c61-8c30-eafc40473725 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:15.037363 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b27d4-bdd3-4c61-8c30-eafc40473725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:15.037577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b27d4-bdd3-4c61-8c30-eafc40473725 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:15.038341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b27d4-bdd3-4c61-8c30-eafc40473725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:15.040575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b27d4-bdd3-4c61-8c30-eafc40473725 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:15.051114 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e76a6-bc67-4c5a-8158-496f90ab7b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:15.052100 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e76a6-bc67-4c5a-8158-496f90ab7b9b admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:15.052383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e76a6-bc67-4c5a-8158-496f90ab7b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:15.052714 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e76a6-bc67-4c5a-8158-496f90ab7b9b admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:15.053938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e76a6-bc67-4c5a-8158-496f90ab7b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:15.061616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e76a6-bc67-4c5a-8158-496f90ab7b9b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:15.094375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:15.165861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 843/1682] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:14 2022] POST /identity/v3/projects => generated 401 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:15.178664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92624546-4c34-499a-9127-b8c08cda8f45 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:15.179991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92624546-4c34-499a-9127-b8c08cda8f45 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:15.180281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92624546-4c34-499a-9127-b8c08cda8f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:15.199425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 840/1683] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:14 2022] POST /identity/v3/users => generated 278 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:15.199425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e76a6-bc67-4c5a-8158-496f90ab7b9b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:15.226296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e76a6-bc67-4c5a-8158-496f90ab7b9b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:15.254710 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:15.293784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-92624546-4c34-499a-9127-b8c08cda8f45 None None] MFA Rules not processed for user `5bb4ef26660244ce90b0105113e252b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:15.296643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-92624546-4c34-499a-9127-b8c08cda8f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:15.464224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3c7a0-5ff5-41b1-bf04-a9db981ac45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:15.465970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3c7a0-5ff5-41b1-bf04-a9db981ac45f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:15.467485 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3c7a0-5ff5-41b1-bf04-a9db981ac45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:15.467956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3c7a0-5ff5-41b1-bf04-a9db981ac45f admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:15.469915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3c7a0-5ff5-41b1-bf04-a9db981ac45f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:15.470989 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 844/1684] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:30:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:15.472692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92624546-4c34-499a-9127-b8c08cda8f45 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:15.474941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3c7a0-5ff5-41b1-bf04-a9db981ac45f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:15.522676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92624546-4c34-499a-9127-b8c08cda8f45 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:15.532819 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7432a0-c9a3-42fe-833a-3f6e0e1c5b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:15.533789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7432a0-c9a3-42fe-833a-3f6e0e1c5b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:15.534457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7432a0-c9a3-42fe-833a-3f6e0e1c5b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:15.534900 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7432a0-c9a3-42fe-833a-3f6e0e1c5b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:15.535795 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7432a0-c9a3-42fe-833a-3f6e0e1c5b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:15.538389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7432a0-c9a3-42fe-833a-3f6e0e1c5b87 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:15.555999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 845/1685] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:15.556909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7432a0-c9a3-42fe-833a-3f6e0e1c5b87 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:15.600344 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7432a0-c9a3-42fe-833a-3f6e0e1c5b87 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:15.608758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 841/1686] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:15 2022] POST /identity/v3/users => generated 301 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:15.610048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3c7a0-5ff5-41b1-bf04-a9db981ac45f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:15.614066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b66b6-83a2-4015-993f-06903655d20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:15.619057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b66b6-83a2-4015-993f-06903655d20e service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:15.619428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b66b6-83a2-4015-993f-06903655d20e service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:15.619706 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b66b6-83a2-4015-993f-06903655d20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:15.641605 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b66b6-83a2-4015-993f-06903655d20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:15.643774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b66b6-83a2-4015-993f-06903655d20e service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:15.664460 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3c7a0-5ff5-41b1-bf04-a9db981ac45f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:15.666902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 846/1687] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:15.668857 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b66b6-83a2-4015-993f-06903655d20e service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:15.674604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e61b66b6-83a2-4015-993f-06903655d20e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:15.684614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fd20b-f0a4-4446-906a-72e39da12bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:15.685777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fd20b-f0a4-4446-906a-72e39da12bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:15.686055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fd20b-f0a4-4446-906a-72e39da12bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:15.686433 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fd20b-f0a4-4446-906a-72e39da12bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:15.687102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fd20b-f0a4-4446-906a-72e39da12bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:15.690412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fd20b-f0a4-4446-906a-72e39da12bcb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:15.719811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b66b6-83a2-4015-993f-06903655d20e service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:15.724260 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 842/1688] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:15.728616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fd20b-f0a4-4446-906a-72e39da12bcb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:15.736078 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43e559-74c1-4f0a-be8a-2679dc5495fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:15.736669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43e559-74c1-4f0a-be8a-2679dc5495fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:15.736933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43e559-74c1-4f0a-be8a-2679dc5495fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:15.737215 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43e559-74c1-4f0a-be8a-2679dc5495fa admin admin] PATH_INFO: `/v3/projects/754ff09d6f454f6eb28e741830a68d2c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:15.742210 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43e559-74c1-4f0a-be8a-2679dc5495fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=754ff09d6f454f6eb28e741830a68d2c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:15.748689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43e559-74c1-4f0a-be8a-2679dc5495fa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:15.753756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fd20b-f0a4-4446-906a-72e39da12bcb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:15.766505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacd663-e163-4c92-8757-1957526b5614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:15.767067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacd663-e163-4c92-8757-1957526b5614 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:15.767299 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacd663-e163-4c92-8757-1957526b5614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:15.767635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacd663-e163-4c92-8757-1957526b5614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:15.768642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacd663-e163-4c92-8757-1957526b5614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:15.774090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacd663-e163-4c92-8757-1957526b5614 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:15.814409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 843/1689] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:15.821091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacd663-e163-4c92-8757-1957526b5614 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:15.857757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacd663-e163-4c92-8757-1957526b5614 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:15.879693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e186c0e-ebbf-4655-b1a8-7cbb4816f855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:15.880530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e186c0e-ebbf-4655-b1a8-7cbb4816f855 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:15.880829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e186c0e-ebbf-4655-b1a8-7cbb4816f855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:15.881579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e186c0e-ebbf-4655-b1a8-7cbb4816f855 admin admin] PATH_INFO: `/v3/projects/75ff5270123943fe8cabc435a7d7595f/users/6bb2a3c9e07a4483972b45a0a8a1822c/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:15.943812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e186c0e-ebbf-4655-b1a8-7cbb4816f855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ff5270123943fe8cabc435a7d7595f, user_id=6bb2a3c9e07a4483972b45a0a8a1822c, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:15.953349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e186c0e-ebbf-4655-b1a8-7cbb4816f855 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:15.966926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0c43e559-74c1-4f0a-be8a-2679dc5495fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754ff09d6f454f6eb28e741830a68d2c', 'request_id': 'req-0c43e559-74c1-4f0a-be8a-2679dc5495fa'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:15.997081 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0c43e559-74c1-4f0a-be8a-2679dc5495fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754ff09d6f454f6eb28e741830a68d2c', 'request_id': 'req-0c43e559-74c1-4f0a-be8a-2679dc5495fa'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:16.103307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 844/1690] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:15 2022] PUT /identity/v3/projects/75ff5270123943fe8cabc435a7d7595f/users/6bb2a3c9e07a4483972b45a0a8a1822c/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:16.104971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e186c0e-ebbf-4655-b1a8-7cbb4816f855 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:16.113435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0c43e559-74c1-4f0a-be8a-2679dc5495fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754ff09d6f454f6eb28e741830a68d2c', 'request_id': 'req-0c43e559-74c1-4f0a-be8a-2679dc5495fa'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:16.131930 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0c43e559-74c1-4f0a-be8a-2679dc5495fa admin admin] The token cache is being invalidate because project 754ff09d6f454f6eb28e741830a68d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:16.132442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0c43e559-74c1-4f0a-be8a-2679dc5495fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:16.133626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0c43e559-74c1-4f0a-be8a-2679dc5495fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:16.142947 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 847/1691] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:15 2022] DELETE /identity/v3/projects/754ff09d6f454f6eb28e741830a68d2c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:16.146271 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ecbd-9cda-4b42-8481-c75d6638b482 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:16.147270 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ecbd-9cda-4b42-8481-c75d6638b482 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:16.148447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ecbd-9cda-4b42-8481-c75d6638b482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:16.225535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-06a1ecbd-9cda-4b42-8481-c75d6638b482 None None] MFA Rules not processed for user `6bb2a3c9e07a4483972b45a0a8a1822c`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:16.229043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-06a1ecbd-9cda-4b42-8481-c75d6638b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:16.300396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e186c0e-ebbf-4655-b1a8-7cbb4816f855 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:16.306975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c6af5-960c-4adc-bc5f-ed9322eced35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:16.307593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c6af5-960c-4adc-bc5f-ed9322eced35 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:16.307882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c6af5-960c-4adc-bc5f-ed9322eced35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:16.309466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c6af5-960c-4adc-bc5f-ed9322eced35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:16.312324 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c6af5-960c-4adc-bc5f-ed9322eced35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:16.321108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c6af5-960c-4adc-bc5f-ed9322eced35 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:16.334785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 845/1692] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:16.336541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8a347-d0fd-490c-9b73-cee38db45991 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:16.337046 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8a347-d0fd-490c-9b73-cee38db45991 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:16.337737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8a347-d0fd-490c-9b73-cee38db45991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:16.369621 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-36d8a347-d0fd-490c-9b73-cee38db45991 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:16.372054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-36d8a347-d0fd-490c-9b73-cee38db45991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:16.395979 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 846/1693] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:16.397234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8a347-d0fd-490c-9b73-cee38db45991 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:16.399292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-36d8a347-d0fd-490c-9b73-cee38db45991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:16.441961 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8a347-d0fd-490c-9b73-cee38db45991 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:16.448275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 848/1694] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:16.457408 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f956ea-47a3-46a5-8965-c9e6b4daf3f7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:16.458695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f956ea-47a3-46a5-8965-c9e6b4daf3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:16.460491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f956ea-47a3-46a5-8965-c9e6b4daf3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:16.464211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7c2e8-04c0-47d8-b1f5-f872aa4e6d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:16.466666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c2e8-04c0-47d8-b1f5-f872aa4e6d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:16.471130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c2e8-04c0-47d8-b1f5-f872aa4e6d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:16.471517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c2e8-04c0-47d8-b1f5-f872aa4e6d1a admin admin] PATH_INFO: `/v3/projects/ba63f5e0447142c9bd911c1b37023d8e/users/67274f52f88f4a238ede9c6270f8c7b9/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:16.531698 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7c2e8-04c0-47d8-b1f5-f872aa4e6d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba63f5e0447142c9bd911c1b37023d8e, user_id=67274f52f88f4a238ede9c6270f8c7b9, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:16.540405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7c2e8-04c0-47d8-b1f5-f872aa4e6d1a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:16.546986 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-34f956ea-47a3-46a5-8965-c9e6b4daf3f7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:16.552140 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-34f956ea-47a3-46a5-8965-c9e6b4daf3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:16.592797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 849/1695] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:16.592797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f956ea-47a3-46a5-8965-c9e6b4daf3f7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:16.598272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-34f956ea-47a3-46a5-8965-c9e6b4daf3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:16.661539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f956ea-47a3-46a5-8965-c9e6b4daf3f7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:16.663799 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 847/1696] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:16 2022] PUT /identity/v3/projects/ba63f5e0447142c9bd911c1b37023d8e/users/67274f52f88f4a238ede9c6270f8c7b9/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:16.667608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7c2e8-04c0-47d8-b1f5-f872aa4e6d1a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:16.900621 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7c2e8-04c0-47d8-b1f5-f872aa4e6d1a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:16.913531 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1fd30-97e1-41ea-8d60-814ca0793afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:16.916340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1fd30-97e1-41ea-8d60-814ca0793afd admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:16.916477 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1fd30-97e1-41ea-8d60-814ca0793afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:16.917631 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1fd30-97e1-41ea-8d60-814ca0793afd admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:16.920118 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1fd30-97e1-41ea-8d60-814ca0793afd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:30:16.921341 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1fd30-97e1-41ea-8d60-814ca0793afd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:16.925515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1fd30-97e1-41ea-8d60-814ca0793afd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:16.956377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:16.975224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 848/1697] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:30:16.975224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f573d0-31cc-42f8-ac44-983784d67727 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:16.976231 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f573d0-31cc-42f8-ac44-983784d67727 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:16.977035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f573d0-31cc-42f8-ac44-983784d67727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:17.000121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bde19-a5c7-4313-8e1a-13622592f2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:17.006677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bde19-a5c7-4313-8e1a-13622592f2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:17.006912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bde19-a5c7-4313-8e1a-13622592f2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:17.007188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bde19-a5c7-4313-8e1a-13622592f2f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:17.007856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bde19-a5c7-4313-8e1a-13622592f2f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:17.009845 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bde19-a5c7-4313-8e1a-13622592f2f4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:17.038776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:17.199100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 850/1698] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:16 2022] POST /identity/v3/projects => generated 357 bytes in 608 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:17.200152 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bde19-a5c7-4313-8e1a-13622592f2f4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:17.214956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-22f573d0-31cc-42f8-ac44-983784d67727 None None] MFA Rules not processed for user `67274f52f88f4a238ede9c6270f8c7b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:17.217809 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-22f573d0-31cc-42f8-ac44-983784d67727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:17.469055 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bde19-a5c7-4313-8e1a-13622592f2f4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:17.471530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 849/1699] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:16 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:17.472700 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f573d0-31cc-42f8-ac44-983784d67727 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:17.477116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22f5b1-ff11-4f9f-9db2-22bce02135c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:17.505292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f573d0-31cc-42f8-ac44-983784d67727 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:17.522789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaf505-9067-4b68-9d93-71a69f8b8a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:17.524630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaf505-9067-4b68-9d93-71a69f8b8a56 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:17.525718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaf505-9067-4b68-9d93-71a69f8b8a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:17.526573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaf505-9067-4b68-9d93-71a69f8b8a56 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:17.528538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eaf505-9067-4b68-9d93-71a69f8b8a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:17.532485 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eaf505-9067-4b68-9d93-71a69f8b8a56 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:17.534147 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22f5b1-ff11-4f9f-9db2-22bce02135c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:17.534439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22f5b1-ff11-4f9f-9db2-22bce02135c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:17.537781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22f5b1-ff11-4f9f-9db2-22bce02135c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:17.537781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22f5b1-ff11-4f9f-9db2-22bce02135c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:17.560085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22f5b1-ff11-4f9f-9db2-22bce02135c7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:17.682056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 850/1700] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:17 2022] POST /identity/v3/users => generated 285 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:17.683250 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaf505-9067-4b68-9d93-71a69f8b8a56 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:17.685821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d7eaf505-9067-4b68-9d93-71a69f8b8a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:17.714465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaf505-9067-4b68-9d93-71a69f8b8a56 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:17.726919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 851/1701] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:17 2022] POST /identity/v3/projects => generated 367 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:17.728134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22f5b1-ff11-4f9f-9db2-22bce02135c7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:17.729437 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:17.730248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:17.730535 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:17.730810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] PATH_INFO: `/v3/users/76119e4c14a84e8cacfe80ebb1e07031` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:17.734478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76119e4c14a84e8cacfe80ebb1e07031)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:17.744549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dc22f5b1-ff11-4f9f-9db2-22bce02135c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:17.744695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:17.917402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22f5b1-ff11-4f9f-9db2-22bce02135c7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:17.927988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d21435-f2b3-4373-9850-4c29c42e9d85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261a9485c3b4d2aa657a931e0388389', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:17.928918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d21435-f2b3-4373-9850-4c29c42e9d85 service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:17.929320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d21435-f2b3-4373-9850-4c29c42e9d85 service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:17.929695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d21435-f2b3-4373-9850-4c29c42e9d85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:17.933120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-26d21435-f2b3-4373-9850-4c29c42e9d85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:17.940520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76119e4c14a84e8cacfe80ebb1e07031'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:17.941402 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76119e4c14a84e8cacfe80ebb1e07031'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:17.942030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76119e4c14a84e8cacfe80ebb1e07031'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:17.957018 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76119e4c14a84e8cacfe80ebb1e07031'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:17.961522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d21435-f2b3-4373-9850-4c29c42e9d85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:17.963246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d21435-f2b3-4373-9850-4c29c42e9d85 service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:17.982639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76119e4c14a84e8cacfe80ebb1e07031'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:17.988141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 852/1702] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:17.991218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d21435-f2b3-4373-9850-4c29c42e9d85 service placement] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:18.068581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 851/1703] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:17 2022] DELETE /identity/v3/users/76119e4c14a84e8cacfe80ebb1e07031 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:18.068581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:18.069515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:18.155173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d21435-f2b3-4373-9850-4c29c42e9d85 service placement] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:18.244519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a6d93-e699-4fed-9cb4-c53bc4cf0c82 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:18.260560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b3046-5d06-461e-aae1-414fdff85a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:18.264504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b3046-5d06-461e-aae1-414fdff85a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:18.267640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b3046-5d06-461e-aae1-414fdff85a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:18.267640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b3046-5d06-461e-aae1-414fdff85a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:18.268165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b3046-5d06-461e-aae1-414fdff85a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:18.270266 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b3046-5d06-461e-aae1-414fdff85a85 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:18.301626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 852/1704] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:18.302752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b3046-5d06-461e-aae1-414fdff85a85 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:18.311129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-123b3046-5d06-461e-aae1-414fdff85a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:18.339982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b3046-5d06-461e-aae1-414fdff85a85 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:18.359053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415bc92-c027-435c-a5c5-fd8425edb170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:18.359699 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415bc92-c027-435c-a5c5-fd8425edb170 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:18.359970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415bc92-c027-435c-a5c5-fd8425edb170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:18.361317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415bc92-c027-435c-a5c5-fd8425edb170 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:18.368413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415bc92-c027-435c-a5c5-fd8425edb170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:18.371125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415bc92-c027-435c-a5c5-fd8425edb170 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:18.376584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:18.402768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:18.414368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada298b2-d5fc-4aa4-af31-1c8bc21abc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:18.415011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada298b2-d5fc-4aa4-af31-1c8bc21abc4f admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:18.415353 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada298b2-d5fc-4aa4-af31-1c8bc21abc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:18.415622 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada298b2-d5fc-4aa4-af31-1c8bc21abc4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:18.416262 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada298b2-d5fc-4aa4-af31-1c8bc21abc4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:18.421549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada298b2-d5fc-4aa4-af31-1c8bc21abc4f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:18.529724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 853/1705] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:18 2022] POST /identity/v3/users => generated 284 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:18.531033 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4789cd8-22c4-4955-8b0b-432515b04e08 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:18.531315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4789cd8-22c4-4955-8b0b-432515b04e08 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:18.531603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4789cd8-22c4-4955-8b0b-432515b04e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:18.594076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 853/1706] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:17 2022] POST /identity/v3/projects => generated 401 bytes in 605 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:18.599127 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d59948-dd9b-4ba1-b2d9-0be573eec673 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:18.599580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d59948-dd9b-4ba1-b2d9-0be573eec673 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:18.600000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d59948-dd9b-4ba1-b2d9-0be573eec673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:18.623288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e4789cd8-22c4-4955-8b0b-432515b04e08 None None] MFA Rules not processed for user `9f181af31fb245bba4158e89e58704d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:18.624616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e4789cd8-22c4-4955-8b0b-432515b04e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:18.666045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-79d59948-dd9b-4ba1-b2d9-0be573eec673 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:18.666625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-79d59948-dd9b-4ba1-b2d9-0be573eec673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:18.835533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 854/1707] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:18.836503 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4789cd8-22c4-4955-8b0b-432515b04e08 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:18.860390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 854/1708] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:18.861624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d59948-dd9b-4ba1-b2d9-0be573eec673 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:18.890096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d59948-dd9b-4ba1-b2d9-0be573eec673 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:18.897469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c070a2e-13cd-47e8-a079-b2cf25789e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:18.898205 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c070a2e-13cd-47e8-a079-b2cf25789e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:18.898585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c070a2e-13cd-47e8-a079-b2cf25789e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:18.898954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c070a2e-13cd-47e8-a079-b2cf25789e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:18.899729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c070a2e-13cd-47e8-a079-b2cf25789e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:18.901467 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c070a2e-13cd-47e8-a079-b2cf25789e7f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:18.936745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 855/1709] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:18.940613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c070a2e-13cd-47e8-a079-b2cf25789e7f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:18.946388 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1c070a2e-13cd-47e8-a079-b2cf25789e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:18.976420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c070a2e-13cd-47e8-a079-b2cf25789e7f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:18.988295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba44a39-9f3b-4262-9e28-37842418e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:18.991233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba44a39-9f3b-4262-9e28-37842418e3ce admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:18.992085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba44a39-9f3b-4262-9e28-37842418e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:18.992459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba44a39-9f3b-4262-9e28-37842418e3ce admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:18.995962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba44a39-9f3b-4262-9e28-37842418e3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:18.999357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba44a39-9f3b-4262-9e28-37842418e3ce admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:19.034585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4789cd8-22c4-4955-8b0b-432515b04e08 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:19.045491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd2f7a-997f-4017-a679-3200134b089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:19.045715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd2f7a-997f-4017-a679-3200134b089d admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:19.046000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd2f7a-997f-4017-a679-3200134b089d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:19.046280 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd2f7a-997f-4017-a679-3200134b089d admin admin] PATH_INFO: `/v3/projects/eb304d71bbda485a9302c3b9d9341e65/users/8c51ca289b504d4e896da697abe9b4a3/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:19.090776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd2f7a-997f-4017-a679-3200134b089d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb304d71bbda485a9302c3b9d9341e65, user_id=8c51ca289b504d4e896da697abe9b4a3, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:19.095276 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd2f7a-997f-4017-a679-3200134b089d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:19.116605 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 856/1710] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:18 2022] POST /identity/v3/users => generated 307 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:19.117827 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba44a39-9f3b-4262-9e28-37842418e3ce admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:19.122432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1ba44a39-9f3b-4262-9e28-37842418e3ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:19.210568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 855/1711] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:18 2022] PUT /identity/v3/projects/eb304d71bbda485a9302c3b9d9341e65/users/8c51ca289b504d4e896da697abe9b4a3/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:19.211768 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd2f7a-997f-4017-a679-3200134b089d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:19.270116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba44a39-9f3b-4262-9e28-37842418e3ce admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:19.278253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:19.335432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd2f7a-997f-4017-a679-3200134b089d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:19.344677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c156-0851-4f7d-a215-31c9c0674cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:19.345436 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c156-0851-4f7d-a215-31c9c0674cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:19.345926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c156-0851-4f7d-a215-31c9c0674cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:19.346216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c156-0851-4f7d-a215-31c9c0674cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:19.346890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788c156-0851-4f7d-a215-31c9c0674cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:19.348765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788c156-0851-4f7d-a215-31c9c0674cd5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:19.368295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 856/1712] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:19.369320 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c156-0851-4f7d-a215-31c9c0674cd5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:19.382621 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c156-0851-4f7d-a215-31c9c0674cd5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:19.387986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35193a28-cb31-4dbd-b355-21ab1d502ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:19.388938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35193a28-cb31-4dbd-b355-21ab1d502ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:19.389227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35193a28-cb31-4dbd-b355-21ab1d502ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:19.390131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35193a28-cb31-4dbd-b355-21ab1d502ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:19.390773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35193a28-cb31-4dbd-b355-21ab1d502ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:19.392512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35193a28-cb31-4dbd-b355-21ab1d502ea4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:19.411098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 857/1713] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:19.412220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35193a28-cb31-4dbd-b355-21ab1d502ea4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:19.429052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35193a28-cb31-4dbd-b355-21ab1d502ea4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:19.437870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06470346-71ff-40e4-8d6c-4ce01ec6ac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:19.439068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06470346-71ff-40e4-8d6c-4ce01ec6ac7b admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:19.439356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06470346-71ff-40e4-8d6c-4ce01ec6ac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:19.439632 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06470346-71ff-40e4-8d6c-4ce01ec6ac7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:19.440285 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06470346-71ff-40e4-8d6c-4ce01ec6ac7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:19.442083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06470346-71ff-40e4-8d6c-4ce01ec6ac7b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:19.453311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e278b63-1f9d-4ce6-802a-0247821e475b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:19.455840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e278b63-1f9d-4ce6-802a-0247821e475b service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:19.462535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e278b63-1f9d-4ce6-802a-0247821e475b service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:19.462535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e278b63-1f9d-4ce6-802a-0247821e475b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:19.473718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 858/1714] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:19.474744 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06470346-71ff-40e4-8d6c-4ce01ec6ac7b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:19.487275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e278b63-1f9d-4ce6-802a-0247821e475b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:19.491100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e278b63-1f9d-4ce6-802a-0247821e475b service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:19.500846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06470346-71ff-40e4-8d6c-4ce01ec6ac7b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:19.512919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce1dc7-24c4-4328-8077-468899a115c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:19.517029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce1dc7-24c4-4328-8077-468899a115c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:19.517029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce1dc7-24c4-4328-8077-468899a115c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:19.517029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce1dc7-24c4-4328-8077-468899a115c9 admin admin] PATH_INFO: `/v3/projects/97ff39573ad44383b891e6e0e38de730/users/d6c3cc72c82d46d3a934517284f2d0de/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:19.523712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 857/1715] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:19.524705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e278b63-1f9d-4ce6-802a-0247821e475b service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:19.545599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e278b63-1f9d-4ce6-802a-0247821e475b service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:19.557606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce1dc7-24c4-4328-8077-468899a115c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ff39573ad44383b891e6e0e38de730, user_id=d6c3cc72c82d46d3a934517284f2d0de, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:19.560432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce1dc7-24c4-4328-8077-468899a115c9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:19.572148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9cad8-3b4c-4835-a5d2-412b21df9178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:19.572148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9cad8-3b4c-4835-a5d2-412b21df9178 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:19.572148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9cad8-3b4c-4835-a5d2-412b21df9178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:19.574543 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9cad8-3b4c-4835-a5d2-412b21df9178 admin admin] PATH_INFO: `/v3/projects/9fdbfab2a54c40aca58e44ccbe66fed8/users/44023ba67f5946fb852f7a7894760a34/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:19.616846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9cad8-3b4c-4835-a5d2-412b21df9178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdbfab2a54c40aca58e44ccbe66fed8, user_id=44023ba67f5946fb852f7a7894760a34, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:19.620633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9cad8-3b4c-4835-a5d2-412b21df9178 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:19.817467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 859/1716] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:19 2022] PUT /identity/v3/projects/97ff39573ad44383b891e6e0e38de730/users/d6c3cc72c82d46d3a934517284f2d0de/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:19.819646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce1dc7-24c4-4328-8077-468899a115c9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:20.047695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce1dc7-24c4-4328-8077-468899a115c9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:20.069136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad51ce-3769-4f90-b88c-03bbef24b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:20.071906 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad51ce-3769-4f90-b88c-03bbef24b462 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:20.072306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad51ce-3769-4f90-b88c-03bbef24b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:20.072703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad51ce-3769-4f90-b88c-03bbef24b462 admin admin] PATH_INFO: `/v3/projects/eb304d71bbda485a9302c3b9d9341e65/users/8c51ca289b504d4e896da697abe9b4a3/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:20.082525 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad51ce-3769-4f90-b88c-03bbef24b462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb304d71bbda485a9302c3b9d9341e65, user_id=8c51ca289b504d4e896da697abe9b4a3, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:20.090404 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad51ce-3769-4f90-b88c-03bbef24b462 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:20.126214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 860/1717] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:19 2022] PUT /identity/v3/projects/eb304d71bbda485a9302c3b9d9341e65/users/8c51ca289b504d4e896da697abe9b4a3/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:20.127795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7d5b-efc5-4fa8-ab7b-e0fc32e56bc2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:20.128082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7d5b-efc5-4fa8-ab7b-e0fc32e56bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:20.128358 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7d5b-efc5-4fa8-ab7b-e0fc32e56bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:20.253677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0b7b7d5b-efc5-4fa8-ab7b-e0fc32e56bc2 None None] MFA Rules not processed for user `d6c3cc72c82d46d3a934517284f2d0de`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:20.255208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0b7b7d5b-efc5-4fa8-ab7b-e0fc32e56bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:20.370116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 861/1718] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:20.375446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b701105-527e-4171-bbff-b47700a0616a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:20.376693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b701105-527e-4171-bbff-b47700a0616a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:20.376932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b701105-527e-4171-bbff-b47700a0616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:20.415248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4b701105-527e-4171-bbff-b47700a0616a None None] MFA Rules not processed for user `8c51ca289b504d4e896da697abe9b4a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:20.416713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4b701105-527e-4171-bbff-b47700a0616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:20.516031 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 862/1719] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:20.517978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45552bef-7c63-4cb3-8ae1-6e200541da77 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:20.518546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45552bef-7c63-4cb3-8ae1-6e200541da77 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:20.518921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45552bef-7c63-4cb3-8ae1-6e200541da77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:20.567645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-45552bef-7c63-4cb3-8ae1-6e200541da77 None None] MFA Rules not processed for user `a0e6526c76984cc7a6a4c14c840f7c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:20.569113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-45552bef-7c63-4cb3-8ae1-6e200541da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:20.665174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 863/1720] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:20.670816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45552bef-7c63-4cb3-8ae1-6e200541da77 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:20.678387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-45552bef-7c63-4cb3-8ae1-6e200541da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:20.757276 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45552bef-7c63-4cb3-8ae1-6e200541da77 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:20.762269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cdd3e-2ff8-4171-b762-3ddbaf5fd333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:20.762936 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cdd3e-2ff8-4171-b762-3ddbaf5fd333 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:20.763216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cdd3e-2ff8-4171-b762-3ddbaf5fd333 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:20.763484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cdd3e-2ff8-4171-b762-3ddbaf5fd333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:20.774370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cdd3e-2ff8-4171-b762-3ddbaf5fd333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:20.775821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cdd3e-2ff8-4171-b762-3ddbaf5fd333 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:20.786217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 864/1721] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:20.787029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cdd3e-2ff8-4171-b762-3ddbaf5fd333 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:20.788381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-457cdd3e-2ff8-4171-b762-3ddbaf5fd333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:20.800390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cdd3e-2ff8-4171-b762-3ddbaf5fd333 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:20.804183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5566d95-1df4-4226-b45a-e4b76827c2cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:20.804785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5566d95-1df4-4226-b45a-e4b76827c2cf service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:20.805058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5566d95-1df4-4226-b45a-e4b76827c2cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:20.805357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5566d95-1df4-4226-b45a-e4b76827c2cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:20.815227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5566d95-1df4-4226-b45a-e4b76827c2cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:20.816770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5566d95-1df4-4226-b45a-e4b76827c2cf service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:20.827488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 865/1722] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:20 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:20.828304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5566d95-1df4-4226-b45a-e4b76827c2cf service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:20.830361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c5566d95-1df4-4226-b45a-e4b76827c2cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:20.914169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5566d95-1df4-4226-b45a-e4b76827c2cf service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:20.920432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07c8d9-e31b-43ba-8632-f32fc1036ea3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:20.921793 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07c8d9-e31b-43ba-8632-f32fc1036ea3 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:20.922094 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07c8d9-e31b-43ba-8632-f32fc1036ea3 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:20.922362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07c8d9-e31b-43ba-8632-f32fc1036ea3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:20.930849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07c8d9-e31b-43ba-8632-f32fc1036ea3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:20.932455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07c8d9-e31b-43ba-8632-f32fc1036ea3 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:20.942171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 866/1723] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:21.487346 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 858/1724] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:19 2022] PUT /identity/v3/projects/9fdbfab2a54c40aca58e44ccbe66fed8/users/44023ba67f5946fb852f7a7894760a34/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 1960 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:21.488860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07c8d9-e31b-43ba-8632-f32fc1036ea3 service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:21.563367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07c8d9-e31b-43ba-8632-f32fc1036ea3 service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:21.679357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d1856-3377-4f02-82e5-ef989318ba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:21.679357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d1856-3377-4f02-82e5-ef989318ba18 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:21.679357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d1856-3377-4f02-82e5-ef989318ba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:21.679357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d1856-3377-4f02-82e5-ef989318ba18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:21.680227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d1856-3377-4f02-82e5-ef989318ba18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:21.680227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d1856-3377-4f02-82e5-ef989318ba18 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:21.712386 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 867/1725] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:30:21.712646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9cad8-3b4c-4835-a5d2-412b21df9178 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:21.737981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9cad8-3b4c-4835-a5d2-412b21df9178 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:21.751029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ec5c0-603b-4c6d-9437-20c8dc1743d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:21.752374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ec5c0-603b-4c6d-9437-20c8dc1743d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:21.753475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ec5c0-603b-4c6d-9437-20c8dc1743d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:21.753763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ec5c0-603b-4c6d-9437-20c8dc1743d3 admin admin] PATH_INFO: `/v3/projects/9fdbfab2a54c40aca58e44ccbe66fed8/users/44023ba67f5946fb852f7a7894760a34/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:21.758589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ec5c0-603b-4c6d-9437-20c8dc1743d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdbfab2a54c40aca58e44ccbe66fed8, user_id=44023ba67f5946fb852f7a7894760a34, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:21.765323 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ec5c0-603b-4c6d-9437-20c8dc1743d3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:21.778610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 859/1726] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:21 2022] PUT /identity/v3/projects/9fdbfab2a54c40aca58e44ccbe66fed8/users/44023ba67f5946fb852f7a7894760a34/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:21.789888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf734a6-3f19-4272-a5e7-2a91d23a3cf1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:21.790420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf734a6-3f19-4272-a5e7-2a91d23a3cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:21.790702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf734a6-3f19-4272-a5e7-2a91d23a3cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:21.862583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ec5c0-603b-4c6d-9437-20c8dc1743d3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:21.862803 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6cf734a6-3f19-4272-a5e7-2a91d23a3cf1 None None] MFA Rules not processed for user `44023ba67f5946fb852f7a7894760a34`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:21.864401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6cf734a6-3f19-4272-a5e7-2a91d23a3cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:21.998822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ec5c0-603b-4c6d-9437-20c8dc1743d3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:22.005984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd2032-dc71-46d9-b85d-6d5803e3bc26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:22.007342 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd2032-dc71-46d9-b85d-6d5803e3bc26 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:22.009980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd2032-dc71-46d9-b85d-6d5803e3bc26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:22.010346 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd2032-dc71-46d9-b85d-6d5803e3bc26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:22.013647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-36cd2032-dc71-46d9-b85d-6d5803e3bc26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:22.055732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 868/1727] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:21 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:22.064935 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:22.145535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd2032-dc71-46d9-b85d-6d5803e3bc26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:22.147234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd2032-dc71-46d9-b85d-6d5803e3bc26 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:22.173682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 860/1728] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:30:22.200086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf734a6-3f19-4272-a5e7-2a91d23a3cf1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:22.226899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf734a6-3f19-4272-a5e7-2a91d23a3cf1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:22.237606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8245968-7327-4aad-95e2-8a022853c442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:22.238294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8245968-7327-4aad-95e2-8a022853c442 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:22.238612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8245968-7327-4aad-95e2-8a022853c442 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:22.241093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8245968-7327-4aad-95e2-8a022853c442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:22.261153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8245968-7327-4aad-95e2-8a022853c442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:22.264968 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8245968-7327-4aad-95e2-8a022853c442 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:22.306193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 869/1729] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:22 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:22.514862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd2032-dc71-46d9-b85d-6d5803e3bc26 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:22.516599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-36cd2032-dc71-46d9-b85d-6d5803e3bc26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:22.688215 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd2032-dc71-46d9-b85d-6d5803e3bc26 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:22.695827 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:22.696674 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:22.697025 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:22.697391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d admin admin] PATH_INFO: `/v3/projects/138038e814134c45a1c7e534eefd175e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:22.699595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d admin admin] RBAC: Authorizing `identity:delete_project(project_id=138038e814134c45a1c7e534eefd175e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:22.703105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:22.812091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8245968-7327-4aad-95e2-8a022853c442 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:22.828609 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8245968-7327-4aad-95e2-8a022853c442 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:22.849522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45054bc-73c3-411a-9d27-39eacc081687 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:22.849522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45054bc-73c3-411a-9d27-39eacc081687 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:22.849522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45054bc-73c3-411a-9d27-39eacc081687 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:22.849522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45054bc-73c3-411a-9d27-39eacc081687 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:22.853311 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a45054bc-73c3-411a-9d27-39eacc081687 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:22.916561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138038e814134c45a1c7e534eefd175e', 'request_id': 'req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:22.945512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138038e814134c45a1c7e534eefd175e', 'request_id': 'req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:23.029448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45054bc-73c3-411a-9d27-39eacc081687 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:23.033084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45054bc-73c3-411a-9d27-39eacc081687 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:23.045176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 870/1730] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:22 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:23.046671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c00f1-dc32-437f-924f-14524609f645 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:23.047033 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c00f1-dc32-437f-924f-14524609f645 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:23.047403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c00f1-dc32-437f-924f-14524609f645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:23.079391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138038e814134c45a1c7e534eefd175e', 'request_id': 'req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:23.084032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-826c00f1-dc32-437f-924f-14524609f645 None None] MFA Rules not processed for user `c83b01ab2d254b0a9e44caee9db02ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:23.085486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-826c00f1-dc32-437f-924f-14524609f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:23.109488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d admin admin] The token cache is being invalidate because project 138038e814134c45a1c7e534eefd175e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:23.109885 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:23.117860 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f3b7ddd3-a34c-4314-ae87-50f3fa43a42d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:23.124785 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 861/1731] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:22 2022] DELETE /identity/v3/projects/138038e814134c45a1c7e534eefd175e => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:23.126915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262514b8-8dea-4c13-899c-8d0157670074 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:23.127204 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262514b8-8dea-4c13-899c-8d0157670074 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:23.133939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262514b8-8dea-4c13-899c-8d0157670074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:23.237604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-262514b8-8dea-4c13-899c-8d0157670074 None None] MFA Rules not processed for user `1398646888214f8a9ed7be5648a9a231`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:23.237604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-262514b8-8dea-4c13-899c-8d0157670074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:23.260866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 871/1732] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:23.271892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c00f1-dc32-437f-924f-14524609f645 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:23.273628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-826c00f1-dc32-437f-924f-14524609f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:23.464688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 862/1733] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:23.466259 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9dac4-d4f4-4eea-a6d2-56a66ce81f10 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:23.466857 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9dac4-d4f4-4eea-a6d2-56a66ce81f10 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:23.467938 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9dac4-d4f4-4eea-a6d2-56a66ce81f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:23.471467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c00f1-dc32-437f-924f-14524609f645 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:23.484020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:23.485576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:23.485864 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:23.487310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] PATH_INFO: `/v3/users/e338de4597a446a28b4920bdc993eb1c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:23.488967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e338de4597a446a28b4920bdc993eb1c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:23.495064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:23.522364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d2d9dac4-d4f4-4eea-a6d2-56a66ce81f10 None None] MFA Rules not processed for user `c83b01ab2d254b0a9e44caee9db02ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:23.524400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d2d9dac4-d4f4-4eea-a6d2-56a66ce81f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:23.538263 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 863/1734] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:23.539784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9dac4-d4f4-4eea-a6d2-56a66ce81f10 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:23.541584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d2d9dac4-d4f4-4eea-a6d2-56a66ce81f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:23.754646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9dac4-d4f4-4eea-a6d2-56a66ce81f10 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:23.755099 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e338de4597a446a28b4920bdc993eb1c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:23.756599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e338de4597a446a28b4920bdc993eb1c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:23.758001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e338de4597a446a28b4920bdc993eb1c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:23.766146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b74882-4381-46f7-9db8-8cea4f988678 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:23.768517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b74882-4381-46f7-9db8-8cea4f988678 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:23.768782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b74882-4381-46f7-9db8-8cea4f988678 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:23.769068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b74882-4381-46f7-9db8-8cea4f988678 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:23.769574 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e338de4597a446a28b4920bdc993eb1c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:23.771656 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-94b74882-4381-46f7-9db8-8cea4f988678 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:23.813872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b74882-4381-46f7-9db8-8cea4f988678 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:23.813872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b74882-4381-46f7-9db8-8cea4f988678 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:23.830808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e338de4597a446a28b4920bdc993eb1c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:23.887076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 864/1735] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:23.888880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b74882-4381-46f7-9db8-8cea4f988678 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:23.890508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-94b74882-4381-46f7-9db8-8cea4f988678 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:23.923186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b74882-4381-46f7-9db8-8cea4f988678 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:23.930158 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:23.941352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0cfa3-8dae-43b4-9ee4-8214d2942c6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:23.941984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0cfa3-8dae-43b4-9ee4-8214d2942c6b service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:23.942265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0cfa3-8dae-43b4-9ee4-8214d2942c6b service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:23.942539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0cfa3-8dae-43b4-9ee4-8214d2942c6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:23.944884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-46a0cfa3-8dae-43b4-9ee4-8214d2942c6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:23.968115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 872/1736] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:23 2022] DELETE /identity/v3/users/e338de4597a446a28b4920bdc993eb1c => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:23.976366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0cfa3-8dae-43b4-9ee4-8214d2942c6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:23.978353 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0cfa3-8dae-43b4-9ee4-8214d2942c6b service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:24.019145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 865/1737] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:24.054929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:25.366185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:25.367682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:25.568186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324846-2e9e-4809-9dbe-2bcd78ac5dd9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:25.568721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324846-2e9e-4809-9dbe-2bcd78ac5dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:25.568721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324846-2e9e-4809-9dbe-2bcd78ac5dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:25.587112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125fcfe-1b1e-4434-b7e9-57a533ec9d03 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:25.602231 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:25.604499 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:25.604499 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:25.604499 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] PATH_INFO: `/v3/projects/d073106dffe045559f6e4d970e0a21d1` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:25.605177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d073106dffe045559f6e4d970e0a21d1)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:25.607269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:25.679912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-37324846-2e9e-4809-9dbe-2bcd78ac5dd9 None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:25.682233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-37324846-2e9e-4809-9dbe-2bcd78ac5dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:25.809304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:25.810885 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 866/1738] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:30:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:30:25.832920 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd073106dffe045559f6e4d970e0a21d1', 'request_id': 'req-dad5455f-16f9-4900-b133-e6d5f6ade6b3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:25.848974 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd073106dffe045559f6e4d970e0a21d1', 'request_id': 'req-dad5455f-16f9-4900-b133-e6d5f6ade6b3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:25.940295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd073106dffe045559f6e4d970e0a21d1', 'request_id': 'req-dad5455f-16f9-4900-b133-e6d5f6ade6b3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:25.957310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] The token cache is being invalidate because project d073106dffe045559f6e4d970e0a21d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:25.957716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:25.960193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:25.963921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 873/1739] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:25 2022] DELETE /identity/v3/projects/d073106dffe045559f6e4d970e0a21d1 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:25.971078 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9e7c7-e181-4773-8e34-0b3d5387182b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:25.971561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9e7c7-e181-4773-8e34-0b3d5387182b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:25.972003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9e7c7-e181-4773-8e34-0b3d5387182b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:26.010673 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-84d9e7c7-e181-4773-8e34-0b3d5387182b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:26.012961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-84d9e7c7-e181-4773-8e34-0b3d5387182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:26.285662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:26.287012 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:26.288038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 867/1740] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:26.296269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575d359-7d42-4f01-b875-a7bbed56264f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:26.299852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575d359-7d42-4f01-b875-a7bbed56264f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:26.299852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575d359-7d42-4f01-b875-a7bbed56264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:26.363635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2575d359-7d42-4f01-b875-a7bbed56264f None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:26.363838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2575d359-7d42-4f01-b875-a7bbed56264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:26.407688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 868/1741] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:30:26.409007 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575d359-7d42-4f01-b875-a7bbed56264f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:26.429331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575d359-7d42-4f01-b875-a7bbed56264f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:26.446163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096bb89-d1d8-4470-8b42-7847948f1abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:26.446893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096bb89-d1d8-4470-8b42-7847948f1abc admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:26.447175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096bb89-d1d8-4470-8b42-7847948f1abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:26.447642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096bb89-d1d8-4470-8b42-7847948f1abc admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:26.448494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096bb89-d1d8-4470-8b42-7847948f1abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:30:26.448850 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096bb89-d1d8-4470-8b42-7847948f1abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:26.452493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096bb89-d1d8-4470-8b42-7847948f1abc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:26.519703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:26.528536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 869/1742] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:30:26.544763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096bb89-d1d8-4470-8b42-7847948f1abc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:26.551572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096bb89-d1d8-4470-8b42-7847948f1abc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:26.557864 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e31fcd-1ada-4640-93ce-cae45727593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:26.558899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e31fcd-1ada-4640-93ce-cae45727593a admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:26.558899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e31fcd-1ada-4640-93ce-cae45727593a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:26.559075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e31fcd-1ada-4640-93ce-cae45727593a admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:26.559801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e31fcd-1ada-4640-93ce-cae45727593a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:26.561961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e31fcd-1ada-4640-93ce-cae45727593a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:26.687402 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5455f-16f9-4900-b133-e6d5f6ade6b3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:26.714915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 870/1743] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:26 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:26.726824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e31fcd-1ada-4640-93ce-cae45727593a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:26.731198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9c3a7-efb1-45cc-8393-b911a3d7aead service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:26.731842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c3a7-efb1-45cc-8393-b911a3d7aead service swift] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:26.732270 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c3a7-efb1-45cc-8393-b911a3d7aead service swift] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:26.732555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c3a7-efb1-45cc-8393-b911a3d7aead service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:26.737220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-70a9c3a7-efb1-45cc-8393-b911a3d7aead service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:26.932915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9c3a7-efb1-45cc-8393-b911a3d7aead service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:26.933635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9c3a7-efb1-45cc-8393-b911a3d7aead service swift] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:26.951975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 874/1744] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:30:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 03:30:26.959699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e31fcd-1ada-4640-93ce-cae45727593a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:26.975090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7a3c-0a83-4836-8c40-f989bb3876c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:26.975728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7a3c-0a83-4836-8c40-f989bb3876c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:26.979326 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7a3c-0a83-4836-8c40-f989bb3876c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:26.979644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7a3c-0a83-4836-8c40-f989bb3876c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:26.980338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb7a3c-0a83-4836-8c40-f989bb3876c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:26.983503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb7a3c-0a83-4836-8c40-f989bb3876c1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:27.093557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 871/1745] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:26 2022] POST /identity/v3/users => generated 293 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:27.099720 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9c3a7-efb1-45cc-8393-b911a3d7aead service swift] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:27.124477 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9c3a7-efb1-45cc-8393-b911a3d7aead service swift] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:27.138026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bf727-e550-440e-b4b0-34f0322feb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:27.138929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bf727-e550-440e-b4b0-34f0322feb61 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:27.139357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bf727-e550-440e-b4b0-34f0322feb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:27.139822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bf727-e550-440e-b4b0-34f0322feb61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:27.140606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bf727-e550-440e-b4b0-34f0322feb61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:27.145703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bf727-e550-440e-b4b0-34f0322feb61 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:27.171526 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7a3c-0a83-4836-8c40-f989bb3876c1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:27.178673 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 875/1746] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:27.183135 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7a3c-0a83-4836-8c40-f989bb3876c1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:27.209432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebd56f-9f0d-48bb-b9a8-c9d68281da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:27.211014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebd56f-9f0d-48bb-b9a8-c9d68281da35 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:27.212668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebd56f-9f0d-48bb-b9a8-c9d68281da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:27.213086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebd56f-9f0d-48bb-b9a8-c9d68281da35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:27.214112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebd56f-9f0d-48bb-b9a8-c9d68281da35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:27.216910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebd56f-9f0d-48bb-b9a8-c9d68281da35 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:27.254846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 872/1747] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:27.258290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bf727-e550-440e-b4b0-34f0322feb61 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:27.269672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bf727-e550-440e-b4b0-34f0322feb61 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:27.287133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c1538-3d3c-4c5d-8a1e-e36c787ad65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:27.288064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c1538-3d3c-4c5d-8a1e-e36c787ad65e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:27.288494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c1538-3d3c-4c5d-8a1e-e36c787ad65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:27.289136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c1538-3d3c-4c5d-8a1e-e36c787ad65e admin admin] PATH_INFO: `/v3/projects/d6aaad54c3aa4c44842413c85322fb5c/users/44c1a9b01b33454bbae3ce70aa1ddff7/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:27.328326 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c1538-3d3c-4c5d-8a1e-e36c787ad65e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6aaad54c3aa4c44842413c85322fb5c, user_id=44c1a9b01b33454bbae3ce70aa1ddff7, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:27.332352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c1538-3d3c-4c5d-8a1e-e36c787ad65e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:27.450503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2832-2462-4b59-a45a-ae6baf45881b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:27.451202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 876/1748] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:27 2022] PUT /identity/v3/projects/d6aaad54c3aa4c44842413c85322fb5c/users/44c1a9b01b33454bbae3ce70aa1ddff7/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:27.453136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2832-2462-4b59-a45a-ae6baf45881b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:27.457642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2832-2462-4b59-a45a-ae6baf45881b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:27.600390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-42ec2832-2462-4b59-a45a-ae6baf45881b None None] MFA Rules not processed for user `44c1a9b01b33454bbae3ce70aa1ddff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:27.601644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-42ec2832-2462-4b59-a45a-ae6baf45881b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:27.840405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c1538-3d3c-4c5d-8a1e-e36c787ad65e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:27.845666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d42c1538-3d3c-4c5d-8a1e-e36c787ad65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:27.850721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 873/1749] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:28.101578 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c1538-3d3c-4c5d-8a1e-e36c787ad65e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:28.120203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc928a2-3b75-4b57-b126-1a17c9a32aea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:28.121115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc928a2-3b75-4b57-b126-1a17c9a32aea service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:28.121595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc928a2-3b75-4b57-b126-1a17c9a32aea service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:28.122020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc928a2-3b75-4b57-b126-1a17c9a32aea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:28.176896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc928a2-3b75-4b57-b126-1a17c9a32aea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:28.178486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc928a2-3b75-4b57-b126-1a17c9a32aea service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:28.217992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 877/1750] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:28.446454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:28.537309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:30.260686 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946492a-8e9b-429c-bf2e-270ee46344be None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:30.261652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946492a-8e9b-429c-bf2e-270ee46344be None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:30.262149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946492a-8e9b-429c-bf2e-270ee46344be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:30.344953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6946492a-8e9b-429c-bf2e-270ee46344be None None] MFA Rules not processed for user `5bb4ef26660244ce90b0105113e252b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:30.346224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6946492a-8e9b-429c-bf2e-270ee46344be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:30.577236 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 874/1751] 10.222.0.55 () {58 vars in 1015 bytes} [Tue Sep 13 03:30:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:30.608903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc928a2-3b75-4b57-b126-1a17c9a32aea service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:30.613042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dfc928a2-3b75-4b57-b126-1a17c9a32aea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:30.619149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946492a-8e9b-429c-bf2e-270ee46344be None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:30.639694 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946492a-8e9b-429c-bf2e-270ee46344be None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:30.643310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:30.648118 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc928a2-3b75-4b57-b126-1a17c9a32aea service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:30.656184 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dc419-df0f-40b5-b168-ab5ef0386a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:30.656817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dc419-df0f-40b5-b168-ab5ef0386a6a service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:30.657092 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dc419-df0f-40b5-b168-ab5ef0386a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:30.657390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dc419-df0f-40b5-b168-ab5ef0386a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:30.677193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e61b0-d31f-4c3c-b407-2988511da69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:30.679875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e61b0-d31f-4c3c-b407-2988511da69b service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:30.680160 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e61b0-d31f-4c3c-b407-2988511da69b service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:30.683109 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e61b0-d31f-4c3c-b407-2988511da69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:30.686707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972dc419-df0f-40b5-b168-ab5ef0386a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:30.688759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972dc419-df0f-40b5-b168-ab5ef0386a6a service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:30.716551 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 875/1752] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:30.721688 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e61b0-d31f-4c3c-b407-2988511da69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:30.725047 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e61b0-d31f-4c3c-b407-2988511da69b service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:30.737638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 878/1753] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:31.289584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78d135-e296-40fd-93cf-a4e7071ce0a7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:31.291785 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78d135-e296-40fd-93cf-a4e7071ce0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:31.292211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78d135-e296-40fd-93cf-a4e7071ce0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:31.332229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9f78d135-e296-40fd-93cf-a4e7071ce0a7 None None] MFA Rules not processed for user `a0e6526c76984cc7a6a4c14c840f7c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:31.333742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9f78d135-e296-40fd-93cf-a4e7071ce0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:31.382197 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e61b0-d31f-4c3c-b407-2988511da69b service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:31.384017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e38e61b0-d31f-4c3c-b407-2988511da69b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:31.402371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:31.472498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:31.494762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 876/1754] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:31.520798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e61b0-d31f-4c3c-b407-2988511da69b service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:31.526721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:31.528024 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:31.528555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:31.529036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] PATH_INFO: `/v3/users/67274f52f88f4a238ede9c6270f8c7b9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:31.532011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67274f52f88f4a238ede9c6270f8c7b9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:31.534382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:31.948722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67274f52f88f4a238ede9c6270f8c7b9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:31.951557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67274f52f88f4a238ede9c6270f8c7b9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:31.952505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67274f52f88f4a238ede9c6270f8c7b9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:31.970806 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67274f52f88f4a238ede9c6270f8c7b9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:32.026483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67274f52f88f4a238ede9c6270f8c7b9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:32.185042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 879/1755] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:31 2022] DELETE /identity/v3/users/67274f52f88f4a238ede9c6270f8c7b9 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:32.190228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5288d-d379-4c17-b1c8-dd5c24a4c45a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:32.190518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5288d-d379-4c17-b1c8-dd5c24a4c45a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:32.190798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5288d-d379-4c17-b1c8-dd5c24a4c45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:32.246063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-aae5288d-d379-4c17-b1c8-dd5c24a4c45a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:32.247505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aae5288d-d379-4c17-b1c8-dd5c24a4c45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:32.458550 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:32.508528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 877/1756] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:32.694637 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:32.696641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:32.910415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6655-9182-4a2f-84cc-d7f8d02d2a4d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:32.922648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d787de-e9e7-4664-9402-c46613ec43b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:32.923170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d787de-e9e7-4664-9402-c46613ec43b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:32.923804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d787de-e9e7-4664-9402-c46613ec43b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:32.924265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d787de-e9e7-4664-9402-c46613ec43b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:32.956406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d787de-e9e7-4664-9402-c46613ec43b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:32.958223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d787de-e9e7-4664-9402-c46613ec43b0 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:32.989553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 880/1757] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:33.451867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:33.894303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1368-698e-4525-82b6-0837a4001905 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:33.894889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1368-698e-4525-82b6-0837a4001905 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:33.895073 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1368-698e-4525-82b6-0837a4001905 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:33.896869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 878/1758] 10.222.0.48 () {54 vars in 912 bytes} [Tue Sep 13 03:30:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:30:33.927076 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eac67-4c9d-485c-8c04-44b8e251b3ff None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:33.927280 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eac67-4c9d-485c-8c04-44b8e251b3ff None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:33.927560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054eac67-4c9d-485c-8c04-44b8e251b3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:33.990686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-054eac67-4c9d-485c-8c04-44b8e251b3ff None None] MFA Rules not processed for user `5bb4ef26660244ce90b0105113e252b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:33.999274 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-054eac67-4c9d-485c-8c04-44b8e251b3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:34.041855 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 881/1759] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:30:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:30:34.164763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f1368-698e-4525-82b6-0837a4001905 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:34.225019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f1368-698e-4525-82b6-0837a4001905 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:34.254662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6a2a9-3f04-4885-aa3a-70d60e372020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:34.259391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6a2a9-3f04-4885-aa3a-70d60e372020 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:34.259681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6a2a9-3f04-4885-aa3a-70d60e372020 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:34.259960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6a2a9-3f04-4885-aa3a-70d60e372020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:34.320813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6a2a9-3f04-4885-aa3a-70d60e372020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:34.322387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6a2a9-3f04-4885-aa3a-70d60e372020 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:34.369480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 879/1760] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:34.525573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19acfb0-178a-4224-b462-54a30eae062d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:34.525896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19acfb0-178a-4224-b462-54a30eae062d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:34.526180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19acfb0-178a-4224-b462-54a30eae062d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:34.607182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d19acfb0-178a-4224-b462-54a30eae062d None None] MFA Rules not processed for user `1398646888214f8a9ed7be5648a9a231`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:34.607182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d19acfb0-178a-4224-b462-54a30eae062d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:34.702315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 882/1761] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:35.391788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a5a41-980d-46e4-8a7e-453ca5552f08 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:35.394001 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a5a41-980d-46e4-8a7e-453ca5552f08 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:35.394481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a5a41-980d-46e4-8a7e-453ca5552f08 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:35.398591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 880/1762] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:30:35 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:30:35.687671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae11ba-da9e-46ec-8c69-50e89750785d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:35.687671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae11ba-da9e-46ec-8c69-50e89750785d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:35.687671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae11ba-da9e-46ec-8c69-50e89750785d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:35.804640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c1ae11ba-da9e-46ec-8c69-50e89750785d None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:35.807295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c1ae11ba-da9e-46ec-8c69-50e89750785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:35.855795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:36.173641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 883/1763] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:30:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:37.284746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a5a41-980d-46e4-8a7e-453ca5552f08 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:37.286719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-195a5a41-980d-46e4-8a7e-453ca5552f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:37.319883 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a5a41-980d-46e4-8a7e-453ca5552f08 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:37.337944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:37.339190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:37.339685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:37.340168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] PATH_INFO: `/v3/projects/ba63f5e0447142c9bd911c1b37023d8e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:37.344260 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba63f5e0447142c9bd911c1b37023d8e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:37.346498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:37.649315 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba63f5e0447142c9bd911c1b37023d8e', 'request_id': 'req-9788c19c-8501-442c-b3c9-6f2b089ad8b7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:37.669010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba63f5e0447142c9bd911c1b37023d8e', 'request_id': 'req-9788c19c-8501-442c-b3c9-6f2b089ad8b7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:37.756086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba63f5e0447142c9bd911c1b37023d8e', 'request_id': 'req-9788c19c-8501-442c-b3c9-6f2b089ad8b7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:37.780530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] The token cache is being invalidate because project ba63f5e0447142c9bd911c1b37023d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:37.781596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:37.782385 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:37.789662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 881/1764] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:37 2022] DELETE /identity/v3/projects/ba63f5e0447142c9bd911c1b37023d8e => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:37.793332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae11ba-da9e-46ec-8c69-50e89750785d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:37.827932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae11ba-da9e-46ec-8c69-50e89750785d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:38.013733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:38.018672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:38.022073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:38.025087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] PATH_INFO: `/v3/users/44023ba67f5946fb852f7a7894760a34` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:38.028701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44023ba67f5946fb852f7a7894760a34)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:38.034972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:38.356622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44023ba67f5946fb852f7a7894760a34'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:38.357585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44023ba67f5946fb852f7a7894760a34'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:38.358594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44023ba67f5946fb852f7a7894760a34'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:38.381323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44023ba67f5946fb852f7a7894760a34'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:38.410154 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44023ba67f5946fb852f7a7894760a34'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:38.481106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:38.486665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:38.535555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 884/1765] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:37 2022] DELETE /identity/v3/users/44023ba67f5946fb852f7a7894760a34 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:38.647887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788c19c-8501-442c-b3c9-6f2b089ad8b7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:38.712194 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:38.889926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc672f-0bf1-4a5c-8b6c-48bf8bd7984d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:38.897625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc672f-0bf1-4a5c-8b6c-48bf8bd7984d service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:38.897625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc672f-0bf1-4a5c-8b6c-48bf8bd7984d service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:38.897625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc672f-0bf1-4a5c-8b6c-48bf8bd7984d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:38.897625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bbdc672f-0bf1-4a5c-8b6c-48bf8bd7984d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:38.938849 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc672f-0bf1-4a5c-8b6c-48bf8bd7984d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:38.940911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc672f-0bf1-4a5c-8b6c-48bf8bd7984d service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:38.967683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 882/1766] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:39.095284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:39.108218 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:39.110479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:39.286769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ab6d7-078b-496b-9eda-de2093cea866 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:39.307373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89068dfa-3065-4476-9664-9abc520dfbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:39.308636 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89068dfa-3065-4476-9664-9abc520dfbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:39.312269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89068dfa-3065-4476-9664-9abc520dfbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:39.312835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89068dfa-3065-4476-9664-9abc520dfbee admin admin] PATH_INFO: `/v3/users/44c1a9b01b33454bbae3ce70aa1ddff7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:39.319889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89068dfa-3065-4476-9664-9abc520dfbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c1a9b01b33454bbae3ce70aa1ddff7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:39.354112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89068dfa-3065-4476-9664-9abc520dfbee admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:39.681053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-89068dfa-3065-4476-9664-9abc520dfbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c1a9b01b33454bbae3ce70aa1ddff7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:39.685185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-89068dfa-3065-4476-9664-9abc520dfbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c1a9b01b33454bbae3ce70aa1ddff7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:39.686324 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-89068dfa-3065-4476-9664-9abc520dfbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c1a9b01b33454bbae3ce70aa1ddff7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:39.696325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-89068dfa-3065-4476-9664-9abc520dfbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c1a9b01b33454bbae3ce70aa1ddff7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:39.712860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-89068dfa-3065-4476-9664-9abc520dfbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c1a9b01b33454bbae3ce70aa1ddff7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:39.842405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 885/1767] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:39 2022] DELETE /identity/v3/users/44c1a9b01b33454bbae3ce70aa1ddff7 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:39.845754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31753a0-0efa-4176-8526-d7d920ac64de None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:39.848869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31753a0-0efa-4176-8526-d7d920ac64de None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:39.848869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31753a0-0efa-4176-8526-d7d920ac64de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:39.914608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a31753a0-0efa-4176-8526-d7d920ac64de None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:39.918319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a31753a0-0efa-4176-8526-d7d920ac64de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:40.123977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7060c83-0ccb-4f08-8923-90b4887259c5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:40.123977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7060c83-0ccb-4f08-8923-90b4887259c5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:40.125091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7060c83-0ccb-4f08-8923-90b4887259c5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:40.127196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 886/1768] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:30:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:30:40.181054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd5a9d-6c7e-40af-8a20-03b4d13e8bf1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:40.181572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd5a9d-6c7e-40af-8a20-03b4d13e8bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:40.181778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd5a9d-6c7e-40af-8a20-03b4d13e8bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:40.184171 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 883/1769] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:40.235503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31753a0-0efa-4176-8526-d7d920ac64de None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:40.237250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a31753a0-0efa-4176-8526-d7d920ac64de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:40.239752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-14fd5a9d-6c7e-40af-8a20-03b4d13e8bf1 None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:40.242576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-14fd5a9d-6c7e-40af-8a20-03b4d13e8bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:40.542152 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 887/1770] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:30:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:30:40.591110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31753a0-0efa-4176-8526-d7d920ac64de None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:40.610396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc334d-4494-4a7b-a1a1-15e2bd4b7368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:40.612438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc334d-4494-4a7b-a1a1-15e2bd4b7368 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:40.613781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc334d-4494-4a7b-a1a1-15e2bd4b7368 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:40.616603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc334d-4494-4a7b-a1a1-15e2bd4b7368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:40.673387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc334d-4494-4a7b-a1a1-15e2bd4b7368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:40.678287 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc334d-4494-4a7b-a1a1-15e2bd4b7368 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:40.686721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd5a9d-6c7e-40af-8a20-03b4d13e8bf1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:40.688265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-14fd5a9d-6c7e-40af-8a20-03b4d13e8bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:40.708831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd5a9d-6c7e-40af-8a20-03b4d13e8bf1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:40.717150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:40.718929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:40.720540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:40.721061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795 admin admin] PATH_INFO: `/v3/projects/9fdbfab2a54c40aca58e44ccbe66fed8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:40.724327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fdbfab2a54c40aca58e44ccbe66fed8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:40.735442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:40.741699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 884/1771] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:41.021695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fdbfab2a54c40aca58e44ccbe66fed8', 'request_id': 'req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:41.040757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fdbfab2a54c40aca58e44ccbe66fed8', 'request_id': 'req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:41.104491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc334d-4494-4a7b-a1a1-15e2bd4b7368 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:41.108678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-75bc334d-4494-4a7b-a1a1-15e2bd4b7368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:41.143336 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc334d-4494-4a7b-a1a1-15e2bd4b7368 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:41.158719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fdbfab2a54c40aca58e44ccbe66fed8', 'request_id': 'req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:41.180432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795 admin admin] The token cache is being invalidate because project 9fdbfab2a54c40aca58e44ccbe66fed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:41.181844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:41.186049 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-05e56d12-45ef-4ee3-b1b2-3f1d5b8bc795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:41.194759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 888/1772] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:40 2022] DELETE /identity/v3/projects/9fdbfab2a54c40aca58e44ccbe66fed8 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:41.198612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce2316-937b-4aa5-858b-a435ded2ca02 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:41.200488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce2316-937b-4aa5-858b-a435ded2ca02 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:41.200777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce2316-937b-4aa5-858b-a435ded2ca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:41.310063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-22ce2316-937b-4aa5-858b-a435ded2ca02 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:41.311363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-22ce2316-937b-4aa5-858b-a435ded2ca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:41.370374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a9def-0be9-4119-9f95-377a5c4751fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:41.371259 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a9def-0be9-4119-9f95-377a5c4751fc service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:41.371721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a9def-0be9-4119-9f95-377a5c4751fc service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:41.372154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a9def-0be9-4119-9f95-377a5c4751fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:41.377250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-874a9def-0be9-4119-9f95-377a5c4751fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:41.405948 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a9def-0be9-4119-9f95-377a5c4751fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:41.425367 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a9def-0be9-4119-9f95-377a5c4751fc service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:41.470866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 885/1773] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:30:41.496647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 889/1774] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:41.505979 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e5b6f-cfbc-4c64-b734-8d6f166f6db7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:41.506579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e5b6f-cfbc-4c64-b734-8d6f166f6db7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:41.507357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e5b6f-cfbc-4c64-b734-8d6f166f6db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:41.570315 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b19e5b6f-cfbc-4c64-b734-8d6f166f6db7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:41.572131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b19e5b6f-cfbc-4c64-b734-8d6f166f6db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:41.613978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce2316-937b-4aa5-858b-a435ded2ca02 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:41.631978 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 886/1775] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:30:41.644970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce2316-937b-4aa5-858b-a435ded2ca02 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:41.667369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf020b-d651-47f7-915a-d09b98c3638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:41.667369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf020b-d651-47f7-915a-d09b98c3638f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:41.679329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf020b-d651-47f7-915a-d09b98c3638f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:41.683883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf020b-d651-47f7-915a-d09b98c3638f admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:41.684926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf020b-d651-47f7-915a-d09b98c3638f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:30:41.684926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf020b-d651-47f7-915a-d09b98c3638f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:41.690894 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf020b-d651-47f7-915a-d09b98c3638f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:41.718151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 890/1776] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:30:41.719160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e5b6f-cfbc-4c64-b734-8d6f166f6db7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:41.736669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e5b6f-cfbc-4c64-b734-8d6f166f6db7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:41.758165 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4390aee-631a-4ece-b25b-91348a296409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:41.759238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4390aee-631a-4ece-b25b-91348a296409 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:41.759363 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4390aee-631a-4ece-b25b-91348a296409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:41.760899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4390aee-631a-4ece-b25b-91348a296409 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:41.760899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4390aee-631a-4ece-b25b-91348a296409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:41.766639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4390aee-631a-4ece-b25b-91348a296409 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:41.887584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf020b-d651-47f7-915a-d09b98c3638f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:41.889504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-79cf020b-d651-47f7-915a-d09b98c3638f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:41.915469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf020b-d651-47f7-915a-d09b98c3638f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:41.940187 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:41.942064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:41.942354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:41.942628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] PATH_INFO: `/v3/users/d6c3cc72c82d46d3a934517284f2d0de` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:41.944930 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c3cc72c82d46d3a934517284f2d0de)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:41.947511 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:41.955713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:41.971485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 887/1777] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:41 2022] POST /identity/v3/projects => generated 383 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:41.977695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4390aee-631a-4ece-b25b-91348a296409 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:42.012654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:42.235485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4390aee-631a-4ece-b25b-91348a296409 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:42.256603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e738b99-2991-45f8-8a8c-1a83948f9bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:42.257603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e738b99-2991-45f8-8a8c-1a83948f9bef admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:42.258939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e738b99-2991-45f8-8a8c-1a83948f9bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:42.259637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e738b99-2991-45f8-8a8c-1a83948f9bef admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:42.263467 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e738b99-2991-45f8-8a8c-1a83948f9bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:42.269711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e738b99-2991-45f8-8a8c-1a83948f9bef admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:42.642879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 888/1778] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:41 2022] POST /identity/v3/users => generated 292 bytes in 665 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:42.649636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e738b99-2991-45f8-8a8c-1a83948f9bef admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:42.677617 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c3cc72c82d46d3a934517284f2d0de'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:42.680380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c3cc72c82d46d3a934517284f2d0de'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:42.680573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c3cc72c82d46d3a934517284f2d0de'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:42.696839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e738b99-2991-45f8-8a8c-1a83948f9bef admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:42.706451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c3cc72c82d46d3a934517284f2d0de'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:42.731351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ace310-6240-45bc-938b-66ace13c8a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:42.733500 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ace310-6240-45bc-938b-66ace13c8a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:42.737153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ace310-6240-45bc-938b-66ace13c8a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:42.737648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ace310-6240-45bc-938b-66ace13c8a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:42.738350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ace310-6240-45bc-938b-66ace13c8a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:42.743346 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ace310-6240-45bc-938b-66ace13c8a63 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:42.773926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c3cc72c82d46d3a934517284f2d0de'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:42.787019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 889/1779] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:42.794692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ace310-6240-45bc-938b-66ace13c8a63 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:42.801307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f8ace310-6240-45bc-938b-66ace13c8a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:42.829648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ace310-6240-45bc-938b-66ace13c8a63 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:42.841334 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef6f7c-11e5-4e4e-a56d-03d829bb787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:42.841334 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef6f7c-11e5-4e4e-a56d-03d829bb787f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:42.841611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef6f7c-11e5-4e4e-a56d-03d829bb787f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:42.842299 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef6f7c-11e5-4e4e-a56d-03d829bb787f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:42.844693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef6f7c-11e5-4e4e-a56d-03d829bb787f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:42.848665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef6f7c-11e5-4e4e-a56d-03d829bb787f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:42.885054 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 890/1780] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:42.892619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef6f7c-11e5-4e4e-a56d-03d829bb787f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:42.916966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef6f7c-11e5-4e4e-a56d-03d829bb787f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:42.928428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe183914-cb08-43df-958f-2bd5b8faa463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:42.930129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe183914-cb08-43df-958f-2bd5b8faa463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:42.930921 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe183914-cb08-43df-958f-2bd5b8faa463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:42.932345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe183914-cb08-43df-958f-2bd5b8faa463 admin admin] PATH_INFO: `/v3/projects/bc3707a2fe1d4d8697a5f5e0b788e7f0/users/61bf2527e8a148f1836b6b20ec41196c/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:43.034480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe183914-cb08-43df-958f-2bd5b8faa463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3707a2fe1d4d8697a5f5e0b788e7f0, user_id=61bf2527e8a148f1836b6b20ec41196c, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:43.035791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 891/1781] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:41 2022] DELETE /identity/v3/users/d6c3cc72c82d46d3a934517284f2d0de => generated 0 bytes in 1153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:43.038961 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:43.057021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe183914-cb08-43df-958f-2bd5b8faa463 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:43.057185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:43.218442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 891/1782] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:42 2022] PUT /identity/v3/projects/bc3707a2fe1d4d8697a5f5e0b788e7f0/users/61bf2527e8a148f1836b6b20ec41196c/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:43.222303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c629-4f56-4232-bf77-37f3d202eb37 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:43.222520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c629-4f56-4232-bf77-37f3d202eb37 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:43.225082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c629-4f56-4232-bf77-37f3d202eb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:43.286141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4a49c629-4f56-4232-bf77-37f3d202eb37 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:43.290607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4a49c629-4f56-4232-bf77-37f3d202eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:43.333344 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e61bc-d511-47b7-9e3c-30d4b2e29ee8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:43.424105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:43.492539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 892/1783] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:43.492539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7fa8a-8423-426e-a049-1fcdefc0f92e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:43.492539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7fa8a-8423-426e-a049-1fcdefc0f92e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:43.492539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7fa8a-8423-426e-a049-1fcdefc0f92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:43.518010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:43.524590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:43.524590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:43.524590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] PATH_INFO: `/v3/projects/d6aaad54c3aa4c44842413c85322fb5c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:43.524590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6aaad54c3aa4c44842413c85322fb5c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:43.524590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:43.579206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3fa7fa8a-8423-426e-a049-1fcdefc0f92e None None] MFA Rules not processed for user `61bf2527e8a148f1836b6b20ec41196c`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:43.580662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3fa7fa8a-8423-426e-a049-1fcdefc0f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:43.761669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 893/1784] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:43.764021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7fa8a-8423-426e-a049-1fcdefc0f92e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:43.770532 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3fa7fa8a-8423-426e-a049-1fcdefc0f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:43.843516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6aaad54c3aa4c44842413c85322fb5c', 'request_id': 'req-efa16dc2-511b-428c-8aba-851b1ee2df83'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:43.875829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6aaad54c3aa4c44842413c85322fb5c', 'request_id': 'req-efa16dc2-511b-428c-8aba-851b1ee2df83'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:43.949498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7fa8a-8423-426e-a049-1fcdefc0f92e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:43.968167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6aaad54c3aa4c44842413c85322fb5c', 'request_id': 'req-efa16dc2-511b-428c-8aba-851b1ee2df83'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:44.043275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] The token cache is being invalidate because project d6aaad54c3aa4c44842413c85322fb5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:44.048440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:44.048440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:44.065460 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 892/1785] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:43 2022] DELETE /identity/v3/projects/d6aaad54c3aa4c44842413c85322fb5c => generated 0 bytes in 1029 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:44.076592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:44.084202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56422f42-32fc-4948-8713-7ff534a4e96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:44.085012 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:44.085770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56422f42-32fc-4948-8713-7ff534a4e96b service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:44.089629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56422f42-32fc-4948-8713-7ff534a4e96b service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:44.090082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56422f42-32fc-4948-8713-7ff534a4e96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:44.095102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-56422f42-32fc-4948-8713-7ff534a4e96b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:44.393131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56422f42-32fc-4948-8713-7ff534a4e96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:44.399459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56422f42-32fc-4948-8713-7ff534a4e96b service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:44.403440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:44.413209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa16dc2-511b-428c-8aba-851b1ee2df83 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:44.429142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfa95b-d2c9-4429-9bf7-ee78beb4cbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:44.430381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:44.432340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfa95b-d2c9-4429-9bf7-ee78beb4cbcd admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:44.433371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfa95b-d2c9-4429-9bf7-ee78beb4cbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:44.434390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfa95b-d2c9-4429-9bf7-ee78beb4cbcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:44.437371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfa95b-d2c9-4429-9bf7-ee78beb4cbcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:44.448865 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfa95b-d2c9-4429-9bf7-ee78beb4cbcd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:44.487442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 894/1786] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:44.488760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec020a-63e0-46fb-9e92-5af4d1e56150 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:44.489045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec020a-63e0-46fb-9e92-5af4d1e56150 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:44.489347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec020a-63e0-46fb-9e92-5af4d1e56150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:44.584991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fdec020a-63e0-46fb-9e92-5af4d1e56150 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:44.586492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fdec020a-63e0-46fb-9e92-5af4d1e56150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:44.624837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 895/1787] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:44.640641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993faa6-ba16-4fd0-84db-b9dede93ed2e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:44.641920 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993faa6-ba16-4fd0-84db-b9dede93ed2e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:44.641920 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993faa6-ba16-4fd0-84db-b9dede93ed2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:44.647908 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 893/1788] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:44 2022] POST /identity/v3/projects => generated 383 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:44.652253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfa95b-d2c9-4429-9bf7-ee78beb4cbcd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:44.702037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9993faa6-ba16-4fd0-84db-b9dede93ed2e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:44.704137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9993faa6-ba16-4fd0-84db-b9dede93ed2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:44.841210 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfa95b-d2c9-4429-9bf7-ee78beb4cbcd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:44.857110 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb65acc-5787-489b-a887-f1698136c4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:44.865634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb65acc-5787-489b-a887-f1698136c4da admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:44.869533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb65acc-5787-489b-a887-f1698136c4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:44.890514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb65acc-5787-489b-a887-f1698136c4da admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:44.893839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb65acc-5787-489b-a887-f1698136c4da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:44.900797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb65acc-5787-489b-a887-f1698136c4da admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:44.963942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 896/1789] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:44.966698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993faa6-ba16-4fd0-84db-b9dede93ed2e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:44.984434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993faa6-ba16-4fd0-84db-b9dede93ed2e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:44.998637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c247b-63f6-4a41-9961-a99ac04fb859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:45.000408 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c247b-63f6-4a41-9961-a99ac04fb859 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:45.000851 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c247b-63f6-4a41-9961-a99ac04fb859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:45.001290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c247b-63f6-4a41-9961-a99ac04fb859 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:45.002166 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c247b-63f6-4a41-9961-a99ac04fb859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:30:45.002632 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c247b-63f6-4a41-9961-a99ac04fb859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:45.006710 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c247b-63f6-4a41-9961-a99ac04fb859 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:45.026470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 897/1790] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:30:45.033290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c247b-63f6-4a41-9961-a99ac04fb859 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:45.076724 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c247b-63f6-4a41-9961-a99ac04fb859 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:45.112590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8457a80-27a7-4573-9e70-2c486955ac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:45.113683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8457a80-27a7-4573-9e70-2c486955ac84 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:45.114153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8457a80-27a7-4573-9e70-2c486955ac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:45.114690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8457a80-27a7-4573-9e70-2c486955ac84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:45.115541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8457a80-27a7-4573-9e70-2c486955ac84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:45.118505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8457a80-27a7-4573-9e70-2c486955ac84 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:45.245754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 894/1791] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:44 2022] POST /identity/v3/users => generated 298 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:45.247173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb65acc-5787-489b-a887-f1698136c4da admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:45.280578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 898/1792] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:45 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:45.281483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8457a80-27a7-4573-9e70-2c486955ac84 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:45.312572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb65acc-5787-489b-a887-f1698136c4da admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:45.493312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8457a80-27a7-4573-9e70-2c486955ac84 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:45.502018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174e603-0392-47fe-8539-9fbaecfe8c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:45.502992 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174e603-0392-47fe-8539-9fbaecfe8c70 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:45.503566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174e603-0392-47fe-8539-9fbaecfe8c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:45.504040 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174e603-0392-47fe-8539-9fbaecfe8c70 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:45.504874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174e603-0392-47fe-8539-9fbaecfe8c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:45.508142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174e603-0392-47fe-8539-9fbaecfe8c70 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:45.566853 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa94a2-d57a-45dd-bbbf-ad5478392e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:45.567484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa94a2-d57a-45dd-bbbf-ad5478392e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:45.567943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa94a2-d57a-45dd-bbbf-ad5478392e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:45.568218 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa94a2-d57a-45dd-bbbf-ad5478392e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:45.568870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa94a2-d57a-45dd-bbbf-ad5478392e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:45.570557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa94a2-d57a-45dd-bbbf-ad5478392e3d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:45.592344 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 895/1793] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:45.602400 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa94a2-d57a-45dd-bbbf-ad5478392e3d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:45.613129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa94a2-d57a-45dd-bbbf-ad5478392e3d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:45.619719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71064d6-e7ca-4400-a39d-ff220f18df00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:45.632123 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 899/1794] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:45 2022] POST /identity/v3/users => generated 293 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:45.633629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:45.636372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174e603-0392-47fe-8539-9fbaecfe8c70 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:45.644363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71064d6-e7ca-4400-a39d-ff220f18df00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:45.645197 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71064d6-e7ca-4400-a39d-ff220f18df00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:45.645654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71064d6-e7ca-4400-a39d-ff220f18df00 admin admin] PATH_INFO: `/v3/projects/bc66a746d89d44ef8888cd65cf416e58/users/b150f687d78b4aaa9626be7387aeb682/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:45.671532 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174e603-0392-47fe-8539-9fbaecfe8c70 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:45.685024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594544b6-e0a6-40b9-9156-320c4d2a844b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:45.689289 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594544b6-e0a6-40b9-9156-320c4d2a844b admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:45.689905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594544b6-e0a6-40b9-9156-320c4d2a844b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:45.691478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594544b6-e0a6-40b9-9156-320c4d2a844b admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:45.692883 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594544b6-e0a6-40b9-9156-320c4d2a844b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:45.695106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71064d6-e7ca-4400-a39d-ff220f18df00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc66a746d89d44ef8888cd65cf416e58, user_id=b150f687d78b4aaa9626be7387aeb682, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:45.706321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594544b6-e0a6-40b9-9156-320c4d2a844b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:45.706490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71064d6-e7ca-4400-a39d-ff220f18df00 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:45.723627 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 900/1795] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:45.727677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594544b6-e0a6-40b9-9156-320c4d2a844b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:45.740307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594544b6-e0a6-40b9-9156-320c4d2a844b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:45.753192 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b150f5-0f8a-424e-9929-27fe51ac0d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:45.754082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b150f5-0f8a-424e-9929-27fe51ac0d61 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:45.754200 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b150f5-0f8a-424e-9929-27fe51ac0d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:45.754486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b150f5-0f8a-424e-9929-27fe51ac0d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:45.755841 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b150f5-0f8a-424e-9929-27fe51ac0d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:45.758307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b150f5-0f8a-424e-9929-27fe51ac0d61 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:45.790219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 901/1796] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:45.791361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b150f5-0f8a-424e-9929-27fe51ac0d61 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:45.809460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b150f5-0f8a-424e-9929-27fe51ac0d61 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:45.818044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 896/1797] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:45 2022] PUT /identity/v3/projects/bc66a746d89d44ef8888cd65cf416e58/users/b150f687d78b4aaa9626be7387aeb682/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:45.819590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:45.826731 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71064d6-e7ca-4400-a39d-ff220f18df00 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:46.082396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6608-03f4-4e60-bda4-dcbc6751d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:46.085156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6608-03f4-4e60-bda4-dcbc6751d6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:46.086574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6608-03f4-4e60-bda4-dcbc6751d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:46.087282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e6608-03f4-4e60-bda4-dcbc6751d6a9 admin admin] PATH_INFO: `/v3/projects/59de9372df48420d995089b642afbc4c/users/3c848b6248c14ecba1719c03126173ce/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:46.120691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71064d6-e7ca-4400-a39d-ff220f18df00 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:46.134912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f32e0c-1de2-47d1-ad85-4b6e278103da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:46.134912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f32e0c-1de2-47d1-ad85-4b6e278103da admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:46.135917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f32e0c-1de2-47d1-ad85-4b6e278103da admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:46.135917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f32e0c-1de2-47d1-ad85-4b6e278103da admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:46.137671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f32e0c-1de2-47d1-ad85-4b6e278103da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:46.145030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f32e0c-1de2-47d1-ad85-4b6e278103da admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:46.172376 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 897/1798] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:46.174492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f32e0c-1de2-47d1-ad85-4b6e278103da admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:46.179542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-26f32e0c-1de2-47d1-ad85-4b6e278103da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:46.187589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e6608-03f4-4e60-bda4-dcbc6751d6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59de9372df48420d995089b642afbc4c, user_id=3c848b6248c14ecba1719c03126173ce, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:46.195444 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e6608-03f4-4e60-bda4-dcbc6751d6a9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:46.214937 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f32e0c-1de2-47d1-ad85-4b6e278103da admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:46.224151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e78117-c9a0-4dab-98b7-280c137e2705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:46.225157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e78117-c9a0-4dab-98b7-280c137e2705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:46.225739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e78117-c9a0-4dab-98b7-280c137e2705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:46.226066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e78117-c9a0-4dab-98b7-280c137e2705 admin admin] PATH_INFO: `/v3/projects/97ff39573ad44383b891e6e0e38de730` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:46.227886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e78117-c9a0-4dab-98b7-280c137e2705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ff39573ad44383b891e6e0e38de730)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:46.233704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e78117-c9a0-4dab-98b7-280c137e2705 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:46.290182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 902/1799] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:45 2022] PUT /identity/v3/projects/59de9372df48420d995089b642afbc4c/users/3c848b6248c14ecba1719c03126173ce/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:46.292937 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6608-03f4-4e60-bda4-dcbc6751d6a9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:46.459416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e6608-03f4-4e60-bda4-dcbc6751d6a9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:46.474899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59ac78-0c95-4110-b4c4-cbd58723bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:46.474899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59ac78-0c95-4110-b4c4-cbd58723bd2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:46.474899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59ac78-0c95-4110-b4c4-cbd58723bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:46.474899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59ac78-0c95-4110-b4c4-cbd58723bd2a admin admin] PATH_INFO: `/v3/projects/bc66a746d89d44ef8888cd65cf416e58/users/b150f687d78b4aaa9626be7387aeb682/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:46.477694 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59ac78-0c95-4110-b4c4-cbd58723bd2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc66a746d89d44ef8888cd65cf416e58, user_id=b150f687d78b4aaa9626be7387aeb682, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:46.485050 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59ac78-0c95-4110-b4c4-cbd58723bd2a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:46.509439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f1e78117-c9a0-4dab-98b7-280c137e2705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ff39573ad44383b891e6e0e38de730', 'request_id': 'req-f1e78117-c9a0-4dab-98b7-280c137e2705'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:46.533621 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f1e78117-c9a0-4dab-98b7-280c137e2705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ff39573ad44383b891e6e0e38de730', 'request_id': 'req-f1e78117-c9a0-4dab-98b7-280c137e2705'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:46.569981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 903/1800] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:46 2022] PUT /identity/v3/projects/bc66a746d89d44ef8888cd65cf416e58/users/b150f687d78b4aaa9626be7387aeb682/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:46.569981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b807f-0cf9-47d2-9706-b70dfb617036 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:46.569981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b807f-0cf9-47d2-9706-b70dfb617036 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:46.569981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b807f-0cf9-47d2-9706-b70dfb617036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:46.627523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:46.630466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-096b807f-0cf9-47d2-9706-b70dfb617036 None None] MFA Rules not processed for user `3c848b6248c14ecba1719c03126173ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:46.631843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-096b807f-0cf9-47d2-9706-b70dfb617036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:46.658593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f1e78117-c9a0-4dab-98b7-280c137e2705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ff39573ad44383b891e6e0e38de730', 'request_id': 'req-f1e78117-c9a0-4dab-98b7-280c137e2705'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:46.703470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f1e78117-c9a0-4dab-98b7-280c137e2705 admin admin] The token cache is being invalidate because project 97ff39573ad44383b891e6e0e38de730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:46.703949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f1e78117-c9a0-4dab-98b7-280c137e2705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:46.705213 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f1e78117-c9a0-4dab-98b7-280c137e2705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:46.710430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 898/1801] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:46 2022] DELETE /identity/v3/projects/97ff39573ad44383b891e6e0e38de730 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:46.711994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4863b-a9f7-4656-aeea-6fd574c5cfbe None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:46.712437 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4863b-a9f7-4656-aeea-6fd574c5cfbe None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:46.713206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4863b-a9f7-4656-aeea-6fd574c5cfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:46.743362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-98b4863b-a9f7-4656-aeea-6fd574c5cfbe None None] MFA Rules not processed for user `b150f687d78b4aaa9626be7387aeb682`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:46.744591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-98b4863b-a9f7-4656-aeea-6fd574c5cfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:46.773690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 904/1802] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:46.777036 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b955ab4-67d1-482c-a598-b42b9cc7e459 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:46.777036 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b955ab4-67d1-482c-a598-b42b9cc7e459 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:46.777036 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b955ab4-67d1-482c-a598-b42b9cc7e459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:46.796437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2b955ab4-67d1-482c-a598-b42b9cc7e459 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:46.803852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2b955ab4-67d1-482c-a598-b42b9cc7e459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:46.807940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:46.834349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 899/1803] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:46.838619 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4863b-a9f7-4656-aeea-6fd574c5cfbe None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:46.845532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-98b4863b-a9f7-4656-aeea-6fd574c5cfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:46.882365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 905/1804] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:46.883296 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b955ab4-67d1-482c-a598-b42b9cc7e459 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:46.884516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2b955ab4-67d1-482c-a598-b42b9cc7e459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:46.941004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4863b-a9f7-4656-aeea-6fd574c5cfbe None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:46.948204 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cfae6-6859-4b2f-9f56-2b2c3884a8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:46.949154 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cfae6-6859-4b2f-9f56-2b2c3884a8ae admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:46.950393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cfae6-6859-4b2f-9f56-2b2c3884a8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:46.950823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cfae6-6859-4b2f-9f56-2b2c3884a8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:46.951656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cfae6-6859-4b2f-9f56-2b2c3884a8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:46.953808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cfae6-6859-4b2f-9f56-2b2c3884a8ae admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:46.968734 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b955ab4-67d1-482c-a598-b42b9cc7e459 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:46.973179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16717a19-0516-4db4-9fb7-abaf169f3fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:46.973179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16717a19-0516-4db4-9fb7-abaf169f3fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:46.973496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16717a19-0516-4db4-9fb7-abaf169f3fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:46.973733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16717a19-0516-4db4-9fb7-abaf169f3fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:46.983841 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16717a19-0516-4db4-9fb7-abaf169f3fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:46.985345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16717a19-0516-4db4-9fb7-abaf169f3fd3 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:46.995441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 906/1805] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:46.998832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343da79-cc90-4ef3-8b0c-64f0eaa4e916 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:46.998832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343da79-cc90-4ef3-8b0c-64f0eaa4e916 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:46.998832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343da79-cc90-4ef3-8b0c-64f0eaa4e916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.020790 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7343da79-cc90-4ef3-8b0c-64f0eaa4e916 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:47.020790 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7343da79-cc90-4ef3-8b0c-64f0eaa4e916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:47.033319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 907/1806] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:47.038527 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343da79-cc90-4ef3-8b0c-64f0eaa4e916 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:47.049781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343da79-cc90-4ef3-8b0c-64f0eaa4e916 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:47.055450 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c2008-70ac-4cc9-9af5-8e84b36c541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:47.056089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c2008-70ac-4cc9-9af5-8e84b36c541a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.056451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c2008-70ac-4cc9-9af5-8e84b36c541a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.056732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c2008-70ac-4cc9-9af5-8e84b36c541a admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.057448 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c2008-70ac-4cc9-9af5-8e84b36c541a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:30:47.057829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c2008-70ac-4cc9-9af5-8e84b36c541a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:47.069145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c2008-70ac-4cc9-9af5-8e84b36c541a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:47.069602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 900/1807] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:46 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:47.070536 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cfae6-6859-4b2f-9f56-2b2c3884a8ae admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:47.079407 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 908/1808] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:30:47.080618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c2008-70ac-4cc9-9af5-8e84b36c541a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:47.091831 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c2008-70ac-4cc9-9af5-8e84b36c541a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:47.143488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cfae6-6859-4b2f-9f56-2b2c3884a8ae admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:47.153774 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c363a5-0b8d-4dd3-89f7-6ab5feb19ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:47.154472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c363a5-0b8d-4dd3-89f7-6ab5feb19ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.154849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c363a5-0b8d-4dd3-89f7-6ab5feb19ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.155751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c363a5-0b8d-4dd3-89f7-6ab5feb19ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.156496 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c363a5-0b8d-4dd3-89f7-6ab5feb19ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:47.158555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c363a5-0b8d-4dd3-89f7-6ab5feb19ed7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:47.159350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9df9b9-a2e8-41f4-94df-382689006f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:47.160032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9df9b9-a2e8-41f4-94df-382689006f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.160420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9df9b9-a2e8-41f4-94df-382689006f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.160753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9df9b9-a2e8-41f4-94df-382689006f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.161464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9df9b9-a2e8-41f4-94df-382689006f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:47.163502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9df9b9-a2e8-41f4-94df-382689006f59 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:47.261348 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 901/1809] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:47 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:30:47.262333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c363a5-0b8d-4dd3-89f7-6ab5feb19ed7 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:47.286601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 909/1810] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:47 2022] POST /identity/v3/projects => generated 403 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:47.287535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9df9b9-a2e8-41f4-94df-382689006f59 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:47.326395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c363a5-0b8d-4dd3-89f7-6ab5feb19ed7 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:47.352540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9df9b9-a2e8-41f4-94df-382689006f59 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:47.357492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15957c-27a7-40b4-8e4d-3a0f2da22c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:47.358125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15957c-27a7-40b4-8e4d-3a0f2da22c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.358403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15957c-27a7-40b4-8e4d-3a0f2da22c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.358674 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15957c-27a7-40b4-8e4d-3a0f2da22c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.359306 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15957c-27a7-40b4-8e4d-3a0f2da22c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:47.360928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15957c-27a7-40b4-8e4d-3a0f2da22c86 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:47.374273 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 910/1811] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:47.374273 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15957c-27a7-40b4-8e4d-3a0f2da22c86 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:47.376406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332353fd-5c13-4198-843e-9a5e02bc9d82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:47.377025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332353fd-5c13-4198-843e-9a5e02bc9d82 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.377331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332353fd-5c13-4198-843e-9a5e02bc9d82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.377609 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332353fd-5c13-4198-843e-9a5e02bc9d82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.380444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-332353fd-5c13-4198-843e-9a5e02bc9d82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:47.381977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15957c-27a7-40b4-8e4d-3a0f2da22c86 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:47.386857 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8abe00-38c0-42ae-8fdb-2c737f26e6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:47.387606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8abe00-38c0-42ae-8fdb-2c737f26e6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.387886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8abe00-38c0-42ae-8fdb-2c737f26e6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.388164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8abe00-38c0-42ae-8fdb-2c737f26e6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.388830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8abe00-38c0-42ae-8fdb-2c737f26e6e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:47.390985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8abe00-38c0-42ae-8fdb-2c737f26e6e3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:47.449210 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332353fd-5c13-4198-843e-9a5e02bc9d82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:47.450635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332353fd-5c13-4198-843e-9a5e02bc9d82 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:47.459677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 902/1812] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:47.460993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332353fd-5c13-4198-843e-9a5e02bc9d82 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:47.479140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332353fd-5c13-4198-843e-9a5e02bc9d82 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:47.479274 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 911/1813] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:47 2022] POST /identity/v3/users => generated 302 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:47.482735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8abe00-38c0-42ae-8fdb-2c737f26e6e3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:47.485641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad14ff5-aef8-4fb7-85e4-557e0f115c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:47.486484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad14ff5-aef8-4fb7-85e4-557e0f115c11 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.486951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad14ff5-aef8-4fb7-85e4-557e0f115c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.487390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad14ff5-aef8-4fb7-85e4-557e0f115c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.488315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad14ff5-aef8-4fb7-85e4-557e0f115c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:47.490182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad14ff5-aef8-4fb7-85e4-557e0f115c11 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:47.504216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 903/1814] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:47.505319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8abe00-38c0-42ae-8fdb-2c737f26e6e3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:47.505442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad14ff5-aef8-4fb7-85e4-557e0f115c11 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:47.517315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad14ff5-aef8-4fb7-85e4-557e0f115c11 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:47.521458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428eae1-d529-4292-84f7-8dc16eac3541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:47.521991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade7fce-876f-43fd-8ca8-1799fc2dd5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:47.522224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428eae1-d529-4292-84f7-8dc16eac3541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.522755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428eae1-d529-4292-84f7-8dc16eac3541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.523039 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428eae1-d529-4292-84f7-8dc16eac3541 admin admin] PATH_INFO: `/v3/projects/a56f6229d3604baa98501dfe0d885b08/users/8242bd6e99664bd4ac10d2eaa903ad79/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.523593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade7fce-876f-43fd-8ca8-1799fc2dd5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.524015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade7fce-876f-43fd-8ca8-1799fc2dd5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.524373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade7fce-876f-43fd-8ca8-1799fc2dd5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.525119 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade7fce-876f-43fd-8ca8-1799fc2dd5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:47.528202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:47.532958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade7fce-876f-43fd-8ca8-1799fc2dd5d6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:47.540384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428eae1-d529-4292-84f7-8dc16eac3541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56f6229d3604baa98501dfe0d885b08, user_id=8242bd6e99664bd4ac10d2eaa903ad79, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:47.543771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428eae1-d529-4292-84f7-8dc16eac3541 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:47.549417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 912/1815] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:30:47.553076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade7fce-876f-43fd-8ca8-1799fc2dd5d6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:47.563560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade7fce-876f-43fd-8ca8-1799fc2dd5d6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:47.568870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd48298-8602-4078-a584-696cc468eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:47.569707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd48298-8602-4078-a584-696cc468eef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.569990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd48298-8602-4078-a584-696cc468eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.570540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd48298-8602-4078-a584-696cc468eef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.571164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd48298-8602-4078-a584-696cc468eef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:47.572624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd48298-8602-4078-a584-696cc468eef1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:47.584747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 913/1816] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:47.589242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd48298-8602-4078-a584-696cc468eef1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:47.602660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd48298-8602-4078-a584-696cc468eef1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:47.608956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b96e4-0c43-4e32-9a43-6da6f1719ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:47.611497 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b96e4-0c43-4e32-9a43-6da6f1719ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.611497 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b96e4-0c43-4e32-9a43-6da6f1719ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.611497 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b96e4-0c43-4e32-9a43-6da6f1719ee8 admin admin] PATH_INFO: `/v3/projects/a7ce1605fea44e37a3acfa8d14e6496c/users/faba5c10f78541d3aad3b26caa220ffd/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.629050 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b96e4-0c43-4e32-9a43-6da6f1719ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ce1605fea44e37a3acfa8d14e6496c, user_id=faba5c10f78541d3aad3b26caa220ffd, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:47.634455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b96e4-0c43-4e32-9a43-6da6f1719ee8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:47.640544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 904/1817] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:47 2022] PUT /identity/v3/projects/a56f6229d3604baa98501dfe0d885b08/users/8242bd6e99664bd4ac10d2eaa903ad79/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:30:47.651190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b123fb-ded0-4292-a095-6c01491855d4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.651870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b123fb-ded0-4292-a095-6c01491855d4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.652221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b123fb-ded0-4292-a095-6c01491855d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.717025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-05b123fb-ded0-4292-a095-6c01491855d4 None None] MFA Rules not processed for user `8242bd6e99664bd4ac10d2eaa903ad79`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:47.725378 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-05b123fb-ded0-4292-a095-6c01491855d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:47.727555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 914/1818] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:47 2022] PUT /identity/v3/projects/a7ce1605fea44e37a3acfa8d14e6496c/users/faba5c10f78541d3aad3b26caa220ffd/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:47.732272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1021ea-9364-4a9e-9368-23034ba56602 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.732559 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1021ea-9364-4a9e-9368-23034ba56602 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.732828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1021ea-9364-4a9e-9368-23034ba56602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.756138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bb1021ea-9364-4a9e-9368-23034ba56602 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:47.758092 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bb1021ea-9364-4a9e-9368-23034ba56602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:47.807585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 905/1819] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:30:47.813629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b123fb-ded0-4292-a095-6c01491855d4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:47.829574 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:47.840640 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 915/1820] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:30:47.848796 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1021ea-9364-4a9e-9368-23034ba56602 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:47.850538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bb1021ea-9364-4a9e-9368-23034ba56602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:47.922206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b123fb-ded0-4292-a095-6c01491855d4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:47.926829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f083c22-6378-40d7-9ba7-7eefba10d0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:47.927524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f083c22-6378-40d7-9ba7-7eefba10d0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.927799 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f083c22-6378-40d7-9ba7-7eefba10d0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.928070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f083c22-6378-40d7-9ba7-7eefba10d0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.928707 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f083c22-6378-40d7-9ba7-7eefba10d0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:47.930654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f083c22-6378-40d7-9ba7-7eefba10d0e5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:47.931493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1021ea-9364-4a9e-9368-23034ba56602 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:47.935457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5361c1-3f2c-4a24-8393-e2d77a476985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:47.936190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5361c1-3f2c-4a24-8393-e2d77a476985 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:47.936451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5361c1-3f2c-4a24-8393-e2d77a476985 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:47.936723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5361c1-3f2c-4a24-8393-e2d77a476985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:47.946704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5361c1-3f2c-4a24-8393-e2d77a476985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:47.948154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5361c1-3f2c-4a24-8393-e2d77a476985 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:47.958563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 916/1821] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:30:48.286542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 906/1822] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:47 2022] POST /identity/v3/projects => generated 383 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:30:48.290626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5361c1-3f2c-4a24-8393-e2d77a476985 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:48.301345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5361c1-3f2c-4a24-8393-e2d77a476985 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:48.370706 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3f340-f312-481b-a82b-c577facf53fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:48.371200 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3f340-f312-481b-a82b-c577facf53fc admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:48.371478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3f340-f312-481b-a82b-c577facf53fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:48.371749 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3f340-f312-481b-a82b-c577facf53fc admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:48.372373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3f340-f312-481b-a82b-c577facf53fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:48.374862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3f340-f312-481b-a82b-c577facf53fc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:48.487532 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 917/1823] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:48 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:48.491414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f083c22-6378-40d7-9ba7-7eefba10d0e5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:48.503768 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f083c22-6378-40d7-9ba7-7eefba10d0e5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:48.508460 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b97dc8-a5dc-41ef-ba42-da5a72f4eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:48.513597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b97dc8-a5dc-41ef-ba42-da5a72f4eb8e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:48.513597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b97dc8-a5dc-41ef-ba42-da5a72f4eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:48.513597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b97dc8-a5dc-41ef-ba42-da5a72f4eb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:48.513597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b97dc8-a5dc-41ef-ba42-da5a72f4eb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:48.513597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b97dc8-a5dc-41ef-ba42-da5a72f4eb8e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:48.524093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 907/1824] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:48.530319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3f340-f312-481b-a82b-c577facf53fc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:48.546262 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3f340-f312-481b-a82b-c577facf53fc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:48.553648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947e786-7fa2-47de-b459-aacc35240957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:48.554467 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947e786-7fa2-47de-b459-aacc35240957 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:48.554818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947e786-7fa2-47de-b459-aacc35240957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:48.555219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947e786-7fa2-47de-b459-aacc35240957 admin admin] PATH_INFO: `/v3/projects/389385db19e14f6d94b1baa7413c7d30/users/294808297b2c46e89561b873cdc0080b/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:48.573623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947e786-7fa2-47de-b459-aacc35240957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389385db19e14f6d94b1baa7413c7d30, user_id=294808297b2c46e89561b873cdc0080b, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:48.576447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947e786-7fa2-47de-b459-aacc35240957 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:48.714386 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 918/1825] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:48 2022] PUT /identity/v3/projects/389385db19e14f6d94b1baa7413c7d30/users/294808297b2c46e89561b873cdc0080b/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:48.715423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b97dc8-a5dc-41ef-ba42-da5a72f4eb8e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:48.730539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b97dc8-a5dc-41ef-ba42-da5a72f4eb8e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:48.809191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f422d7-e498-4b04-abcd-71d446b765ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:48.810102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f422d7-e498-4b04-abcd-71d446b765ac admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:48.810102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f422d7-e498-4b04-abcd-71d446b765ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:48.810369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f422d7-e498-4b04-abcd-71d446b765ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:48.811035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f422d7-e498-4b04-abcd-71d446b765ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:48.813978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f422d7-e498-4b04-abcd-71d446b765ac admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:48.833676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 908/1826] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:48.837144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947e786-7fa2-47de-b459-aacc35240957 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:48.864249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947e786-7fa2-47de-b459-aacc35240957 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:48.871654 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61037d4-f2bd-414b-912f-adc1d2a94227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:48.872416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61037d4-f2bd-414b-912f-adc1d2a94227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:48.872699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61037d4-f2bd-414b-912f-adc1d2a94227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:48.872976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61037d4-f2bd-414b-912f-adc1d2a94227 admin admin] PATH_INFO: `/v3/projects/389385db19e14f6d94b1baa7413c7d30/users/294808297b2c46e89561b873cdc0080b/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:48.876299 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61037d4-f2bd-414b-912f-adc1d2a94227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389385db19e14f6d94b1baa7413c7d30, user_id=294808297b2c46e89561b873cdc0080b, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:48.879102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61037d4-f2bd-414b-912f-adc1d2a94227 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:48.917142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 919/1827] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:48 2022] PUT /identity/v3/projects/389385db19e14f6d94b1baa7413c7d30/users/294808297b2c46e89561b873cdc0080b/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:30:48.929083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d44ea-d8a6-4655-938f-2110e2be65e4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:48.929505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d44ea-d8a6-4655-938f-2110e2be65e4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:48.929871 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d44ea-d8a6-4655-938f-2110e2be65e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:48.960741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c49d44ea-d8a6-4655-938f-2110e2be65e4 None None] MFA Rules not processed for user `294808297b2c46e89561b873cdc0080b`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:48.962085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c49d44ea-d8a6-4655-938f-2110e2be65e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:49.036502 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 909/1828] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:49.054929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61037d4-f2bd-414b-912f-adc1d2a94227 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:49.076848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:49.182716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61037d4-f2bd-414b-912f-adc1d2a94227 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:49.187412 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084bb6b-8bca-4ff5-a43c-cd32e91b32de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:49.188042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084bb6b-8bca-4ff5-a43c-cd32e91b32de service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:49.188317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084bb6b-8bca-4ff5-a43c-cd32e91b32de service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:49.188588 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084bb6b-8bca-4ff5-a43c-cd32e91b32de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:49.321796 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084bb6b-8bca-4ff5-a43c-cd32e91b32de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:49.324175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084bb6b-8bca-4ff5-a43c-cd32e91b32de service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:49.349662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 920/1829] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:49.777233 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d44ea-d8a6-4655-938f-2110e2be65e4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:49.778812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c49d44ea-d8a6-4655-938f-2110e2be65e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:49.891185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d44ea-d8a6-4655-938f-2110e2be65e4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:49.903895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:49.904476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:49.905249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:49.905705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] PATH_INFO: `/v3/users/6bb2a3c9e07a4483972b45a0a8a1822c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:49.907293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bb2a3c9e07a4483972b45a0a8a1822c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:49.909565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:50.172721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb217f-3391-4803-9e1c-b870ebb08fd5 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:50.173359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb217f-3391-4803-9e1c-b870ebb08fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:50.179400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb217f-3391-4803-9e1c-b870ebb08fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:50.200923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:50.242522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0dfb217f-3391-4803-9e1c-b870ebb08fd5 None None] MFA Rules not processed for user `faba5c10f78541d3aad3b26caa220ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:50.243986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bb2a3c9e07a4483972b45a0a8a1822c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:50.244759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0dfb217f-3391-4803-9e1c-b870ebb08fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:50.244884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bb2a3c9e07a4483972b45a0a8a1822c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:50.245422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bb2a3c9e07a4483972b45a0a8a1822c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:50.259550 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bb2a3c9e07a4483972b45a0a8a1822c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:50.288754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bb2a3c9e07a4483972b45a0a8a1822c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:50.384038 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 910/1830] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:49 2022] DELETE /identity/v3/users/6bb2a3c9e07a4483972b45a0a8a1822c => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:50.384707 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:50.387104 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:50.387441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 921/1831] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:50.390818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20957cfb-9c74-4138-b0a9-e4d35cde2d23 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:50.391608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20957cfb-9c74-4138-b0a9-e4d35cde2d23 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:50.391845 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20957cfb-9c74-4138-b0a9-e4d35cde2d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:50.430949 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-20957cfb-9c74-4138-b0a9-e4d35cde2d23 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:50.432414 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-20957cfb-9c74-4138-b0a9-e4d35cde2d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:50.484136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20573aa9-7ce0-4124-99cd-8a438d33380d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:50.502989 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 922/1832] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:50.507823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebe235-96b2-4802-8855-ffecdc11eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:50.508720 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebe235-96b2-4802-8855-ffecdc11eed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:50.509304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebe235-96b2-4802-8855-ffecdc11eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:50.509790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebe235-96b2-4802-8855-ffecdc11eed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:50.510949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebe235-96b2-4802-8855-ffecdc11eed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:50.511769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20957cfb-9c74-4138-b0a9-e4d35cde2d23 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:50.513167 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-20957cfb-9c74-4138-b0a9-e4d35cde2d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:50.514681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebe235-96b2-4802-8855-ffecdc11eed4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:50.582636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20957cfb-9c74-4138-b0a9-e4d35cde2d23 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:50.586345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbea28-413c-40d0-bb30-cb2f9fbb3cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:50.586951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbea28-413c-40d0-bb30-cb2f9fbb3cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:50.587223 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbea28-413c-40d0-bb30-cb2f9fbb3cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:50.587495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbea28-413c-40d0-bb30-cb2f9fbb3cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:50.609407 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbea28-413c-40d0-bb30-cb2f9fbb3cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:50.611066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbea28-413c-40d0-bb30-cb2f9fbb3cc7 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:50.623208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 923/1833] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:30:50.649303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 911/1834] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:50 2022] POST /identity/v3/projects => generated 401 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:50.653098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbea28-413c-40d0-bb30-cb2f9fbb3cc7 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:50.672382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbea28-413c-40d0-bb30-cb2f9fbb3cc7 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:50.753383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5cbf2-b585-4517-a47b-5078081b3ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:50.754017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5cbf2-b585-4517-a47b-5078081b3ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:50.754352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5cbf2-b585-4517-a47b-5078081b3ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:50.754729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5cbf2-b585-4517-a47b-5078081b3ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:50.755366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5cbf2-b585-4517-a47b-5078081b3ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:50.757721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5cbf2-b585-4517-a47b-5078081b3ad3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:50.874664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 924/1835] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:50 2022] POST /identity/v3/users => generated 307 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:50.878611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebe235-96b2-4802-8855-ffecdc11eed4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:50.890484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebe235-96b2-4802-8855-ffecdc11eed4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:50.896088 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e946362-96e3-4b03-89ed-0944666fd250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:50.899674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e946362-96e3-4b03-89ed-0944666fd250 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:50.899674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e946362-96e3-4b03-89ed-0944666fd250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:50.899674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e946362-96e3-4b03-89ed-0944666fd250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:50.899674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e946362-96e3-4b03-89ed-0944666fd250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:50.900526 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e946362-96e3-4b03-89ed-0944666fd250 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:50.913190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 912/1836] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:50.917444 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5cbf2-b585-4517-a47b-5078081b3ad3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:50.929298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5cbf2-b585-4517-a47b-5078081b3ad3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:50.934626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786b0af-5447-4dce-808b-d01e696868c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:50.936703 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786b0af-5447-4dce-808b-d01e696868c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:50.937083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786b0af-5447-4dce-808b-d01e696868c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:50.937548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786b0af-5447-4dce-808b-d01e696868c8 admin admin] PATH_INFO: `/v3/projects/e129a666739b422bb6a36f2d45699465/users/46b3b858df9e413c873c6734b54ca0c4/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:50.960089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786b0af-5447-4dce-808b-d01e696868c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e129a666739b422bb6a36f2d45699465, user_id=46b3b858df9e413c873c6734b54ca0c4, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:50.962988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786b0af-5447-4dce-808b-d01e696868c8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:51.033117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 925/1837] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:50 2022] PUT /identity/v3/projects/e129a666739b422bb6a36f2d45699465/users/46b3b858df9e413c873c6734b54ca0c4/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:51.037280 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e946362-96e3-4b03-89ed-0944666fd250 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:51.048103 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e946362-96e3-4b03-89ed-0944666fd250 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:51.056183 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:51.112117 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab076e2-236a-45a4-868d-eab688c961b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:51.112729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab076e2-236a-45a4-868d-eab688c961b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:51.113011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab076e2-236a-45a4-868d-eab688c961b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:51.113305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab076e2-236a-45a4-868d-eab688c961b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:51.113939 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab076e2-236a-45a4-868d-eab688c961b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:51.115576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab076e2-236a-45a4-868d-eab688c961b9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:51.126863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 913/1838] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:51.130854 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786b0af-5447-4dce-808b-d01e696868c8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:51.141949 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786b0af-5447-4dce-808b-d01e696868c8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:51.151471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2842c-5405-4fc2-a408-afc16a9a0ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:51.152162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2842c-5405-4fc2-a408-afc16a9a0ade admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:51.152436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2842c-5405-4fc2-a408-afc16a9a0ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:51.156158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2842c-5405-4fc2-a408-afc16a9a0ade admin admin] PATH_INFO: `/v3/projects/e129a666739b422bb6a36f2d45699465/users/46b3b858df9e413c873c6734b54ca0c4/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:51.156437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2842c-5405-4fc2-a408-afc16a9a0ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=e129a666739b422bb6a36f2d45699465, user_id=46b3b858df9e413c873c6734b54ca0c4, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:51.159100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2842c-5405-4fc2-a408-afc16a9a0ade admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:51.170327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 926/1839] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:51 2022] PUT /identity/v3/projects/e129a666739b422bb6a36f2d45699465/users/46b3b858df9e413c873c6734b54ca0c4/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:51.212358 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab076e2-236a-45a4-868d-eab688c961b9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:51.214678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-aab076e2-236a-45a4-868d-eab688c961b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:51.229666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab076e2-236a-45a4-868d-eab688c961b9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:51.309630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:51.310845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:51.311390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:51.311918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b admin admin] PATH_INFO: `/v3/projects/75ff5270123943fe8cabc435a7d7595f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:51.314181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ff5270123943fe8cabc435a7d7595f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:51.318991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:51.364557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2842c-5405-4fc2-a408-afc16a9a0ade admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:51.369836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5fb2842c-5405-4fc2-a408-afc16a9a0ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:51.382906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2842c-5405-4fc2-a408-afc16a9a0ade admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:51.388150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351aaa4-3f3d-41cb-88fa-f0c944dcd059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:51.389292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351aaa4-3f3d-41cb-88fa-f0c944dcd059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:51.389822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351aaa4-3f3d-41cb-88fa-f0c944dcd059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:51.390329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351aaa4-3f3d-41cb-88fa-f0c944dcd059 admin admin] PATH_INFO: `/v3/users/61bf2527e8a148f1836b6b20ec41196c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:51.391891 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351aaa4-3f3d-41cb-88fa-f0c944dcd059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61bf2527e8a148f1836b6b20ec41196c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:51.394366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351aaa4-3f3d-41cb-88fa-f0c944dcd059 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:51.461629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ff5270123943fe8cabc435a7d7595f', 'request_id': 'req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:51.484415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ff5270123943fe8cabc435a7d7595f', 'request_id': 'req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:51.641601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ff5270123943fe8cabc435a7d7595f', 'request_id': 'req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:51.661439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b admin admin] The token cache is being invalidate because project 75ff5270123943fe8cabc435a7d7595f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:51.661781 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:51.662462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a6e42fd9-e6bf-4c33-9db9-2fe0e4d87e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:51.667640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 914/1840] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:51 2022] DELETE /identity/v3/projects/75ff5270123943fe8cabc435a7d7595f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:51.670265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72f8c8-ce7d-4c54-8a7c-0f38b75e9075 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:51.670689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72f8c8-ce7d-4c54-8a7c-0f38b75e9075 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:51.670973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72f8c8-ce7d-4c54-8a7c-0f38b75e9075 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:51.672680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 915/1841] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:30:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:30:51.673483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72f8c8-ce7d-4c54-8a7c-0f38b75e9075 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:51.675221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1f72f8c8-ce7d-4c54-8a7c-0f38b75e9075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:51.713672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b351aaa4-3f3d-41cb-88fa-f0c944dcd059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61bf2527e8a148f1836b6b20ec41196c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:51.827721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72f8c8-ce7d-4c54-8a7c-0f38b75e9075 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:51.853143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f27177-a1fe-480b-825a-f5f85d53923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:51.854532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f27177-a1fe-480b-825a-f5f85d53923d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:51.854897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f27177-a1fe-480b-825a-f5f85d53923d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:51.856599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f27177-a1fe-480b-825a-f5f85d53923d admin admin] PATH_INFO: `/v3/users/8c51ca289b504d4e896da697abe9b4a3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:51.859438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f27177-a1fe-480b-825a-f5f85d53923d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c51ca289b504d4e896da697abe9b4a3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:51.862715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f27177-a1fe-480b-825a-f5f85d53923d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:51.933329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b351aaa4-3f3d-41cb-88fa-f0c944dcd059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61bf2527e8a148f1836b6b20ec41196c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:51.934310 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b351aaa4-3f3d-41cb-88fa-f0c944dcd059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61bf2527e8a148f1836b6b20ec41196c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:51.934940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b351aaa4-3f3d-41cb-88fa-f0c944dcd059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61bf2527e8a148f1836b6b20ec41196c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:51.943529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b351aaa4-3f3d-41cb-88fa-f0c944dcd059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61bf2527e8a148f1836b6b20ec41196c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:51.963100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 927/1842] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:51 2022] DELETE /identity/v3/users/61bf2527e8a148f1836b6b20ec41196c => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:30:51.971974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83b900-1266-4d2c-9be4-da50f1eba9cc None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:51.971974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83b900-1266-4d2c-9be4-da50f1eba9cc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:51.971974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83b900-1266-4d2c-9be4-da50f1eba9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:51.997625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8f83b900-1266-4d2c-9be4-da50f1eba9cc None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:52.000697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8f83b900-1266-4d2c-9be4-da50f1eba9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:52.097178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 928/1843] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:30:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:52.098187 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83b900-1266-4d2c-9be4-da50f1eba9cc None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:52.099593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8f83b900-1266-4d2c-9be4-da50f1eba9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:52.129173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-92f27177-a1fe-480b-825a-f5f85d53923d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c51ca289b504d4e896da697abe9b4a3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:52.130071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-92f27177-a1fe-480b-825a-f5f85d53923d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c51ca289b504d4e896da697abe9b4a3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:52.135124 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-92f27177-a1fe-480b-825a-f5f85d53923d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c51ca289b504d4e896da697abe9b4a3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:52.153014 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-92f27177-a1fe-480b-825a-f5f85d53923d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c51ca289b504d4e896da697abe9b4a3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:52.207379 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-92f27177-a1fe-480b-825a-f5f85d53923d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c51ca289b504d4e896da697abe9b4a3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:52.239104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83b900-1266-4d2c-9be4-da50f1eba9cc None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:52.252490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad0d1c-8397-425d-b7ff-c541410a580a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:52.253066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad0d1c-8397-425d-b7ff-c541410a580a service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:52.253433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad0d1c-8397-425d-b7ff-c541410a580a service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:52.253650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad0d1c-8397-425d-b7ff-c541410a580a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:52.256960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c5ad0d1c-8397-425d-b7ff-c541410a580a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:52.298078 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:52.308053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 916/1844] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:51 2022] DELETE /identity/v3/users/8c51ca289b504d4e896da697abe9b4a3 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:52.309891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557affd-8e56-422c-acae-a6848f016b48 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:52.310177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557affd-8e56-422c-acae-a6848f016b48 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:52.310608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557affd-8e56-422c-acae-a6848f016b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:52.331603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad0d1c-8397-425d-b7ff-c541410a580a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:52.333238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad0d1c-8397-425d-b7ff-c541410a580a service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:52.334520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8557affd-8e56-422c-acae-a6848f016b48 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:52.335847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8557affd-8e56-422c-acae-a6848f016b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:52.346232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 929/1845] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:52.347187 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad0d1c-8397-425d-b7ff-c541410a580a service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:52.348854 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c5ad0d1c-8397-425d-b7ff-c541410a580a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:52.368719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad0d1c-8397-425d-b7ff-c541410a580a service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:52.445626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 917/1846] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:52.475866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e51408-1705-4a4f-bd4f-3703e56e53aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:52.478914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557affd-8e56-422c-acae-a6848f016b48 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:52.480520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e51408-1705-4a4f-bd4f-3703e56e53aa service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:52.480520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e51408-1705-4a4f-bd4f-3703e56e53aa service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:52.480694 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e51408-1705-4a4f-bd4f-3703e56e53aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:52.483177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8557affd-8e56-422c-acae-a6848f016b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:52.493193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d0e51408-1705-4a4f-bd4f-3703e56e53aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:52.521756 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e51408-1705-4a4f-bd4f-3703e56e53aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:52.527501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e51408-1705-4a4f-bd4f-3703e56e53aa service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:52.556505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 930/1847] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:52.652229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557affd-8e56-422c-acae-a6848f016b48 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:52.669625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87eb9d-1a99-409b-91ac-921a6d42f34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:52.671090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87eb9d-1a99-409b-91ac-921a6d42f34b service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:52.671655 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87eb9d-1a99-409b-91ac-921a6d42f34b service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:52.672224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87eb9d-1a99-409b-91ac-921a6d42f34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:52.697147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87eb9d-1a99-409b-91ac-921a6d42f34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:52.702850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87eb9d-1a99-409b-91ac-921a6d42f34b service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:52.711515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 918/1848] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:53.087465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:53.151165 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e51408-1705-4a4f-bd4f-3703e56e53aa service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:53.151165 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d0e51408-1705-4a4f-bd4f-3703e56e53aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:53.187756 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e51408-1705-4a4f-bd4f-3703e56e53aa service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:53.205118 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584e097-5380-4e0d-8163-ea576e12ea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:53.207037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584e097-5380-4e0d-8163-ea576e12ea1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:53.207037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584e097-5380-4e0d-8163-ea576e12ea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:53.207037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584e097-5380-4e0d-8163-ea576e12ea1a admin admin] PATH_INFO: `/v3/projects/eb304d71bbda485a9302c3b9d9341e65` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:53.210088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584e097-5380-4e0d-8163-ea576e12ea1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb304d71bbda485a9302c3b9d9341e65)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:53.212886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584e097-5380-4e0d-8163-ea576e12ea1a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:53.352185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e584e097-5380-4e0d-8163-ea576e12ea1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb304d71bbda485a9302c3b9d9341e65', 'request_id': 'req-e584e097-5380-4e0d-8163-ea576e12ea1a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:53.365671 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e584e097-5380-4e0d-8163-ea576e12ea1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb304d71bbda485a9302c3b9d9341e65', 'request_id': 'req-e584e097-5380-4e0d-8163-ea576e12ea1a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:53.484249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e584e097-5380-4e0d-8163-ea576e12ea1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb304d71bbda485a9302c3b9d9341e65', 'request_id': 'req-e584e097-5380-4e0d-8163-ea576e12ea1a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:53.496604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e584e097-5380-4e0d-8163-ea576e12ea1a admin admin] The token cache is being invalidate because project eb304d71bbda485a9302c3b9d9341e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:53.497010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e584e097-5380-4e0d-8163-ea576e12ea1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:53.497787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e584e097-5380-4e0d-8163-ea576e12ea1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:53.499851 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 931/1849] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:53 2022] DELETE /identity/v3/projects/eb304d71bbda485a9302c3b9d9341e65 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:53.504828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845dd8-572e-48fc-af09-342240b11036 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:53.505373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845dd8-572e-48fc-af09-342240b11036 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:53.505462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9845dd8-572e-48fc-af09-342240b11036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:53.531430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e9845dd8-572e-48fc-af09-342240b11036 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:53.532764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e9845dd8-572e-48fc-af09-342240b11036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:53.612584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 919/1850] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:30:53.622347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ace72-e530-43ec-80ea-3d0cd6bb8bf9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:53.622983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ace72-e530-43ec-80ea-3d0cd6bb8bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:53.623986 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ace72-e530-43ec-80ea-3d0cd6bb8bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:53.685368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c60ace72-e530-43ec-80ea-3d0cd6bb8bf9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:53.687931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c60ace72-e530-43ec-80ea-3d0cd6bb8bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:53.704417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 932/1851] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:53.713707 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9845dd8-572e-48fc-af09-342240b11036 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:53.724127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9845dd8-572e-48fc-af09-342240b11036 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:53.729585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd62bb-495a-432a-a7fa-236eccde4902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:53.730702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd62bb-495a-432a-a7fa-236eccde4902 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:53.733297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd62bb-495a-432a-a7fa-236eccde4902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:53.733297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd62bb-495a-432a-a7fa-236eccde4902 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:53.733297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd62bb-495a-432a-a7fa-236eccde4902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:30:53.733297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd62bb-495a-432a-a7fa-236eccde4902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:53.735027 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd62bb-495a-432a-a7fa-236eccde4902 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:53.748095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 920/1852] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:30:53.753083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ace72-e530-43ec-80ea-3d0cd6bb8bf9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:53.762796 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ace72-e530-43ec-80ea-3d0cd6bb8bf9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:53.768536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66674068-17d5-4423-9ff6-06c8ded4e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:53.769252 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66674068-17d5-4423-9ff6-06c8ded4e552 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:53.769562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66674068-17d5-4423-9ff6-06c8ded4e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:53.769829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66674068-17d5-4423-9ff6-06c8ded4e552 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:53.770466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66674068-17d5-4423-9ff6-06c8ded4e552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:53.772545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66674068-17d5-4423-9ff6-06c8ded4e552 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:53.901491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 933/1853] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:53 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:30:53.902098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd62bb-495a-432a-a7fa-236eccde4902 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:53.916994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd62bb-495a-432a-a7fa-236eccde4902 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:54.017517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93867d3-9ed5-4643-a067-1b22cbbda318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:54.017715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93867d3-9ed5-4643-a067-1b22cbbda318 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:54.017978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93867d3-9ed5-4643-a067-1b22cbbda318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:54.018253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93867d3-9ed5-4643-a067-1b22cbbda318 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:54.018911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93867d3-9ed5-4643-a067-1b22cbbda318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:54.020960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93867d3-9ed5-4643-a067-1b22cbbda318 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:54.048870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66674068-17d5-4423-9ff6-06c8ded4e552 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:54.050677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-66674068-17d5-4423-9ff6-06c8ded4e552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:54.072024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66674068-17d5-4423-9ff6-06c8ded4e552 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:54.078071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:54.078718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:54.079048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:54.079324 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] PATH_INFO: `/v3/projects/bc3707a2fe1d4d8697a5f5e0b788e7f0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:54.080656 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3707a2fe1d4d8697a5f5e0b788e7f0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:54.082938 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:54.168806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:54.178967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 921/1854] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:53 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:54.180763 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b2516-a31c-4cfd-ac99-ba4d26dbfbb2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:54.181289 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b2516-a31c-4cfd-ac99-ba4d26dbfbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:54.182073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b2516-a31c-4cfd-ac99-ba4d26dbfbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:54.232560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-689b2516-a31c-4cfd-ac99-ba4d26dbfbb2 None None] MFA Rules not processed for user `46b3b858df9e413c873c6734b54ca0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:54.241144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-689b2516-a31c-4cfd-ac99-ba4d26dbfbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:54.352188 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 922/1855] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:54 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:54.352188 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b2516-a31c-4cfd-ac99-ba4d26dbfbb2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:54.365874 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b2516-a31c-4cfd-ac99-ba4d26dbfbb2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:54.376211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3707a2fe1d4d8697a5f5e0b788e7f0', 'request_id': 'req-b0ae6882-a681-49be-9cb1-e5e3c675ab44'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:54.390111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3707a2fe1d4d8697a5f5e0b788e7f0', 'request_id': 'req-b0ae6882-a681-49be-9cb1-e5e3c675ab44'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:54.459029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e425c2c-28d6-47eb-b4a4-31e23bd38715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:54.459959 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e425c2c-28d6-47eb-b4a4-31e23bd38715 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:54.460284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e425c2c-28d6-47eb-b4a4-31e23bd38715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:54.461976 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e425c2c-28d6-47eb-b4a4-31e23bd38715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:54.462701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e425c2c-28d6-47eb-b4a4-31e23bd38715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:54.464614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e425c2c-28d6-47eb-b4a4-31e23bd38715 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:54.496095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 923/1856] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:54.503614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e425c2c-28d6-47eb-b4a4-31e23bd38715 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:54.507871 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3707a2fe1d4d8697a5f5e0b788e7f0', 'request_id': 'req-b0ae6882-a681-49be-9cb1-e5e3c675ab44'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:54.514595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8e425c2c-28d6-47eb-b4a4-31e23bd38715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:54.521903 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] The token cache is being invalidate because project bc3707a2fe1d4d8697a5f5e0b788e7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:54.522437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:54.523433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:54.525799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 934/1857] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:54 2022] DELETE /identity/v3/projects/bc3707a2fe1d4d8697a5f5e0b788e7f0 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:54.526780 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:54.530122 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:54.549309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae6882-a681-49be-9cb1-e5e3c675ab44 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:54.563731 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6425b2-80db-49db-85d1-f6058aadf077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:54.564282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6425b2-80db-49db-85d1-f6058aadf077 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:54.565232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6425b2-80db-49db-85d1-f6058aadf077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:54.565533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6425b2-80db-49db-85d1-f6058aadf077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:54.566292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6425b2-80db-49db-85d1-f6058aadf077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:54.570722 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6425b2-80db-49db-85d1-f6058aadf077 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:54.585943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 935/1858] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:54.587127 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6425b2-80db-49db-85d1-f6058aadf077 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:54.590216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4d6425b2-80db-49db-85d1-f6058aadf077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:54.606371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6425b2-80db-49db-85d1-f6058aadf077 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:54.627241 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:54.627894 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:54.628197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:54.628472 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] PATH_INFO: `/v3/users/b150f687d78b4aaa9626be7387aeb682` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:54.630758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b150f687d78b4aaa9626be7387aeb682)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:54.633881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:54.638608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e425c2c-28d6-47eb-b4a4-31e23bd38715 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:54.646624 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce98cc-c316-483e-9d14-6a2dd7463d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:54.647266 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce98cc-c316-483e-9d14-6a2dd7463d2f service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:54.647543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce98cc-c316-483e-9d14-6a2dd7463d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:54.647805 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce98cc-c316-483e-9d14-6a2dd7463d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:54.650398 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-07ce98cc-c316-483e-9d14-6a2dd7463d2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:54.773818 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce98cc-c316-483e-9d14-6a2dd7463d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:54.775718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce98cc-c316-483e-9d14-6a2dd7463d2f service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:54.787928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 924/1859] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:54.789199 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce98cc-c316-483e-9d14-6a2dd7463d2f service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:54.803722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce98cc-c316-483e-9d14-6a2dd7463d2f service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:54.811858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e232f5b-11f8-445a-9423-771cbc001d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:54.812663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e232f5b-11f8-445a-9423-771cbc001d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:54.813240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e232f5b-11f8-445a-9423-771cbc001d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:54.813742 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e232f5b-11f8-445a-9423-771cbc001d26 admin admin] PATH_INFO: `/v3/projects/e23c2fc025f84e1bb92a8c1ae855b832/users/4d8b7d2821d74c228ae07cca5dc5578a/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:54.850107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e232f5b-11f8-445a-9423-771cbc001d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23c2fc025f84e1bb92a8c1ae855b832, user_id=4d8b7d2821d74c228ae07cca5dc5578a, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:54.854520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e232f5b-11f8-445a-9423-771cbc001d26 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:54.889974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b150f687d78b4aaa9626be7387aeb682'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:54.957867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 925/1860] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:54 2022] PUT /identity/v3/projects/e23c2fc025f84e1bb92a8c1ae855b832/users/4d8b7d2821d74c228ae07cca5dc5578a/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:54.963524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a6b87-8cd8-46ff-9d8a-fbeb9df87e42 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:54.963877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a6b87-8cd8-46ff-9d8a-fbeb9df87e42 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:54.964219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a6b87-8cd8-46ff-9d8a-fbeb9df87e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:54.998455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-df8a6b87-8cd8-46ff-9d8a-fbeb9df87e42 None None] MFA Rules not processed for user `4d8b7d2821d74c228ae07cca5dc5578a`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:55.000600 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-df8a6b87-8cd8-46ff-9d8a-fbeb9df87e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:55.007293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b150f687d78b4aaa9626be7387aeb682'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:55.008540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b150f687d78b4aaa9626be7387aeb682'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:55.010361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b150f687d78b4aaa9626be7387aeb682'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:55.036380 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b150f687d78b4aaa9626be7387aeb682'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:55.069359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 936/1861] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:54 2022] DELETE /identity/v3/users/b150f687d78b4aaa9626be7387aeb682 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:55.132458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 926/1862] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:30:55.145552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:55.158227 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:55.255685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3b7b9-66bf-4884-9089-305320bfffce admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:55.260472 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9f3fb-7601-4cdd-b204-baa6152feb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:55.261796 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9f3fb-7601-4cdd-b204-baa6152feb1d admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:55.261796 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9f3fb-7601-4cdd-b204-baa6152feb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:55.261796 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9f3fb-7601-4cdd-b204-baa6152feb1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:55.262414 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9f3fb-7601-4cdd-b204-baa6152feb1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:55.264973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9f3fb-7601-4cdd-b204-baa6152feb1d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:55.366318 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 937/1863] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:55 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:55.376090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a6b87-8cd8-46ff-9d8a-fbeb9df87e42 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:55.470078 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a6b87-8cd8-46ff-9d8a-fbeb9df87e42 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:55.523546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c86df-825e-4efe-a770-408decb487cc None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:55.524110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c86df-825e-4efe-a770-408decb487cc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:55.524222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c86df-825e-4efe-a770-408decb487cc None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:55.525895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 938/1864] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 03:30:55.546830 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd0e62-3b03-4341-8eb9-1733ba9b97dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:55.547447 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd0e62-3b03-4341-8eb9-1733ba9b97dc admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:55.547730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd0e62-3b03-4341-8eb9-1733ba9b97dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:55.548007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd0e62-3b03-4341-8eb9-1733ba9b97dc admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:55.548843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd0e62-3b03-4341-8eb9-1733ba9b97dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:55.550823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd0e62-3b03-4341-8eb9-1733ba9b97dc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:55.562447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44dc90-40fc-4411-a060-3033f811567f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:55.563005 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44dc90-40fc-4411-a060-3033f811567f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:55.563311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44dc90-40fc-4411-a060-3033f811567f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:55.584095 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3c44dc90-40fc-4411-a060-3033f811567f None None] MFA Rules not processed for user `e261a9485c3b4d2aa657a931e0388389`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:55.585337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3c44dc90-40fc-4411-a060-3033f811567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:55.655840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 939/1865] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:30:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:30:55.656979 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44dc90-40fc-4411-a060-3033f811567f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:55.658353 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3c44dc90-40fc-4411-a060-3033f811567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:55.673287 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44dc90-40fc-4411-a060-3033f811567f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:55.679080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 927/1866] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:55 2022] POST /identity/v3/users => generated 300 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:55.679209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:55.683321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9766c5-9d70-45cc-a528-5a7ca00ed995 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:55.683437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:55.683533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9766c5-9d70-45cc-a528-5a7ca00ed995 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:55.683625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:55.683714 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9766c5-9d70-45cc-a528-5a7ca00ed995 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:55.683811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] PATH_INFO: `/v3/projects/bc66a746d89d44ef8888cd65cf416e58` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:55.683811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc66a746d89d44ef8888cd65cf416e58)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:55.683979 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 928/1867] 10.222.0.48 () {54 vars in 961 bytes} [Tue Sep 13 03:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:30:55.684063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:55.686532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9766c5-9d70-45cc-a528-5a7ca00ed995 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:55.699086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9766c5-9d70-45cc-a528-5a7ca00ed995 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:55.704551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2540b-3480-43ba-9890-6d79ad416d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:55.712634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2540b-3480-43ba-9890-6d79ad416d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:55.712634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2540b-3480-43ba-9890-6d79ad416d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:55.712634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2540b-3480-43ba-9890-6d79ad416d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:55.712634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2540b-3480-43ba-9890-6d79ad416d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:55.712634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2540b-3480-43ba-9890-6d79ad416d87 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:55.718437 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 929/1868] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:55.719598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3a51-7211-4013-9be6-c078bcbc713f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:55.719871 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3a51-7211-4013-9be6-c078bcbc713f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:55.720314 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc3a51-7211-4013-9be6-c078bcbc713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:55.748788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3fcc3a51-7211-4013-9be6-c078bcbc713f None None] MFA Rules not processed for user `e261a9485c3b4d2aa657a931e0388389`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:55.748788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3fcc3a51-7211-4013-9be6-c078bcbc713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:55.758614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 930/1869] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Sep 13 03:30:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:55.766254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3a51-7211-4013-9be6-c078bcbc713f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:55.777140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc3a51-7211-4013-9be6-c078bcbc713f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:55.782074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeba3b-e4c0-4418-a685-5b24010a2d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:55.782851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeba3b-e4c0-4418-a685-5b24010a2d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:55.783135 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeba3b-e4c0-4418-a685-5b24010a2d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:55.783416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeba3b-e4c0-4418-a685-5b24010a2d68 admin admin] PATH_INFO: `/v3/projects/07a8684f52344f49b2409504eb79a0a6/users/20359ce1df7c4be797b8313ba3c4444f/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:55.798753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbeba3b-e4c0-4418-a685-5b24010a2d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a8684f52344f49b2409504eb79a0a6, user_id=20359ce1df7c4be797b8313ba3c4444f, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:55.801481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbeba3b-e4c0-4418-a685-5b24010a2d68 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:55.894770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 931/1870] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:55 2022] PUT /identity/v3/projects/07a8684f52344f49b2409504eb79a0a6/users/20359ce1df7c4be797b8313ba3c4444f/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:55.895893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeba3b-e4c0-4418-a685-5b24010a2d68 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:55.909902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:55.913914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc66a746d89d44ef8888cd65cf416e58', 'request_id': 'req-17f6f4fe-8344-4f89-b738-efd6a5b6e096'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:55.924956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc66a746d89d44ef8888cd65cf416e58', 'request_id': 'req-17f6f4fe-8344-4f89-b738-efd6a5b6e096'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:55.979716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeba3b-e4c0-4418-a685-5b24010a2d68 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:56.026226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc66a746d89d44ef8888cd65cf416e58', 'request_id': 'req-17f6f4fe-8344-4f89-b738-efd6a5b6e096'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:56.040695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee66f3-2d6d-4ab8-a8da-f31f919f86de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261a9485c3b4d2aa657a931e0388389', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:56.041335 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee66f3-2d6d-4ab8-a8da-f31f919f86de service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.041617 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee66f3-2d6d-4ab8-a8da-f31f919f86de service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.041890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee66f3-2d6d-4ab8-a8da-f31f919f86de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.047733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] The token cache is being invalidate because project bc66a746d89d44ef8888cd65cf416e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:56.048160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:56.048924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:56.050485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 940/1871] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:55 2022] DELETE /identity/v3/projects/bc66a746d89d44ef8888cd65cf416e58 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:56.051303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:56.052666 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:56.055444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee66f3-2d6d-4ab8-a8da-f31f919f86de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:56.068175 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee66f3-2d6d-4ab8-a8da-f31f919f86de service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:56.077292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 932/1872] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:56.078526 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5a141-5c51-4098-83a0-085b695597a2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.079229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5a141-5c51-4098-83a0-085b695597a2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.079549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5a141-5c51-4098-83a0-085b695597a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.112157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c1f5a141-5c51-4098-83a0-085b695597a2 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:56.113624 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c1f5a141-5c51-4098-83a0-085b695597a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:56.164914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6f4fe-8344-4f89-b738-efd6a5b6e096 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:56.171340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bad4f-5f44-40e1-ada1-fd381913bb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:56.172094 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bad4f-5f44-40e1-ada1-fd381913bb75 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.172440 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bad4f-5f44-40e1-ada1-fd381913bb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.172833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bad4f-5f44-40e1-ada1-fd381913bb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.173779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bad4f-5f44-40e1-ada1-fd381913bb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:56.175641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bad4f-5f44-40e1-ada1-fd381913bb75 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:56.191172 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 941/1873] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:56.197708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bad4f-5f44-40e1-ada1-fd381913bb75 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:56.205359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 933/1874] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:56.210217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567102f8-f49e-42f5-a207-2d0129eec5cf None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.210604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567102f8-f49e-42f5-a207-2d0129eec5cf None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.210816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bad4f-5f44-40e1-ada1-fd381913bb75 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:56.211062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567102f8-f49e-42f5-a207-2d0129eec5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.216972 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc08b7-6131-46ba-92b5-803a3809dce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:56.218284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc08b7-6131-46ba-92b5-803a3809dce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.218568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc08b7-6131-46ba-92b5-803a3809dce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.218980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc08b7-6131-46ba-92b5-803a3809dce8 admin admin] PATH_INFO: `/v3/projects/07a8684f52344f49b2409504eb79a0a6/users/20359ce1df7c4be797b8313ba3c4444f/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.222175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc08b7-6131-46ba-92b5-803a3809dce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a8684f52344f49b2409504eb79a0a6, user_id=20359ce1df7c4be797b8313ba3c4444f, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:56.225209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc08b7-6131-46ba-92b5-803a3809dce8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:56.242481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-567102f8-f49e-42f5-a207-2d0129eec5cf None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:56.243754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-567102f8-f49e-42f5-a207-2d0129eec5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:56.250923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 942/1875] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:56 2022] PUT /identity/v3/projects/07a8684f52344f49b2409504eb79a0a6/users/20359ce1df7c4be797b8313ba3c4444f/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:56.262873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d820-bb12-4adb-bdb1-a02862109b07 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.263153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d820-bb12-4adb-bdb1-a02862109b07 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.263432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d820-bb12-4adb-bdb1-a02862109b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.309436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1a88d820-bb12-4adb-bdb1-a02862109b07 None None] MFA Rules not processed for user `20359ce1df7c4be797b8313ba3c4444f`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:56.317731 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1a88d820-bb12-4adb-bdb1-a02862109b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:56.350014 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 934/1876] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:56.351821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567102f8-f49e-42f5-a207-2d0129eec5cf None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:56.380085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567102f8-f49e-42f5-a207-2d0129eec5cf None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:56.385164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782df42-24d1-4eb6-8660-7c4280ffe4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:56.385955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782df42-24d1-4eb6-8660-7c4280ffe4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.386232 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782df42-24d1-4eb6-8660-7c4280ffe4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.386504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782df42-24d1-4eb6-8660-7c4280ffe4c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.387314 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782df42-24d1-4eb6-8660-7c4280ffe4c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:30:56.387627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782df42-24d1-4eb6-8660-7c4280ffe4c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:56.389528 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782df42-24d1-4eb6-8660-7c4280ffe4c5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:56.407425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 935/1877] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:30:56.411732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782df42-24d1-4eb6-8660-7c4280ffe4c5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:56.433636 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782df42-24d1-4eb6-8660-7c4280ffe4c5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:56.449970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c6050-9301-4fff-9777-cbc2e2549556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:56.450653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c6050-9301-4fff-9777-cbc2e2549556 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.450938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c6050-9301-4fff-9777-cbc2e2549556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.451434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c6050-9301-4fff-9777-cbc2e2549556 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.452085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c6050-9301-4fff-9777-cbc2e2549556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:56.454142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c6050-9301-4fff-9777-cbc2e2549556 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:56.485248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 943/1878] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:30:56.499439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88d820-bb12-4adb-bdb1-a02862109b07 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:56.499439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1a88d820-bb12-4adb-bdb1-a02862109b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:56.572835 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88d820-bb12-4adb-bdb1-a02862109b07 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:56.585758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 936/1879] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:56 2022] POST /identity/v3/projects => generated 407 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:56.590580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c6050-9301-4fff-9777-cbc2e2549556 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:56.593752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009828f3-7191-42bb-8065-d3c622ad0f9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:56.594434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009828f3-7191-42bb-8065-d3c622ad0f9b service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.594870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009828f3-7191-42bb-8065-d3c622ad0f9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.595272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009828f3-7191-42bb-8065-d3c622ad0f9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.614611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009828f3-7191-42bb-8065-d3c622ad0f9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:56.616281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009828f3-7191-42bb-8065-d3c622ad0f9b service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:56.632021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 944/1880] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:30:56.660369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd60457-723d-4f20-a3bd-725dfb1391a4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.660369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd60457-723d-4f20-a3bd-725dfb1391a4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.660369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd60457-723d-4f20-a3bd-725dfb1391a4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.662995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 945/1881] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:30:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:30:56.675669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051db0e-1946-4b6e-bedf-e1ff3841ec71 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.676038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051db0e-1946-4b6e-bedf-e1ff3841ec71 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.676310 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051db0e-1946-4b6e-bedf-e1ff3841ec71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.690966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c6050-9301-4fff-9777-cbc2e2549556 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:56.700199 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072e6fa-ce0c-48e3-8c45-44fe95e5178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:56.701169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072e6fa-ce0c-48e3-8c45-44fe95e5178f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.701487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072e6fa-ce0c-48e3-8c45-44fe95e5178f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.701771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072e6fa-ce0c-48e3-8c45-44fe95e5178f admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.702811 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072e6fa-ce0c-48e3-8c45-44fe95e5178f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:56.706853 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072e6fa-ce0c-48e3-8c45-44fe95e5178f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:56.714554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e051db0e-1946-4b6e-bedf-e1ff3841ec71 None None] MFA Rules not processed for user `e261a9485c3b4d2aa657a931e0388389`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:56.715831 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e051db0e-1946-4b6e-bedf-e1ff3841ec71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:56.788368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 946/1882] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:30:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:56.790497 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051db0e-1946-4b6e-bedf-e1ff3841ec71 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:56.806517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051db0e-1946-4b6e-bedf-e1ff3841ec71 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:56.812459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 937/1883] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:56 2022] POST /identity/v3/users => generated 304 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:56.812459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072e6fa-ce0c-48e3-8c45-44fe95e5178f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:56.812670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:56.812670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.813050 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.813957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] PATH_INFO: `/v3/users/4d8b7d2821d74c228ae07cca5dc5578a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.815522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a072e6fa-ce0c-48e3-8c45-44fe95e5178f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:56.815723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8b7d2821d74c228ae07cca5dc5578a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:56.818173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:56.842622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072e6fa-ce0c-48e3-8c45-44fe95e5178f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:56.847690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe698f-9dbe-4332-ab56-890bb8566bc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261a9485c3b4d2aa657a931e0388389', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:56.848298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe698f-9dbe-4332-ab56-890bb8566bc2 service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.848573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe698f-9dbe-4332-ab56-890bb8566bc2 service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.848844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe698f-9dbe-4332-ab56-890bb8566bc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.857587 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe698f-9dbe-4332-ab56-890bb8566bc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:56.859170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe698f-9dbe-4332-ab56-890bb8566bc2 service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:56.869038 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 938/1884] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:56.870031 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe698f-9dbe-4332-ab56-890bb8566bc2 service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:56.879522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe698f-9dbe-4332-ab56-890bb8566bc2 service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:56.884337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243de5-73a9-48da-8133-b30d848ecc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:56.885004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243de5-73a9-48da-8133-b30d848ecc69 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.885374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243de5-73a9-48da-8133-b30d848ecc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.885714 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14243de5-73a9-48da-8133-b30d848ecc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.886417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14243de5-73a9-48da-8133-b30d848ecc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:56.888067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14243de5-73a9-48da-8133-b30d848ecc69 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:56.910048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 939/1885] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:56.910048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243de5-73a9-48da-8133-b30d848ecc69 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:56.910481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-14243de5-73a9-48da-8133-b30d848ecc69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:56.924607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14243de5-73a9-48da-8133-b30d848ecc69 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:56.929344 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:56.929970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:56.930246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:56.930516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] PATH_INFO: `/v3/users/faba5c10f78541d3aad3b26caa220ffd` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:56.931652 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faba5c10f78541d3aad3b26caa220ffd)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:56.933674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:57.022711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:57.037777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8b7d2821d74c228ae07cca5dc5578a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:57.113890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8b7d2821d74c228ae07cca5dc5578a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:57.124212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8b7d2821d74c228ae07cca5dc5578a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:57.125230 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8b7d2821d74c228ae07cca5dc5578a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:57.134068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8b7d2821d74c228ae07cca5dc5578a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:57.186278 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 947/1886] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:56 2022] DELETE /identity/v3/users/4d8b7d2821d74c228ae07cca5dc5578a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:57.187505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:57.190334 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:57.198282 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faba5c10f78541d3aad3b26caa220ffd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:57.200164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faba5c10f78541d3aad3b26caa220ffd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:57.202587 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faba5c10f78541d3aad3b26caa220ffd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:57.214899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faba5c10f78541d3aad3b26caa220ffd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:57.245376 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faba5c10f78541d3aad3b26caa220ffd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:57.275287 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a595a-0ea1-4100-b3f6-12b51f8f6664 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:57.280289 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387108e-0480-439b-8b53-71b8db2b274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:57.280901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387108e-0480-439b-8b53-71b8db2b274d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:57.281181 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387108e-0480-439b-8b53-71b8db2b274d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:57.281487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387108e-0480-439b-8b53-71b8db2b274d admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:57.282128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387108e-0480-439b-8b53-71b8db2b274d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:57.283778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387108e-0480-439b-8b53-71b8db2b274d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:57.292065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:57.294060 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 948/1887] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:57.295448 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1e2a1-e3e7-4069-a5cd-2636e3c156f7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:57.295730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1e2a1-e3e7-4069-a5cd-2636e3c156f7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:57.296002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1e2a1-e3e7-4069-a5cd-2636e3c156f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:57.314606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-32c1e2a1-e3e7-4069-a5cd-2636e3c156f7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:57.315817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-32c1e2a1-e3e7-4069-a5cd-2636e3c156f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:57.323302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 949/1888] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:57.324096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1e2a1-e3e7-4069-a5cd-2636e3c156f7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:57.325337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-32c1e2a1-e3e7-4069-a5cd-2636e3c156f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:57.339709 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 940/1889] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:56 2022] DELETE /identity/v3/users/faba5c10f78541d3aad3b26caa220ffd => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:57.339709 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:57.339884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1e2a1-e3e7-4069-a5cd-2636e3c156f7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:57.339961 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:57.401923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d2b13-1983-4878-b633-f206541351cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:57.402910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d2b13-1983-4878-b633-f206541351cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:57.403398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d2b13-1983-4878-b633-f206541351cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:57.403872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d2b13-1983-4878-b633-f206541351cd admin admin] PATH_INFO: `/v3/projects/70de23e995ce46e6b6a99e3fa1b8d1ec/users/93715302a5dd45c787db9436d63400fe/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:57.410828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b23120-94f4-4f06-913a-423cbe8a9c52 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:57.414784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79b7aa-21cb-492f-9e57-b9d0a3102e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:57.415416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b7aa-21cb-492f-9e57-b9d0a3102e8c service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:57.415750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b7aa-21cb-492f-9e57-b9d0a3102e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:57.416054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b7aa-21cb-492f-9e57-b9d0a3102e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:57.424037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d2b13-1983-4878-b633-f206541351cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=70de23e995ce46e6b6a99e3fa1b8d1ec, user_id=93715302a5dd45c787db9436d63400fe, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:57.426713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79b7aa-21cb-492f-9e57-b9d0a3102e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:57.427128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d2b13-1983-4878-b633-f206541351cd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:57.427918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79b7aa-21cb-492f-9e57-b9d0a3102e8c service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:57.438845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 941/1890] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:57.505109 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 950/1891] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:57 2022] PUT /identity/v3/projects/70de23e995ce46e6b6a99e3fa1b8d1ec/users/93715302a5dd45c787db9436d63400fe/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:57.515693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93791869-1714-4f28-af88-3246cf1ce552 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:57.516221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93791869-1714-4f28-af88-3246cf1ce552 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:57.516733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93791869-1714-4f28-af88-3246cf1ce552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:57.546933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-93791869-1714-4f28-af88-3246cf1ce552 None None] MFA Rules not processed for user `93715302a5dd45c787db9436d63400fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:57.548244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-93791869-1714-4f28-af88-3246cf1ce552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:57.621918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 942/1892] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:57 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:57.627116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d2b13-1983-4878-b633-f206541351cd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:57.699040 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d2b13-1983-4878-b633-f206541351cd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:57.704936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69146dc2-f6e0-4f26-87f9-5236d3a3ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:57.705682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69146dc2-f6e0-4f26-87f9-5236d3a3ea51 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:57.705962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69146dc2-f6e0-4f26-87f9-5236d3a3ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:57.706347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69146dc2-f6e0-4f26-87f9-5236d3a3ea51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:57.707061 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69146dc2-f6e0-4f26-87f9-5236d3a3ea51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:57.709093 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69146dc2-f6e0-4f26-87f9-5236d3a3ea51 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:57.711045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93791869-1714-4f28-af88-3246cf1ce552 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:57.712538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-93791869-1714-4f28-af88-3246cf1ce552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:57.729910 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93791869-1714-4f28-af88-3246cf1ce552 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:57.735649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:57.742023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:57.746754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:57.746754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] PATH_INFO: `/v3/projects/a7ce1605fea44e37a3acfa8d14e6496c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:57.746754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ce1605fea44e37a3acfa8d14e6496c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:57.747275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:57.871184 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 951/1893] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:57 2022] POST /identity/v3/projects => generated 407 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:30:57.875758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69146dc2-f6e0-4f26-87f9-5236d3a3ea51 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:57.946060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ce1605fea44e37a3acfa8d14e6496c', 'request_id': 'req-200d8aeb-2dce-4983-876e-dd94170d63a2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:57.953363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ce1605fea44e37a3acfa8d14e6496c', 'request_id': 'req-200d8aeb-2dce-4983-876e-dd94170d63a2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:57.969491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69146dc2-f6e0-4f26-87f9-5236d3a3ea51 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:58.035984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ce1605fea44e37a3acfa8d14e6496c', 'request_id': 'req-200d8aeb-2dce-4983-876e-dd94170d63a2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.054033 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f23b1-fe2b-4b91-aba8-c8623c433197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:58.054927 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f23b1-fe2b-4b91-aba8-c8623c433197 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:58.055067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] The token cache is being invalidate because project a7ce1605fea44e37a3acfa8d14e6496c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:58.055168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f23b1-fe2b-4b91-aba8-c8623c433197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:58.055242 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.055311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f23b1-fe2b-4b91-aba8-c8623c433197 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:58.055830 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.055940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f23b1-fe2b-4b91-aba8-c8623c433197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:58.058023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f23b1-fe2b-4b91-aba8-c8623c433197 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:58.060928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 943/1894] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:57 2022] DELETE /identity/v3/projects/a7ce1605fea44e37a3acfa8d14e6496c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:30:58.061822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:58.063185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:58.077808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d8aeb-2dce-4983-876e-dd94170d63a2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:58.082566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:58.083198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:58.083475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:58.083744 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] PATH_INFO: `/v3/projects/e23c2fc025f84e1bb92a8c1ae855b832` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:58.084870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23c2fc025f84e1bb92a8c1ae855b832)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:58.086847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:58.170979 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 952/1895] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:57 2022] POST /identity/v3/users => generated 310 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:30:58.179110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f23b1-fe2b-4b91-aba8-c8623c433197 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:58.179110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b50f23b1-fe2b-4b91-aba8-c8623c433197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:58.185494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f23b1-fe2b-4b91-aba8-c8623c433197 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:58.190115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:58.190716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:58.190995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:58.191276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] PATH_INFO: `/v3/users/46b3b858df9e413c873c6734b54ca0c4` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:58.192361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b3b858df9e413c873c6734b54ca0c4)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:58.194311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:58.218860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23c2fc025f84e1bb92a8c1ae855b832', 'request_id': 'req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.226586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23c2fc025f84e1bb92a8c1ae855b832', 'request_id': 'req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.332147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23c2fc025f84e1bb92a8c1ae855b832', 'request_id': 'req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.344713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] The token cache is being invalidate because project e23c2fc025f84e1bb92a8c1ae855b832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:58.345004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.346744 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.348302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 944/1896] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:58 2022] DELETE /identity/v3/projects/e23c2fc025f84e1bb92a8c1ae855b832 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:58.349746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:58.352695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:58.410593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b3b858df9e413c873c6734b54ca0c4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.427020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef56d4-a509-470d-b0f4-8cb4266cdb5f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:58.432243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b23f87-3fa6-456a-b714-cc93428e255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:58.432851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b23f87-3fa6-456a-b714-cc93428e255d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:58.433129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b23f87-3fa6-456a-b714-cc93428e255d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:58.435646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b23f87-3fa6-456a-b714-cc93428e255d admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:58.435646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b23f87-3fa6-456a-b714-cc93428e255d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:58.435904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b23f87-3fa6-456a-b714-cc93428e255d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:58.448699 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 945/1897] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:30:58.448699 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b23f87-3fa6-456a-b714-cc93428e255d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:58.448699 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-17b23f87-3fa6-456a-b714-cc93428e255d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:58.461369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b23f87-3fa6-456a-b714-cc93428e255d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:58.466146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:58.466807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:58.467838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:58.468110 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] PATH_INFO: `/v3/users/20359ce1df7c4be797b8313ba3c4444f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:58.469499 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20359ce1df7c4be797b8313ba3c4444f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:58.471506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:58.483764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b3b858df9e413c873c6734b54ca0c4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.484848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b3b858df9e413c873c6734b54ca0c4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.485491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b3b858df9e413c873c6734b54ca0c4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.493991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b3b858df9e413c873c6734b54ca0c4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.512519 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 953/1898] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:58 2022] DELETE /identity/v3/users/46b3b858df9e413c873c6734b54ca0c4 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:58.513127 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:58.515045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:58.592852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4418db7-0fe5-4ee4-b0e8-56751a2e5d59 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:58.597565 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bc8c8-43ef-41c2-96aa-1860e9b6e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:58.598233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bc8c8-43ef-41c2-96aa-1860e9b6e2df admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:58.598511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bc8c8-43ef-41c2-96aa-1860e9b6e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:58.598786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bc8c8-43ef-41c2-96aa-1860e9b6e2df admin admin] PATH_INFO: `/v3/projects/6f8eda1fe02448d7bbe866ee68030f2e/users/7a58040299524fdaa7630a6b1f82a5ce/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:58.613697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bc8c8-43ef-41c2-96aa-1860e9b6e2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8eda1fe02448d7bbe866ee68030f2e, user_id=7a58040299524fdaa7630a6b1f82a5ce, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:58.616369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bc8c8-43ef-41c2-96aa-1860e9b6e2df admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:58.706025 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 954/1899] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:58 2022] PUT /identity/v3/projects/6f8eda1fe02448d7bbe866ee68030f2e/users/7a58040299524fdaa7630a6b1f82a5ce/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:58.709816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bc8c8-43ef-41c2-96aa-1860e9b6e2df admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:58.711723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20359ce1df7c4be797b8313ba3c4444f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.712925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20359ce1df7c4be797b8313ba3c4444f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.713729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20359ce1df7c4be797b8313ba3c4444f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.721735 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20359ce1df7c4be797b8313ba3c4444f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.739083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20359ce1df7c4be797b8313ba3c4444f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:58.739762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=76,keystone:DELETE=20,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:58.778258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bc8c8-43ef-41c2-96aa-1860e9b6e2df admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:58.783347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a758672-8251-4dcd-be51-bebedbd504fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:58.783961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758672-8251-4dcd-be51-bebedbd504fd admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:58.784289 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758672-8251-4dcd-be51-bebedbd504fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:58.784567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758672-8251-4dcd-be51-bebedbd504fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:58.785206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a758672-8251-4dcd-be51-bebedbd504fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:58.791334 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a758672-8251-4dcd-be51-bebedbd504fd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:58.799482 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 955/1900] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:30:58.800391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a758672-8251-4dcd-be51-bebedbd504fd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:58.802839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6a758672-8251-4dcd-be51-bebedbd504fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:58.820131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 946/1901] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:30:58 2022] DELETE /identity/v3/users/20359ce1df7c4be797b8313ba3c4444f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:58.820131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:58.822142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:58.826555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a758672-8251-4dcd-be51-bebedbd504fd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:58.904756 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:58.905442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:58.905713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:58.905981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5 admin admin] PATH_INFO: `/v3/projects/e129a666739b422bb6a36f2d45699465` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:58.907032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59bd2f-a51b-488c-acaa-35f4ebb60ce9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:58.907270 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e129a666739b422bb6a36f2d45699465)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:58.909806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:58.912071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c37d9-69c6-4ac7-92bf-ebe6ea9d514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:58.912809 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c37d9-69c6-4ac7-92bf-ebe6ea9d514e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:58.913160 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c37d9-69c6-4ac7-92bf-ebe6ea9d514e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:58.913538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c37d9-69c6-4ac7-92bf-ebe6ea9d514e admin admin] PATH_INFO: `/v3/projects/6f8eda1fe02448d7bbe866ee68030f2e/users/7a58040299524fdaa7630a6b1f82a5ce/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:58.915595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c37d9-69c6-4ac7-92bf-ebe6ea9d514e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8eda1fe02448d7bbe866ee68030f2e, user_id=7a58040299524fdaa7630a6b1f82a5ce, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:58.918530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c37d9-69c6-4ac7-92bf-ebe6ea9d514e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:58.935807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 947/1902] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:30:58 2022] PUT /identity/v3/projects/6f8eda1fe02448d7bbe866ee68030f2e/users/7a58040299524fdaa7630a6b1f82a5ce/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:58.942148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9197fe-37d3-4002-9a81-bd63ad13fa68 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:58.942439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9197fe-37d3-4002-9a81-bd63ad13fa68 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:58.942835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9197fe-37d3-4002-9a81-bd63ad13fa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:58.965022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:30:58.972491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7e9197fe-37d3-4002-9a81-bd63ad13fa68 None None] MFA Rules not processed for user `7a58040299524fdaa7630a6b1f82a5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:58.973939 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7e9197fe-37d3-4002-9a81-bd63ad13fa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:59.053808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 948/1903] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:58 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:30:59.054918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9197fe-37d3-4002-9a81-bd63ad13fa68 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:59.056088 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7e9197fe-37d3-4002-9a81-bd63ad13fa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:59.088791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e129a666739b422bb6a36f2d45699465', 'request_id': 'req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:59.109635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e129a666739b422bb6a36f2d45699465', 'request_id': 'req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:59.152490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9197fe-37d3-4002-9a81-bd63ad13fa68 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:59.215542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e129a666739b422bb6a36f2d45699465', 'request_id': 'req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:59.235534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5 admin admin] The token cache is being invalidate because project e129a666739b422bb6a36f2d45699465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:59.236097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:59.237064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7b3bbf2c-35f4-4b8b-9972-f8c0f0f686e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:59.239737 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 956/1904] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:58 2022] DELETE /identity/v3/projects/e129a666739b422bb6a36f2d45699465 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:30:59.259437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffd0d-f713-4340-9db6-677f5babb17a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:59.259846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffd0d-f713-4340-9db6-677f5babb17a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:59.260167 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffd0d-f713-4340-9db6-677f5babb17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:59.263572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1bb0a-c7de-4a99-aebf-0e5a05548814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:59.264193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1bb0a-c7de-4a99-aebf-0e5a05548814 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:59.264471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1bb0a-c7de-4a99-aebf-0e5a05548814 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:59.264751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1bb0a-c7de-4a99-aebf-0e5a05548814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:59.266627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f7f1bb0a-c7de-4a99-aebf-0e5a05548814 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:59.289600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d0cffd0d-f713-4340-9db6-677f5babb17a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:59.291233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d0cffd0d-f713-4340-9db6-677f5babb17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:59.357988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1bb0a-c7de-4a99-aebf-0e5a05548814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:59.361375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1bb0a-c7de-4a99-aebf-0e5a05548814 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:59.375981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 949/1905] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:30:59 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:30:59.389445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 957/1906] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:59.397054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e833c-7643-4977-8d1d-79b719a50300 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:59.402472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e833c-7643-4977-8d1d-79b719a50300 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:59.402472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e833c-7643-4977-8d1d-79b719a50300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:59.424821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d63e833c-7643-4977-8d1d-79b719a50300 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:59.426583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d63e833c-7643-4977-8d1d-79b719a50300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:59.435984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 950/1907] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:59.437015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cffd0d-f713-4340-9db6-677f5babb17a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:59.438446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d0cffd0d-f713-4340-9db6-677f5babb17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:59.446766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e833c-7643-4977-8d1d-79b719a50300 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:59.457477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cffd0d-f713-4340-9db6-677f5babb17a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:59.466171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e833c-7643-4977-8d1d-79b719a50300 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:59.470752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb718d5c-fc1d-4956-b476-b22c104856ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:59.471413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb718d5c-fc1d-4956-b476-b22c104856ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:59.472320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb718d5c-fc1d-4956-b476-b22c104856ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:59.472766 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb718d5c-fc1d-4956-b476-b22c104856ed admin admin] PATH_INFO: `/v3/projects/07a8684f52344f49b2409504eb79a0a6` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:59.474400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb718d5c-fc1d-4956-b476-b22c104856ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a8684f52344f49b2409504eb79a0a6)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:59.477925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb718d5c-fc1d-4956-b476-b22c104856ed admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:59.481675 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3302e-5102-40f0-b0c5-7327695159cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:59.488498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3302e-5102-40f0-b0c5-7327695159cb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:59.488807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3302e-5102-40f0-b0c5-7327695159cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:59.489079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3302e-5102-40f0-b0c5-7327695159cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:59.489786 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3302e-5102-40f0-b0c5-7327695159cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:30:59.490081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3302e-5102-40f0-b0c5-7327695159cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:59.492135 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3302e-5102-40f0-b0c5-7327695159cb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:59.521243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 951/1908] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:30:59.525397 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3302e-5102-40f0-b0c5-7327695159cb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:59.542430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3302e-5102-40f0-b0c5-7327695159cb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:59.548478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a999041-bb27-43bb-8a87-96cab7df8bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:59.549096 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a999041-bb27-43bb-8a87-96cab7df8bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:59.556645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a999041-bb27-43bb-8a87-96cab7df8bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:59.556645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a999041-bb27-43bb-8a87-96cab7df8bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:59.556645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a999041-bb27-43bb-8a87-96cab7df8bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:59.556645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a999041-bb27-43bb-8a87-96cab7df8bb3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:59.647345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bb718d5c-fc1d-4956-b476-b22c104856ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a8684f52344f49b2409504eb79a0a6', 'request_id': 'req-bb718d5c-fc1d-4956-b476-b22c104856ed'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:59.653828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bb718d5c-fc1d-4956-b476-b22c104856ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a8684f52344f49b2409504eb79a0a6', 'request_id': 'req-bb718d5c-fc1d-4956-b476-b22c104856ed'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:59.694620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 952/1909] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:30:59 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:30:59.703627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a999041-bb27-43bb-8a87-96cab7df8bb3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:59.784636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bb718d5c-fc1d-4956-b476-b22c104856ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a8684f52344f49b2409504eb79a0a6', 'request_id': 'req-bb718d5c-fc1d-4956-b476-b22c104856ed'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:59.804009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a999041-bb27-43bb-8a87-96cab7df8bb3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:59.807181 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bb718d5c-fc1d-4956-b476-b22c104856ed admin admin] The token cache is being invalidate because project 07a8684f52344f49b2409504eb79a0a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:30:59.807502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bb718d5c-fc1d-4956-b476-b22c104856ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:59.808914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bb718d5c-fc1d-4956-b476-b22c104856ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:30:59.810941 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 958/1910] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:30:59 2022] DELETE /identity/v3/projects/07a8684f52344f49b2409504eb79a0a6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:30:59.815547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce448bce-c3e4-491b-9314-344bdddce074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:59.816245 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448bce-c3e4-491b-9314-344bdddce074 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:59.816529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448bce-c3e4-491b-9314-344bdddce074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:59.816809 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448bce-c3e4-491b-9314-344bdddce074 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:59.817626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce448bce-c3e4-491b-9314-344bdddce074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:59.819773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce448bce-c3e4-491b-9314-344bdddce074 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:30:59.827924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a521b4-01d3-4f05-97f2-dfbcc14b6a4b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:59.828220 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a521b4-01d3-4f05-97f2-dfbcc14b6a4b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:59.828498 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a521b4-01d3-4f05-97f2-dfbcc14b6a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:59.854882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c7a521b4-01d3-4f05-97f2-dfbcc14b6a4b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:59.856101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c7a521b4-01d3-4f05-97f2-dfbcc14b6a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:59.874214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 959/1911] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:59.875976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2072ee1-27e8-499d-8352-8e2fa21c90bf None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:59.876313 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2072ee1-27e8-499d-8352-8e2fa21c90bf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:59.876757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2072ee1-27e8-499d-8352-8e2fa21c90bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:59.914094 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 953/1912] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:30:59 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:30:59.917367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce448bce-c3e4-491b-9314-344bdddce074 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:59.917488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b2072ee1-27e8-499d-8352-8e2fa21c90bf None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:30:59.919212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b2072ee1-27e8-499d-8352-8e2fa21c90bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:59.926058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ce448bce-c3e4-491b-9314-344bdddce074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:30:59.941774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 960/1913] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:30:59.942948 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2072ee1-27e8-499d-8352-8e2fa21c90bf None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:30:59.965589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2072ee1-27e8-499d-8352-8e2fa21c90bf None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:59.971157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce448bce-c3e4-491b-9314-344bdddce074 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:30:59.980808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9de411-e1c0-480a-868f-3aac90a43c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:30:59.980808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9de411-e1c0-480a-868f-3aac90a43c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:30:59.980808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9de411-e1c0-480a-868f-3aac90a43c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:30:59.980808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9de411-e1c0-480a-868f-3aac90a43c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:30:59.981514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9de411-e1c0-480a-868f-3aac90a43c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:30:59.981514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9de411-e1c0-480a-868f-3aac90a43c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:30:59.983438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9de411-e1c0-480a-868f-3aac90a43c1d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:00.002023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 961/1914] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:31:00.003088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9de411-e1c0-480a-868f-3aac90a43c1d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:00.003220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca12f4-0979-4e8a-b4d0-d0cda6adeab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:00.003922 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca12f4-0979-4e8a-b4d0-d0cda6adeab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:00.004208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca12f4-0979-4e8a-b4d0-d0cda6adeab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:00.004486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca12f4-0979-4e8a-b4d0-d0cda6adeab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:00.005226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca12f4-0979-4e8a-b4d0-d0cda6adeab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:00.007736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca12f4-0979-4e8a-b4d0-d0cda6adeab2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:00.014291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9de411-e1c0-480a-868f-3aac90a43c1d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:00.019197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a7ee1-74f6-43be-a13f-6dfc06b854e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:00.019881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a7ee1-74f6-43be-a13f-6dfc06b854e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:00.020237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a7ee1-74f6-43be-a13f-6dfc06b854e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:00.020585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a7ee1-74f6-43be-a13f-6dfc06b854e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:00.021326 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a7ee1-74f6-43be-a13f-6dfc06b854e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:00.023291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a7ee1-74f6-43be-a13f-6dfc06b854e2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:00.023727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 954/1915] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:00.028129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca12f4-0979-4e8a-b4d0-d0cda6adeab2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:00.030248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-71ca12f4-0979-4e8a-b4d0-d0cda6adeab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:00.093506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca12f4-0979-4e8a-b4d0-d0cda6adeab2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:00.098234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be371c1f-4dbc-4d32-9076-118afd347295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:00.098982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be371c1f-4dbc-4d32-9076-118afd347295 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:00.099300 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be371c1f-4dbc-4d32-9076-118afd347295 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:00.099709 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be371c1f-4dbc-4d32-9076-118afd347295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:00.101589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-be371c1f-4dbc-4d32-9076-118afd347295 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:00.118259 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 962/1916] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:00 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:00.121317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a7ee1-74f6-43be-a13f-6dfc06b854e2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:00.197577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a7ee1-74f6-43be-a13f-6dfc06b854e2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:00.203833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b13188-85e8-4c8e-a2cb-2e77b1fefc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:00.210547 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b13188-85e8-4c8e-a2cb-2e77b1fefc36 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:00.210547 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b13188-85e8-4c8e-a2cb-2e77b1fefc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:00.210547 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b13188-85e8-4c8e-a2cb-2e77b1fefc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:00.210547 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b13188-85e8-4c8e-a2cb-2e77b1fefc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:00.210547 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b13188-85e8-4c8e-a2cb-2e77b1fefc36 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:00.215373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be371c1f-4dbc-4d32-9076-118afd347295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:00.217403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be371c1f-4dbc-4d32-9076-118afd347295 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:00.222379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 963/1917] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:00.222379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b13188-85e8-4c8e-a2cb-2e77b1fefc36 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:00.229608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 955/1918] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:00 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:00.230581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be371c1f-4dbc-4d32-9076-118afd347295 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:00.237105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b13188-85e8-4c8e-a2cb-2e77b1fefc36 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:00.242233 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be371c1f-4dbc-4d32-9076-118afd347295 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:00.243805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb4562-6a37-4594-a80a-fd7cc46b3647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:00.244656 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4562-6a37-4594-a80a-fd7cc46b3647 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:00.245027 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4562-6a37-4594-a80a-fd7cc46b3647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:00.245339 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4562-6a37-4594-a80a-fd7cc46b3647 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:00.246179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb4562-6a37-4594-a80a-fd7cc46b3647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:00.246926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87875757-9a47-427f-a5a5-93daf47f938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:00.247591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87875757-9a47-427f-a5a5-93daf47f938f admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:00.248571 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87875757-9a47-427f-a5a5-93daf47f938f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:00.248754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb4562-6a37-4594-a80a-fd7cc46b3647 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:00.248858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87875757-9a47-427f-a5a5-93daf47f938f admin admin] PATH_INFO: `/v3/projects/9c9193ada36749b7b2000eb4691a194e/users/eb052aad1aab4f5889c08c7ff80336ff/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:00.267481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87875757-9a47-427f-a5a5-93daf47f938f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9193ada36749b7b2000eb4691a194e, user_id=eb052aad1aab4f5889c08c7ff80336ff, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:00.271475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87875757-9a47-427f-a5a5-93daf47f938f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:00.390055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 956/1919] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:00 2022] PUT /identity/v3/projects/9c9193ada36749b7b2000eb4691a194e/users/eb052aad1aab4f5889c08c7ff80336ff/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:00.390251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 964/1920] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:00 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:00.390368 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87875757-9a47-427f-a5a5-93daf47f938f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:00.392286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133296-61bc-45b5-a417-47d49a16a3d9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:00.392577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133296-61bc-45b5-a417-47d49a16a3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:00.392850 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133296-61bc-45b5-a417-47d49a16a3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:00.436392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-94133296-61bc-45b5-a417-47d49a16a3d9 None None] MFA Rules not processed for user `eb052aad1aab4f5889c08c7ff80336ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:00.437649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-94133296-61bc-45b5-a417-47d49a16a3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:00.547873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87875757-9a47-427f-a5a5-93daf47f938f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:00.547873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa7cc0-e210-4edb-83ee-37b6835ac435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:00.547873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa7cc0-e210-4edb-83ee-37b6835ac435 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:00.547873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa7cc0-e210-4edb-83ee-37b6835ac435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:00.548214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa7cc0-e210-4edb-83ee-37b6835ac435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:00.548214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa7cc0-e210-4edb-83ee-37b6835ac435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:00.549980 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa7cc0-e210-4edb-83ee-37b6835ac435 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:00.562473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 957/1922] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:00.562590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 965/1922] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:00.563405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa7cc0-e210-4edb-83ee-37b6835ac435 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:00.567459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133296-61bc-45b5-a417-47d49a16a3d9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:00.568017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-61fa7cc0-e210-4edb-83ee-37b6835ac435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:00.582363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa7cc0-e210-4edb-83ee-37b6835ac435 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:00.582912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133296-61bc-45b5-a417-47d49a16a3d9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:00.589556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:00.590196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:00.591007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:00.591007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] PATH_INFO: `/v3/users/3c848b6248c14ecba1719c03126173ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:00.592328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c848b6248c14ecba1719c03126173ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:00.592521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77462ec6-a0b3-4b8b-ae46-ad7fa46cad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:00.593202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77462ec6-a0b3-4b8b-ae46-ad7fa46cad01 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:00.593609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77462ec6-a0b3-4b8b-ae46-ad7fa46cad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:00.593963 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77462ec6-a0b3-4b8b-ae46-ad7fa46cad01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:00.594297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:00.594866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77462ec6-a0b3-4b8b-ae46-ad7fa46cad01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:00.596740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77462ec6-a0b3-4b8b-ae46-ad7fa46cad01 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:00.608715 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 966/1923] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:00.609652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77462ec6-a0b3-4b8b-ae46-ad7fa46cad01 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:00.621109 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77462ec6-a0b3-4b8b-ae46-ad7fa46cad01 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:00.626408 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c6bf9-823e-4480-8ca7-6355c6f4514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:00.627257 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c6bf9-823e-4480-8ca7-6355c6f4514e admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:00.627418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c6bf9-823e-4480-8ca7-6355c6f4514e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:00.627794 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c6bf9-823e-4480-8ca7-6355c6f4514e admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:00.628422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c6bf9-823e-4480-8ca7-6355c6f4514e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:00.630535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c6bf9-823e-4480-8ca7-6355c6f4514e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:00.686923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:00.747856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 967/1924] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:00 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:00.748669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c6bf9-823e-4480-8ca7-6355c6f4514e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:00.782653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c848b6248c14ecba1719c03126173ce'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:00.783359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c848b6248c14ecba1719c03126173ce'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:00.783991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c848b6248c14ecba1719c03126173ce'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:00.793557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c848b6248c14ecba1719c03126173ce'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:00.812128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c848b6248c14ecba1719c03126173ce'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:00.825194 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c6bf9-823e-4480-8ca7-6355c6f4514e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:00.829974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bbb04-3068-4277-a41d-04d403435782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:00.830689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bbb04-3068-4277-a41d-04d403435782 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:00.834295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bbb04-3068-4277-a41d-04d403435782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:00.834295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bbb04-3068-4277-a41d-04d403435782 admin admin] PATH_INFO: `/v3/projects/7027ad54283848c995dc1bb9a1d10d30/users/58937f02e9ff4f6899a79f3790646ad8/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:00.846613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bbb04-3068-4277-a41d-04d403435782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7027ad54283848c995dc1bb9a1d10d30, user_id=58937f02e9ff4f6899a79f3790646ad8, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:00.849312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bbb04-3068-4277-a41d-04d403435782 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:00.878761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 958/1925] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:00 2022] DELETE /identity/v3/users/3c848b6248c14ecba1719c03126173ce => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:00.879664 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:00.882418 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:00.946150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 968/1926] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:00 2022] PUT /identity/v3/projects/7027ad54283848c995dc1bb9a1d10d30/users/58937f02e9ff4f6899a79f3790646ad8/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:00.947646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832cad0-0a98-46ed-b9b6-d7957ab3d203 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:00.947932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832cad0-0a98-46ed-b9b6-d7957ab3d203 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:00.948202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832cad0-0a98-46ed-b9b6-d7957ab3d203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:00.972756 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c832cad0-0a98-46ed-b9b6-d7957ab3d203 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:00.973990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c832cad0-0a98-46ed-b9b6-d7957ab3d203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:00.981386 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e14081-0d4a-4375-a338-bc928da59919 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:01.062578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 969/1927] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:01.063930 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06062b7-6f4e-465e-a93b-35111d47ba57 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:01.064253 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06062b7-6f4e-465e-a93b-35111d47ba57 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:01.064524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06062b7-6f4e-465e-a93b-35111d47ba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:01.097143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dc196-1489-46df-a7f6-091feca60f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:01.097383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c06062b7-6f4e-465e-a93b-35111d47ba57 None None] MFA Rules not processed for user `58937f02e9ff4f6899a79f3790646ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:01.098150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dc196-1489-46df-a7f6-091feca60f1b admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:01.098436 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dc196-1489-46df-a7f6-091feca60f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:01.098897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dc196-1489-46df-a7f6-091feca60f1b admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:01.099012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c06062b7-6f4e-465e-a93b-35111d47ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:01.108063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dc196-1489-46df-a7f6-091feca60f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:01.111039 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dc196-1489-46df-a7f6-091feca60f1b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:01.170984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 970/1928] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:01.171670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06062b7-6f4e-465e-a93b-35111d47ba57 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:01.175271 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c06062b7-6f4e-465e-a93b-35111d47ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:01.205735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:01.221302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 959/1929] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:00 2022] POST /identity/v3/users => generated 293 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:01.223524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dc196-1489-46df-a7f6-091feca60f1b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:01.234781 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bf8dc196-1489-46df-a7f6-091feca60f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:01.262075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dc196-1489-46df-a7f6-091feca60f1b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:01.273501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1408f3d-8de0-4a93-9261-877374de330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:01.274529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1408f3d-8de0-4a93-9261-877374de330a admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:01.274885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1408f3d-8de0-4a93-9261-877374de330a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:01.275259 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1408f3d-8de0-4a93-9261-877374de330a admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:01.276224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1408f3d-8de0-4a93-9261-877374de330a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:01.280606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1408f3d-8de0-4a93-9261-877374de330a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:01.306340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06062b7-6f4e-465e-a93b-35111d47ba57 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:01.310360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ccfd6-812b-4288-8965-cdebee183bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:01.312843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ccfd6-812b-4288-8965-cdebee183bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:01.312843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ccfd6-812b-4288-8965-cdebee183bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:01.312843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ccfd6-812b-4288-8965-cdebee183bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:01.321666 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ccfd6-812b-4288-8965-cdebee183bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:01.323112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ccfd6-812b-4288-8965-cdebee183bd2 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:01.334978 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 971/1930] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:01.344406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ccfd6-812b-4288-8965-cdebee183bd2 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:01.345358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ccfd6-812b-4288-8965-cdebee183bd2 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:01.350345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20125ad-2453-4269-9f3f-3109f37fae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:01.350910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20125ad-2453-4269-9f3f-3109f37fae7a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:01.351192 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20125ad-2453-4269-9f3f-3109f37fae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:01.351466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20125ad-2453-4269-9f3f-3109f37fae7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:01.352101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20125ad-2453-4269-9f3f-3109f37fae7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:01.353742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20125ad-2453-4269-9f3f-3109f37fae7a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:01.365078 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 972/1931] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:01.373406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20125ad-2453-4269-9f3f-3109f37fae7a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:01.399637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20125ad-2453-4269-9f3f-3109f37fae7a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:01.403676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 960/1932] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:01 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:01.409618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7f3db-d16c-4a95-bb6e-13c823e7671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:01.409952 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7f3db-d16c-4a95-bb6e-13c823e7671c admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:01.410245 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7f3db-d16c-4a95-bb6e-13c823e7671c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:01.410519 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7f3db-d16c-4a95-bb6e-13c823e7671c admin admin] PATH_INFO: `/v3/projects/096fcb1f30c1426f94b7e6fbf50ba315/users/9ab19260a8944db4bc8a60b2196b83f5/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:01.411549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1408f3d-8de0-4a93-9261-877374de330a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:01.444448 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7f3db-d16c-4a95-bb6e-13c823e7671c admin admin] RBAC: Authorizing `identity:create_grant(project_id=096fcb1f30c1426f94b7e6fbf50ba315, user_id=9ab19260a8944db4bc8a60b2196b83f5, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:01.449902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7f3db-d16c-4a95-bb6e-13c823e7671c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:01.494772 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1408f3d-8de0-4a93-9261-877374de330a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:01.501981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa859d-e5c7-45b1-a67a-dadab6007506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:01.503759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa859d-e5c7-45b1-a67a-dadab6007506 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:01.503759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa859d-e5c7-45b1-a67a-dadab6007506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:01.503759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa859d-e5c7-45b1-a67a-dadab6007506 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:01.504018 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa859d-e5c7-45b1-a67a-dadab6007506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:01.506118 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa859d-e5c7-45b1-a67a-dadab6007506 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:01.597316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 973/1933] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:01 2022] PUT /identity/v3/projects/096fcb1f30c1426f94b7e6fbf50ba315/users/9ab19260a8944db4bc8a60b2196b83f5/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:01.601614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7f3db-d16c-4a95-bb6e-13c823e7671c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:01.692727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 961/1934] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:01 2022] POST /identity/v3/users => generated 299 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:01.694040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa859d-e5c7-45b1-a67a-dadab6007506 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:01.712561 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa859d-e5c7-45b1-a67a-dadab6007506 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:01.717985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7f3db-d16c-4a95-bb6e-13c823e7671c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:01.723853 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66edd7-90ee-4faf-b6f5-1e8d4aade54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:01.725727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66edd7-90ee-4faf-b6f5-1e8d4aade54a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:01.726539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66edd7-90ee-4faf-b6f5-1e8d4aade54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:01.728012 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66edd7-90ee-4faf-b6f5-1e8d4aade54a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:01.729461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66edd7-90ee-4faf-b6f5-1e8d4aade54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:01.730363 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb758527-d733-4ea8-9d54-fc8b128ddabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:01.731232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758527-d733-4ea8-9d54-fc8b128ddabb admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:01.731666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66edd7-90ee-4faf-b6f5-1e8d4aade54a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:01.732298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758527-d733-4ea8-9d54-fc8b128ddabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:01.732805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758527-d733-4ea8-9d54-fc8b128ddabb admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:01.733997 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb758527-d733-4ea8-9d54-fc8b128ddabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:01.736324 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb758527-d733-4ea8-9d54-fc8b128ddabb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:01.754144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 974/1935] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:01.756257 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb758527-d733-4ea8-9d54-fc8b128ddabb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:01.772889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 962/1936] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:01.774082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb758527-d733-4ea8-9d54-fc8b128ddabb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:01.774836 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66edd7-90ee-4faf-b6f5-1e8d4aade54a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:01.785152 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c32e28-091c-44de-b905-887977e16b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:01.785879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32e28-091c-44de-b905-887977e16b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:01.787973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32e28-091c-44de-b905-887977e16b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:01.788263 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32e28-091c-44de-b905-887977e16b5c admin admin] PATH_INFO: `/v3/projects/096fcb1f30c1426f94b7e6fbf50ba315/users/9ab19260a8944db4bc8a60b2196b83f5/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:01.793458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c32e28-091c-44de-b905-887977e16b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=096fcb1f30c1426f94b7e6fbf50ba315, user_id=9ab19260a8944db4bc8a60b2196b83f5, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:01.801578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c32e28-091c-44de-b905-887977e16b5c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:01.813900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66edd7-90ee-4faf-b6f5-1e8d4aade54a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:01.836803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 975/1937] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:01 2022] PUT /identity/v3/projects/096fcb1f30c1426f94b7e6fbf50ba315/users/9ab19260a8944db4bc8a60b2196b83f5/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:01.838600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd34464-3b63-4cc5-96a7-0d721422e2e2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:01.838895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd34464-3b63-4cc5-96a7-0d721422e2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:01.839407 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd34464-3b63-4cc5-96a7-0d721422e2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:01.890295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2bd34464-3b63-4cc5-96a7-0d721422e2e2 None None] MFA Rules not processed for user `9ab19260a8944db4bc8a60b2196b83f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:01.891670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2bd34464-3b63-4cc5-96a7-0d721422e2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:01.915077 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa2020-eae9-4251-a46d-a60d842a0bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:01.915853 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa2020-eae9-4251-a46d-a60d842a0bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:01.916236 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa2020-eae9-4251-a46d-a60d842a0bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:01.916509 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa2020-eae9-4251-a46d-a60d842a0bbd admin admin] PATH_INFO: `/v3/projects/fe1a0c7ab6f24571ae0a91cb79cd8c33/users/636240c1d5324ca38a3b9237c6f1aa55/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:01.933148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa2020-eae9-4251-a46d-a60d842a0bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1a0c7ab6f24571ae0a91cb79cd8c33, user_id=636240c1d5324ca38a3b9237c6f1aa55, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:01.938589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa2020-eae9-4251-a46d-a60d842a0bbd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:01.996137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 976/1938] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:01.997822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd34464-3b63-4cc5-96a7-0d721422e2e2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:01.999883 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2bd34464-3b63-4cc5-96a7-0d721422e2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:02.033562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd34464-3b63-4cc5-96a7-0d721422e2e2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:02.035020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 963/1939] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:01 2022] PUT /identity/v3/projects/fe1a0c7ab6f24571ae0a91cb79cd8c33/users/636240c1d5324ca38a3b9237c6f1aa55/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:02.037102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa2020-eae9-4251-a46d-a60d842a0bbd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:02.042208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-59aa2020-eae9-4251-a46d-a60d842a0bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:02.114885 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:02.115856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:02.116210 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:02.116601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] PATH_INFO: `/v3/projects/59de9372df48420d995089b642afbc4c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:02.117927 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59de9372df48420d995089b642afbc4c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:02.121048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:02.124876 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa2020-eae9-4251-a46d-a60d842a0bbd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:02.126946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e84d7d-b766-475a-970f-baa5a282ce07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:02.127555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e84d7d-b766-475a-970f-baa5a282ce07 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:02.128022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e84d7d-b766-475a-970f-baa5a282ce07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:02.128303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e84d7d-b766-475a-970f-baa5a282ce07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:02.199454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e84d7d-b766-475a-970f-baa5a282ce07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:02.201541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e84d7d-b766-475a-970f-baa5a282ce07 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:02.211338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 964/1940] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:02.212217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e84d7d-b766-475a-970f-baa5a282ce07 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:02.223055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e84d7d-b766-475a-970f-baa5a282ce07 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:02.229938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929643bf-390e-4b46-85d8-8414ab69d875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:02.230636 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929643bf-390e-4b46-85d8-8414ab69d875 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:02.230988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929643bf-390e-4b46-85d8-8414ab69d875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:02.231320 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929643bf-390e-4b46-85d8-8414ab69d875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:02.232061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929643bf-390e-4b46-85d8-8414ab69d875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:02.233833 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929643bf-390e-4b46-85d8-8414ab69d875 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:02.248850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 965/1941] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:02.249850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929643bf-390e-4b46-85d8-8414ab69d875 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:02.261214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59de9372df48420d995089b642afbc4c', 'request_id': 'req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:02.261413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929643bf-390e-4b46-85d8-8414ab69d875 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:02.273303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59de9372df48420d995089b642afbc4c', 'request_id': 'req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:02.334858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f43a3-9458-428e-9851-6d6dc0dbf97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:02.335519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f43a3-9458-428e-9851-6d6dc0dbf97e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:02.335795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f43a3-9458-428e-9851-6d6dc0dbf97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:02.336068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f43a3-9458-428e-9851-6d6dc0dbf97e admin admin] PATH_INFO: `/v3/projects/fe1a0c7ab6f24571ae0a91cb79cd8c33/users/636240c1d5324ca38a3b9237c6f1aa55/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:02.338044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f43a3-9458-428e-9851-6d6dc0dbf97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1a0c7ab6f24571ae0a91cb79cd8c33, user_id=636240c1d5324ca38a3b9237c6f1aa55, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:02.340736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f43a3-9458-428e-9851-6d6dc0dbf97e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:02.351937 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 966/1942] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:02 2022] PUT /identity/v3/projects/fe1a0c7ab6f24571ae0a91cb79cd8c33/users/636240c1d5324ca38a3b9237c6f1aa55/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:02.362318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3936a-e8f6-4ae2-8f5a-6ecf63938e9f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:02.362591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3936a-e8f6-4ae2-8f5a-6ecf63938e9f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:02.362873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3936a-e8f6-4ae2-8f5a-6ecf63938e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:02.364525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59de9372df48420d995089b642afbc4c', 'request_id': 'req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:02.380264 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] The token cache is being invalidate because project 59de9372df48420d995089b642afbc4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:02.383190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:02.385655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:02.388762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 977/1943] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:01 2022] DELETE /identity/v3/projects/59de9372df48420d995089b642afbc4c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:02.399987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:02.401672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:02.411892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6cf3936a-e8f6-4ae2-8f5a-6ecf63938e9f None None] MFA Rules not processed for user `636240c1d5324ca38a3b9237c6f1aa55`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:02.413483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6cf3936a-e8f6-4ae2-8f5a-6ecf63938e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:02.419721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b3729-0b45-4efb-8d14-bdc5a485dfb0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:02.503117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec27069-bcaa-4a27-a8a9-58984bbae163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:02.504103 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec27069-bcaa-4a27-a8a9-58984bbae163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:02.504466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec27069-bcaa-4a27-a8a9-58984bbae163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:02.504846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec27069-bcaa-4a27-a8a9-58984bbae163 admin admin] PATH_INFO: `/v3/users/8242bd6e99664bd4ac10d2eaa903ad79` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:02.506111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec27069-bcaa-4a27-a8a9-58984bbae163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8242bd6e99664bd4ac10d2eaa903ad79)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:02.508514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec27069-bcaa-4a27-a8a9-58984bbae163 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:02.522607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 967/1944] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:02.580973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3936a-e8f6-4ae2-8f5a-6ecf63938e9f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:02.582623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6cf3936a-e8f6-4ae2-8f5a-6ecf63938e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:02.651374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3936a-e8f6-4ae2-8f5a-6ecf63938e9f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:02.655537 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e85b3d-33d7-424f-bdda-84f3c52105c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:02.656298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85b3d-33d7-424f-bdda-84f3c52105c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:02.657061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85b3d-33d7-424f-bdda-84f3c52105c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:02.657061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85b3d-33d7-424f-bdda-84f3c52105c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:02.659014 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e1e85b3d-33d7-424f-bdda-84f3c52105c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:02.721503 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e85b3d-33d7-424f-bdda-84f3c52105c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:02.722961 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e85b3d-33d7-424f-bdda-84f3c52105c2 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:02.733020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 968/1945] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:31:02.733732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e85b3d-33d7-424f-bdda-84f3c52105c2 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:02.735135 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e1e85b3d-33d7-424f-bdda-84f3c52105c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:02.752867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e85b3d-33d7-424f-bdda-84f3c52105c2 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:02.758184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ab341-a640-4710-b195-03a36cc83a1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:02.759016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ab341-a640-4710-b195-03a36cc83a1f service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:02.759446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ab341-a640-4710-b195-03a36cc83a1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:02.759923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ab341-a640-4710-b195-03a36cc83a1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:02.760298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fec27069-bcaa-4a27-a8a9-58984bbae163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8242bd6e99664bd4ac10d2eaa903ad79'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:02.771426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ab341-a640-4710-b195-03a36cc83a1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:02.773134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ab341-a640-4710-b195-03a36cc83a1f service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:02.784349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 969/1946] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:02.852792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fec27069-bcaa-4a27-a8a9-58984bbae163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8242bd6e99664bd4ac10d2eaa903ad79'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:02.853399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fec27069-bcaa-4a27-a8a9-58984bbae163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8242bd6e99664bd4ac10d2eaa903ad79'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:02.856416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fec27069-bcaa-4a27-a8a9-58984bbae163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8242bd6e99664bd4ac10d2eaa903ad79'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:02.868995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fec27069-bcaa-4a27-a8a9-58984bbae163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8242bd6e99664bd4ac10d2eaa903ad79'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:02.879376 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ab341-a640-4710-b195-03a36cc83a1f service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:02.881592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e12ab341-a640-4710-b195-03a36cc83a1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:02.897983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ab341-a640-4710-b195-03a36cc83a1f service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:02.899610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 978/1947] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:02 2022] DELETE /identity/v3/users/8242bd6e99664bd4ac10d2eaa903ad79 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:03.003365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:03.004148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:03.004600 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:03.005307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] PATH_INFO: `/v3/users/58937f02e9ff4f6899a79f3790646ad8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:03.006251 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58937f02e9ff4f6899a79f3790646ad8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:03.008327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:03.247690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58937f02e9ff4f6899a79f3790646ad8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:03.248545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58937f02e9ff4f6899a79f3790646ad8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:03.249470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58937f02e9ff4f6899a79f3790646ad8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:03.259959 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58937f02e9ff4f6899a79f3790646ad8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:03.277982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58937f02e9ff4f6899a79f3790646ad8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:03.381018 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 970/1948] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:02 2022] DELETE /identity/v3/users/58937f02e9ff4f6899a79f3790646ad8 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:03.385515 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed736-da94-4843-a2a4-63126ba2e6e2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:03.385804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed736-da94-4843-a2a4-63126ba2e6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:03.386119 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed736-da94-4843-a2a4-63126ba2e6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:03.406665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e63ed736-da94-4843-a2a4-63126ba2e6e2 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:03.407875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e63ed736-da94-4843-a2a4-63126ba2e6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:03.439799 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:03.441333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:03.510011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:03.520584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 979/1949] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:03.532212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ed736-da94-4843-a2a4-63126ba2e6e2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:03.534014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e63ed736-da94-4843-a2a4-63126ba2e6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:03.543733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97afb7-a197-46b2-bea0-26f5543358e3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:03.552158 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af911492-0408-4099-9482-2064c485b80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:03.553002 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af911492-0408-4099-9482-2064c485b80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:03.553327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af911492-0408-4099-9482-2064c485b80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:03.553609 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af911492-0408-4099-9482-2064c485b80d admin admin] PATH_INFO: `/v3/projects/a56f6229d3604baa98501dfe0d885b08` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:03.554739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af911492-0408-4099-9482-2064c485b80d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56f6229d3604baa98501dfe0d885b08)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:03.556851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af911492-0408-4099-9482-2064c485b80d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:03.605139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ed736-da94-4843-a2a4-63126ba2e6e2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:03.608882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49612f94-c98f-495f-aadb-80c5489943b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:03.609540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49612f94-c98f-495f-aadb-80c5489943b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:03.609840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49612f94-c98f-495f-aadb-80c5489943b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:03.610115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49612f94-c98f-495f-aadb-80c5489943b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:03.619392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49612f94-c98f-495f-aadb-80c5489943b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:03.620834 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49612f94-c98f-495f-aadb-80c5489943b2 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:03.630633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 980/1950] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:03.706229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-af911492-0408-4099-9482-2064c485b80d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56f6229d3604baa98501dfe0d885b08', 'request_id': 'req-af911492-0408-4099-9482-2064c485b80d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:03.713139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-af911492-0408-4099-9482-2064c485b80d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56f6229d3604baa98501dfe0d885b08', 'request_id': 'req-af911492-0408-4099-9482-2064c485b80d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:03.823072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-af911492-0408-4099-9482-2064c485b80d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56f6229d3604baa98501dfe0d885b08', 'request_id': 'req-af911492-0408-4099-9482-2064c485b80d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:03.835181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-af911492-0408-4099-9482-2064c485b80d admin admin] The token cache is being invalidate because project a56f6229d3604baa98501dfe0d885b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:03.835477 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-af911492-0408-4099-9482-2064c485b80d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:03.836121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-af911492-0408-4099-9482-2064c485b80d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:03.837912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 971/1951] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:03 2022] DELETE /identity/v3/projects/a56f6229d3604baa98501dfe0d885b08 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:03.842570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49612f94-c98f-495f-aadb-80c5489943b2 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:03.860423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49612f94-c98f-495f-aadb-80c5489943b2 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:04.014601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:04.018553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:04.018924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:04.019107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] PATH_INFO: `/v3/users/294808297b2c46e89561b873cdc0080b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:04.022109 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=294808297b2c46e89561b873cdc0080b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:04.026867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:04.080463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:04.239562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294808297b2c46e89561b873cdc0080b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:04.260105 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af911492-0408-4099-9482-2064c485b80d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:04.261782 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-af911492-0408-4099-9482-2064c485b80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:04.281237 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af911492-0408-4099-9482-2064c485b80d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:04.290776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:04.291488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:04.291854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:04.292975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] PATH_INFO: `/v3/projects/7027ad54283848c995dc1bb9a1d10d30` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:04.295487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7027ad54283848c995dc1bb9a1d10d30)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:04.299008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:04.318134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294808297b2c46e89561b873cdc0080b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:04.319708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294808297b2c46e89561b873cdc0080b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:04.320393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294808297b2c46e89561b873cdc0080b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:04.333442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294808297b2c46e89561b873cdc0080b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:04.362480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 981/1952] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:03 2022] DELETE /identity/v3/users/294808297b2c46e89561b873cdc0080b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:04.478488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7027ad54283848c995dc1bb9a1d10d30', 'request_id': 'req-b78f8b4b-67c3-4457-891e-bb54da4b0193'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:04.488096 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7027ad54283848c995dc1bb9a1d10d30', 'request_id': 'req-b78f8b4b-67c3-4457-891e-bb54da4b0193'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:04.566257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7027ad54283848c995dc1bb9a1d10d30', 'request_id': 'req-b78f8b4b-67c3-4457-891e-bb54da4b0193'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:04.579347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] The token cache is being invalidate because project 7027ad54283848c995dc1bb9a1d10d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:04.591279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:04.591279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:04.591279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 972/1953] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:04 2022] DELETE /identity/v3/projects/7027ad54283848c995dc1bb9a1d10d30 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:04.592062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:04.592062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:04.698098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c503f-45f2-4fa1-b58e-2d5c854df0e7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:04.782504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:04.783284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:04.783771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:04.784537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] PATH_INFO: `/v3/users/636240c1d5324ca38a3b9237c6f1aa55` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:04.785870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=636240c1d5324ca38a3b9237c6f1aa55)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:04.788907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:05.017067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636240c1d5324ca38a3b9237c6f1aa55'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:05.125902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636240c1d5324ca38a3b9237c6f1aa55'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:05.126569 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636240c1d5324ca38a3b9237c6f1aa55'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:05.127301 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636240c1d5324ca38a3b9237c6f1aa55'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:05.135653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636240c1d5324ca38a3b9237c6f1aa55'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:05.171969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 982/1954] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:04 2022] DELETE /identity/v3/users/636240c1d5324ca38a3b9237c6f1aa55 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:05.655197 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:05.657186 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:05.670874 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f8b4b-67c3-4457-891e-bb54da4b0193 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:05.734592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8778d-43fd-47a7-8eb6-47fff053c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:05.735319 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8778d-43fd-47a7-8eb6-47fff053c06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:05.735671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8778d-43fd-47a7-8eb6-47fff053c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:05.736098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8778d-43fd-47a7-8eb6-47fff053c06b admin admin] PATH_INFO: `/v3/projects/389385db19e14f6d94b1baa7413c7d30` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:05.737512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8778d-43fd-47a7-8eb6-47fff053c06b admin admin] RBAC: Authorizing `identity:delete_project(project_id=389385db19e14f6d94b1baa7413c7d30)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:05.739780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8778d-43fd-47a7-8eb6-47fff053c06b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:05.771761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:05.773347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:05.788359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c3ca7-64ed-414d-8705-5155513c7838 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:05.793031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b7c28-f047-4457-ab91-b762b1a20587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:05.793700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b7c28-f047-4457-ab91-b762b1a20587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:05.793973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b7c28-f047-4457-ab91-b762b1a20587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:05.794929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b7c28-f047-4457-ab91-b762b1a20587 admin admin] PATH_INFO: `/v3/projects/fe1a0c7ab6f24571ae0a91cb79cd8c33` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:05.796057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b7c28-f047-4457-ab91-b762b1a20587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1a0c7ab6f24571ae0a91cb79cd8c33)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:05.799021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b7c28-f047-4457-ab91-b762b1a20587 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:05.884236 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-94e8778d-43fd-47a7-8eb6-47fff053c06b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389385db19e14f6d94b1baa7413c7d30', 'request_id': 'req-94e8778d-43fd-47a7-8eb6-47fff053c06b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:05.890405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-94e8778d-43fd-47a7-8eb6-47fff053c06b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389385db19e14f6d94b1baa7413c7d30', 'request_id': 'req-94e8778d-43fd-47a7-8eb6-47fff053c06b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:05.906109 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:05.924186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-461b7c28-f047-4457-ab91-b762b1a20587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1a0c7ab6f24571ae0a91cb79cd8c33', 'request_id': 'req-461b7c28-f047-4457-ab91-b762b1a20587'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:05.931449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-461b7c28-f047-4457-ab91-b762b1a20587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1a0c7ab6f24571ae0a91cb79cd8c33', 'request_id': 'req-461b7c28-f047-4457-ab91-b762b1a20587'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:05.979751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-94e8778d-43fd-47a7-8eb6-47fff053c06b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389385db19e14f6d94b1baa7413c7d30', 'request_id': 'req-94e8778d-43fd-47a7-8eb6-47fff053c06b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:05.991510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-94e8778d-43fd-47a7-8eb6-47fff053c06b admin admin] The token cache is being invalidate because project 389385db19e14f6d94b1baa7413c7d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:05.992037 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-94e8778d-43fd-47a7-8eb6-47fff053c06b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:05.992752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-94e8778d-43fd-47a7-8eb6-47fff053c06b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:05.994682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 973/1955] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:05 2022] DELETE /identity/v3/projects/389385db19e14f6d94b1baa7413c7d30 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:05.999750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5755a3c-30d7-4deb-a0d6-b3932e1b85be None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.000916 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5755a3c-30d7-4deb-a0d6-b3932e1b85be None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.000916 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5755a3c-30d7-4deb-a0d6-b3932e1b85be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.022334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e5755a3c-30d7-4deb-a0d6-b3932e1b85be None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:06.023651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e5755a3c-30d7-4deb-a0d6-b3932e1b85be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:06.062799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-461b7c28-f047-4457-ab91-b762b1a20587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1a0c7ab6f24571ae0a91cb79cd8c33', 'request_id': 'req-461b7c28-f047-4457-ab91-b762b1a20587'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:06.082631 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-461b7c28-f047-4457-ab91-b762b1a20587 admin admin] The token cache is being invalidate because project fe1a0c7ab6f24571ae0a91cb79cd8c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:06.083274 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-461b7c28-f047-4457-ab91-b762b1a20587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:06.084568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-461b7c28-f047-4457-ab91-b762b1a20587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:06.087233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 983/1956] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:05 2022] DELETE /identity/v3/projects/fe1a0c7ab6f24571ae0a91cb79cd8c33 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:06.092802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836517f-98eb-4aed-b5a5-1627ed19222b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.093601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836517f-98eb-4aed-b5a5-1627ed19222b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.094048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836517f-98eb-4aed-b5a5-1627ed19222b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.105660 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 974/1957] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:06.113884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eebe2b-e4e1-42de-b75f-cc637a8d1010 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.114177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eebe2b-e4e1-42de-b75f-cc637a8d1010 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.114456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eebe2b-e4e1-42de-b75f-cc637a8d1010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.118611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5836517f-98eb-4aed-b5a5-1627ed19222b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:06.119902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5836517f-98eb-4aed-b5a5-1627ed19222b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:06.129528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 984/1958] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:06.135482 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-55eebe2b-e4e1-42de-b75f-cc637a8d1010 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:06.137036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-55eebe2b-e4e1-42de-b75f-cc637a8d1010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:06.144058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ca14-fe51-47e9-8e82-2c48071722af None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.144435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ca14-fe51-47e9-8e82-2c48071722af None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.144787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ca14-fe51-47e9-8e82-2c48071722af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.148859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 975/1959] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:06.149675 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eebe2b-e4e1-42de-b75f-cc637a8d1010 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:06.160289 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eebe2b-e4e1-42de-b75f-cc637a8d1010 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:06.165510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:06.168095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0026a48-b29a-4c4e-90fd-b8c3f5de95eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:06.168095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0026a48-b29a-4c4e-90fd-b8c3f5de95eb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.168095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0026a48-b29a-4c4e-90fd-b8c3f5de95eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.168095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0026a48-b29a-4c4e-90fd-b8c3f5de95eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.171568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0026a48-b29a-4c4e-90fd-b8c3f5de95eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:06.173072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0026a48-b29a-4c4e-90fd-b8c3f5de95eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:06.176239 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0026a48-b29a-4c4e-90fd-b8c3f5de95eb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:06.184351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e516ca14-fe51-47e9-8e82-2c48071722af None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:06.185879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e516ca14-fe51-47e9-8e82-2c48071722af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:06.195977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 976/1960] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:31:06.196897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0026a48-b29a-4c4e-90fd-b8c3f5de95eb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:06.197544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 985/1961] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:06.201577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516ca14-fe51-47e9-8e82-2c48071722af None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:06.208143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0026a48-b29a-4c4e-90fd-b8c3f5de95eb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:06.212285 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516ca14-fe51-47e9-8e82-2c48071722af None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:06.214873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bac4e6-f69e-4e14-a213-1e2581eeff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:06.215486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bac4e6-f69e-4e14-a213-1e2581eeff30 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.215756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bac4e6-f69e-4e14-a213-1e2581eeff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.216927 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bac4e6-f69e-4e14-a213-1e2581eeff30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.217607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bac4e6-f69e-4e14-a213-1e2581eeff30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:06.218936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b017384-8f52-4987-b6fe-9f53d03b49b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:06.219513 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bac4e6-f69e-4e14-a213-1e2581eeff30 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:06.219641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b017384-8f52-4987-b6fe-9f53d03b49b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.219807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b017384-8f52-4987-b6fe-9f53d03b49b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.220087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b017384-8f52-4987-b6fe-9f53d03b49b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.220738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b017384-8f52-4987-b6fe-9f53d03b49b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:06.221103 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b017384-8f52-4987-b6fe-9f53d03b49b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:06.224638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b017384-8f52-4987-b6fe-9f53d03b49b4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:06.240329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 986/1962] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:31:06.244981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b017384-8f52-4987-b6fe-9f53d03b49b4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:06.258714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b017384-8f52-4987-b6fe-9f53d03b49b4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:06.263681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8d949-d488-4c04-a82d-ecdff81a8b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:06.264290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8d949-d488-4c04-a82d-ecdff81a8b77 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.264571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8d949-d488-4c04-a82d-ecdff81a8b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.264862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8d949-d488-4c04-a82d-ecdff81a8b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.265745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8d949-d488-4c04-a82d-ecdff81a8b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:06.267505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8d949-d488-4c04-a82d-ecdff81a8b77 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:06.320926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 977/1963] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:06 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:06.323858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bac4e6-f69e-4e14-a213-1e2581eeff30 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:06.395263 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bac4e6-f69e-4e14-a213-1e2581eeff30 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:06.404311 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4459a7-d6b2-4f04-a512-f2f7145a578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:06.406647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4459a7-d6b2-4f04-a512-f2f7145a578a admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.406647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4459a7-d6b2-4f04-a512-f2f7145a578a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.406647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4459a7-d6b2-4f04-a512-f2f7145a578a admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.408095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4459a7-d6b2-4f04-a512-f2f7145a578a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:06.409206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 987/1964] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:06 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:06.410121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8d949-d488-4c04-a82d-ecdff81a8b77 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:06.410655 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4459a7-d6b2-4f04-a512-f2f7145a578a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:06.512432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8d949-d488-4c04-a82d-ecdff81a8b77 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:06.518522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d010a-51c6-4013-aaa6-a17ebdfb723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:06.519142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d010a-51c6-4013-aaa6-a17ebdfb723c admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.519421 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d010a-51c6-4013-aaa6-a17ebdfb723c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.519694 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d010a-51c6-4013-aaa6-a17ebdfb723c admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.520320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d010a-51c6-4013-aaa6-a17ebdfb723c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:06.522271 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d010a-51c6-4013-aaa6-a17ebdfb723c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:06.544609 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:06.550133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 978/1965] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:06 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:06.552028 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4459a7-d6b2-4f04-a512-f2f7145a578a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:06.577224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4459a7-d6b2-4f04-a512-f2f7145a578a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:06.590801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a3a75-b79a-40e8-b3d9-9a8b9c75b180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:06.592283 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a3a75-b79a-40e8-b3d9-9a8b9c75b180 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.592567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a3a75-b79a-40e8-b3d9-9a8b9c75b180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.593776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a3a75-b79a-40e8-b3d9-9a8b9c75b180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.598768 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a3a75-b79a-40e8-b3d9-9a8b9c75b180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:06.601862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a3a75-b79a-40e8-b3d9-9a8b9c75b180 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:06.632020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 979/1966] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:06.634347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a3a75-b79a-40e8-b3d9-9a8b9c75b180 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:06.651618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 988/1967] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:06 2022] POST /identity/v3/users => generated 281 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:06.652699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d010a-51c6-4013-aaa6-a17ebdfb723c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:06.659866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a3a75-b79a-40e8-b3d9-9a8b9c75b180 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:06.672029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e812fe2-fa8a-4897-a7ad-ccf6de12c07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:06.672754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e812fe2-fa8a-4897-a7ad-ccf6de12c07e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.673037 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e812fe2-fa8a-4897-a7ad-ccf6de12c07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.673221 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d010a-51c6-4013-aaa6-a17ebdfb723c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:06.674531 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e812fe2-fa8a-4897-a7ad-ccf6de12c07e admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.675395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e812fe2-fa8a-4897-a7ad-ccf6de12c07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:06.679378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726fe17-29c9-4655-bea4-31847798730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:06.680698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726fe17-29c9-4655-bea4-31847798730d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.680698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726fe17-29c9-4655-bea4-31847798730d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.680698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726fe17-29c9-4655-bea4-31847798730d admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.681310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e812fe2-fa8a-4897-a7ad-ccf6de12c07e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:06.681417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726fe17-29c9-4655-bea4-31847798730d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:06.683387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726fe17-29c9-4655-bea4-31847798730d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:06.698614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 989/1968] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:06.699524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726fe17-29c9-4655-bea4-31847798730d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:06.705586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 980/1969] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:06.706838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e812fe2-fa8a-4897-a7ad-ccf6de12c07e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:06.712781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726fe17-29c9-4655-bea4-31847798730d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:06.720912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fc3bf-1feb-4616-8f84-24bb42a5305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:06.721802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fc3bf-1feb-4616-8f84-24bb42a5305b admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.722212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fc3bf-1feb-4616-8f84-24bb42a5305b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.722706 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fc3bf-1feb-4616-8f84-24bb42a5305b admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.724002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fc3bf-1feb-4616-8f84-24bb42a5305b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:06.724539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e812fe2-fa8a-4897-a7ad-ccf6de12c07e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:06.726795 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fc3bf-1feb-4616-8f84-24bb42a5305b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:06.732381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76a338-b27f-4a41-b460-eba9729611dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:06.734506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76a338-b27f-4a41-b460-eba9729611dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.734506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76a338-b27f-4a41-b460-eba9729611dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.734506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76a338-b27f-4a41-b460-eba9729611dc admin admin] PATH_INFO: `/v3/projects/7d25e32eaaf747478d925d7bb1eca033/users/c4e5a3eafd7a4364a1e0f4d9c67ab2c4/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.750105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 990/1970] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:06.751581 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fc3bf-1feb-4616-8f84-24bb42a5305b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:06.756029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76a338-b27f-4a41-b460-eba9729611dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d25e32eaaf747478d925d7bb1eca033, user_id=c4e5a3eafd7a4364a1e0f4d9c67ab2c4, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:06.759136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76a338-b27f-4a41-b460-eba9729611dc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:06.765587 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fc3bf-1feb-4616-8f84-24bb42a5305b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:06.773989 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c9370-a2cf-4c91-8d9a-4e1464e5670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:06.776179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c9370-a2cf-4c91-8d9a-4e1464e5670a admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.780748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c9370-a2cf-4c91-8d9a-4e1464e5670a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.780748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c9370-a2cf-4c91-8d9a-4e1464e5670a admin admin] PATH_INFO: `/v3/projects/5abb2927f181458e9536f79e19896604/users/0941020a49574a2eb4c54675e0cff418/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.799247 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c9370-a2cf-4c91-8d9a-4e1464e5670a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abb2927f181458e9536f79e19896604, user_id=0941020a49574a2eb4c54675e0cff418, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:06.818880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c9370-a2cf-4c91-8d9a-4e1464e5670a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:06.840800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 981/1971] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:06 2022] PUT /identity/v3/projects/7d25e32eaaf747478d925d7bb1eca033/users/c4e5a3eafd7a4364a1e0f4d9c67ab2c4/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:06.852956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9d80f-384f-428f-a37b-a407b3a53593 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.853498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9d80f-384f-428f-a37b-a407b3a53593 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.853826 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9d80f-384f-428f-a37b-a407b3a53593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.890386 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e1e9d80f-384f-428f-a37b-a407b3a53593 None None] MFA Rules not processed for user `c4e5a3eafd7a4364a1e0f4d9c67ab2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:06.891941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e1e9d80f-384f-428f-a37b-a407b3a53593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:06.955918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 991/1972] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:06 2022] PUT /identity/v3/projects/5abb2927f181458e9536f79e19896604/users/0941020a49574a2eb4c54675e0cff418/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:06.967990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416af9a6-8455-4264-a1b1-b1f2dcf198ee None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:06.968415 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416af9a6-8455-4264-a1b1-b1f2dcf198ee None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:06.968860 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416af9a6-8455-4264-a1b1-b1f2dcf198ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:06.981654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 982/1973] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:06.987437 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9d80f-384f-428f-a37b-a407b3a53593 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:07.005600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-416af9a6-8455-4264-a1b1-b1f2dcf198ee None None] MFA Rules not processed for user `0941020a49574a2eb4c54675e0cff418`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:07.007563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-416af9a6-8455-4264-a1b1-b1f2dcf198ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:07.073222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9d80f-384f-428f-a37b-a407b3a53593 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:07.102675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 992/1974] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:07.135038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416af9a6-8455-4264-a1b1-b1f2dcf198ee None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:07.136601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-416af9a6-8455-4264-a1b1-b1f2dcf198ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:07.169383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09427f-9d6d-4b08-bcd3-6fb1a179cd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:07.170747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09427f-9d6d-4b08-bcd3-6fb1a179cd83 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:07.171313 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09427f-9d6d-4b08-bcd3-6fb1a179cd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:07.171735 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09427f-9d6d-4b08-bcd3-6fb1a179cd83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:07.172564 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09427f-9d6d-4b08-bcd3-6fb1a179cd83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:07.174681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09427f-9d6d-4b08-bcd3-6fb1a179cd83 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:07.234828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416af9a6-8455-4264-a1b1-b1f2dcf198ee None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:07.240547 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09380499-59af-4879-99f1-5815c04770d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:07.241753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09380499-59af-4879-99f1-5815c04770d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:07.242497 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09380499-59af-4879-99f1-5815c04770d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:07.243022 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09380499-59af-4879-99f1-5815c04770d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:07.258861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09380499-59af-4879-99f1-5815c04770d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:07.260931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09380499-59af-4879-99f1-5815c04770d8 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:07.272563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 993/1975] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:31:07.281821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 983/1976] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:06 2022] POST /identity/v3/projects => generated 385 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:31:07.290113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09427f-9d6d-4b08-bcd3-6fb1a179cd83 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:07.291663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09380499-59af-4879-99f1-5815c04770d8 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:07.304856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09380499-59af-4879-99f1-5815c04770d8 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:07.420646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09427f-9d6d-4b08-bcd3-6fb1a179cd83 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:07.427008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7916df-fe20-42ca-83e8-a33e582fba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:07.427352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7916df-fe20-42ca-83e8-a33e582fba6c admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:07.429980 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7916df-fe20-42ca-83e8-a33e582fba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:07.429980 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7916df-fe20-42ca-83e8-a33e582fba6c admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:07.430296 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cc48e-4ddb-4def-9af8-02e72378da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:07.430404 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7916df-fe20-42ca-83e8-a33e582fba6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:07.430478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cc48e-4ddb-4def-9af8-02e72378da6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:07.430478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cc48e-4ddb-4def-9af8-02e72378da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:07.430478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cc48e-4ddb-4def-9af8-02e72378da6d admin admin] PATH_INFO: `/v3/users/0941020a49574a2eb4c54675e0cff418` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:07.430650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cc48e-4ddb-4def-9af8-02e72378da6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0941020a49574a2eb4c54675e0cff418)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:07.431507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7916df-fe20-42ca-83e8-a33e582fba6c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:07.432432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cc48e-4ddb-4def-9af8-02e72378da6d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:07.581203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 984/1977] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:07 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:07.584821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7916df-fe20-42ca-83e8-a33e582fba6c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:07.598718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7916df-fe20-42ca-83e8-a33e582fba6c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:07.603669 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5d3cf-e339-486a-8be6-323b5e08f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:07.609943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5d3cf-e339-486a-8be6-323b5e08f0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:07.609943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5d3cf-e339-486a-8be6-323b5e08f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:07.609943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5d3cf-e339-486a-8be6-323b5e08f0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:07.609943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5d3cf-e339-486a-8be6-323b5e08f0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:07.609943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5d3cf-e339-486a-8be6-323b5e08f0b8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:07.623677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 985/1978] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:07.630534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5d3cf-e339-486a-8be6-323b5e08f0b8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:07.643821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5d3cf-e339-486a-8be6-323b5e08f0b8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:07.651185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5b7c1-0255-45f2-9859-2bf5ff5adb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:07.652420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5b7c1-0255-45f2-9859-2bf5ff5adb64 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:07.652689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5b7c1-0255-45f2-9859-2bf5ff5adb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:07.652958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5b7c1-0255-45f2-9859-2bf5ff5adb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:07.654203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5b7c1-0255-45f2-9859-2bf5ff5adb64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:07.658543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5b7c1-0255-45f2-9859-2bf5ff5adb64 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:07.672483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 986/1979] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:07.676232 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5b7c1-0255-45f2-9859-2bf5ff5adb64 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:07.690419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5b7c1-0255-45f2-9859-2bf5ff5adb64 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:07.696948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39b72d-95a0-4001-9b69-79998fa9dc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:07.703844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39b72d-95a0-4001-9b69-79998fa9dc58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:07.703844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39b72d-95a0-4001-9b69-79998fa9dc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:07.703844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39b72d-95a0-4001-9b69-79998fa9dc58 admin admin] PATH_INFO: `/v3/projects/5e2bdcbbc1204deda19f7c68407ae6c9/users/8457ced7bf9a4c63884ef225c195b790/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:07.718933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39b72d-95a0-4001-9b69-79998fa9dc58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2bdcbbc1204deda19f7c68407ae6c9, user_id=8457ced7bf9a4c63884ef225c195b790, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:07.721356 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-338cc48e-4ddb-4def-9af8-02e72378da6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0941020a49574a2eb4c54675e0cff418'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:07.721993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39b72d-95a0-4001-9b69-79998fa9dc58 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:07.852549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-338cc48e-4ddb-4def-9af8-02e72378da6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0941020a49574a2eb4c54675e0cff418'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:07.854636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-338cc48e-4ddb-4def-9af8-02e72378da6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0941020a49574a2eb4c54675e0cff418'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:07.861102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-338cc48e-4ddb-4def-9af8-02e72378da6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0941020a49574a2eb4c54675e0cff418'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:07.873288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 987/1980] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:07 2022] PUT /identity/v3/projects/5e2bdcbbc1204deda19f7c68407ae6c9/users/8457ced7bf9a4c63884ef225c195b790/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:07.877702 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-338cc48e-4ddb-4def-9af8-02e72378da6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0941020a49574a2eb4c54675e0cff418'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:07.900114 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3963dbe-91d3-4ac7-82da-6ca24760c323 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:07.900408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3963dbe-91d3-4ac7-82da-6ca24760c323 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:07.900689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3963dbe-91d3-4ac7-82da-6ca24760c323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:07.931437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 994/1981] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:07 2022] DELETE /identity/v3/users/0941020a49574a2eb4c54675e0cff418 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:07.932914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c83fb-9915-4dcd-9337-ef70cd7e1aaa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:07.933285 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c83fb-9915-4dcd-9337-ef70cd7e1aaa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:07.933638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c83fb-9915-4dcd-9337-ef70cd7e1aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:07.935511 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a3963dbe-91d3-4ac7-82da-6ca24760c323 None None] MFA Rules not processed for user `8457ced7bf9a4c63884ef225c195b790`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:07.937037 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a3963dbe-91d3-4ac7-82da-6ca24760c323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:07.943172 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:07.969315 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b13c83fb-9915-4dcd-9337-ef70cd7e1aaa None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:07.970804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b13c83fb-9915-4dcd-9337-ef70cd7e1aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:08.044737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 988/1982] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:08.044737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3963dbe-91d3-4ac7-82da-6ca24760c323 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:08.046321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a3963dbe-91d3-4ac7-82da-6ca24760c323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:08.095307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 995/1983] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:08.095307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c83fb-9915-4dcd-9337-ef70cd7e1aaa None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:08.095801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b13c83fb-9915-4dcd-9337-ef70cd7e1aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:08.155552 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3963dbe-91d3-4ac7-82da-6ca24760c323 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:08.162725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b820c-768c-4782-93e2-c3f9dee2c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:08.163571 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b820c-768c-4782-93e2-c3f9dee2c4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:08.163862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b820c-768c-4782-93e2-c3f9dee2c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:08.164208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b820c-768c-4782-93e2-c3f9dee2c4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:08.164989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b820c-768c-4782-93e2-c3f9dee2c4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:08.167338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b820c-768c-4782-93e2-c3f9dee2c4c2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:08.175084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c83fb-9915-4dcd-9337-ef70cd7e1aaa None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:08.179805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2b65f-a085-41bb-a20b-8c1991cbbca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:08.180584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2b65f-a085-41bb-a20b-8c1991cbbca7 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:08.180954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2b65f-a085-41bb-a20b-8c1991cbbca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:08.181230 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2b65f-a085-41bb-a20b-8c1991cbbca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:08.190801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2b65f-a085-41bb-a20b-8c1991cbbca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:08.192231 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2b65f-a085-41bb-a20b-8c1991cbbca7 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:08.202393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 996/1984] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:08.259359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 989/1985] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:08 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:08.260998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2b65f-a085-41bb-a20b-8c1991cbbca7 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:08.271841 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2b65f-a085-41bb-a20b-8c1991cbbca7 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:08.333838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb3497-dac5-4a64-8195-ee6162a2b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:08.334806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3497-dac5-4a64-8195-ee6162a2b043 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:08.335129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3497-dac5-4a64-8195-ee6162a2b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:08.335467 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb3497-dac5-4a64-8195-ee6162a2b043 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:08.336189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb3497-dac5-4a64-8195-ee6162a2b043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:08.338373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb3497-dac5-4a64-8195-ee6162a2b043 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:08.361714 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b820c-768c-4782-93e2-c3f9dee2c4c2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:08.363646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-736b820c-768c-4782-93e2-c3f9dee2c4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:08.378856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b820c-768c-4782-93e2-c3f9dee2c4c2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:08.384049 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615d071-2a0f-4de2-ae3c-755869e0770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:08.384700 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615d071-2a0f-4de2-ae3c-755869e0770f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:08.384985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615d071-2a0f-4de2-ae3c-755869e0770f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:08.385279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615d071-2a0f-4de2-ae3c-755869e0770f admin admin] PATH_INFO: `/v3/users/93715302a5dd45c787db9436d63400fe` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:08.386450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615d071-2a0f-4de2-ae3c-755869e0770f admin admin] RBAC: Authorizing `identity:delete_user(user_id=93715302a5dd45c787db9436d63400fe)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:08.388983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615d071-2a0f-4de2-ae3c-755869e0770f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:08.397999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:08.433295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 997/1986] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:08 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:08.438279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb3497-dac5-4a64-8195-ee6162a2b043 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:08.457624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb3497-dac5-4a64-8195-ee6162a2b043 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:08.462819 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c94473-124f-4af1-86d6-3cac670a52c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:08.463433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94473-124f-4af1-86d6-3cac670a52c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:08.463717 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94473-124f-4af1-86d6-3cac670a52c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:08.465146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94473-124f-4af1-86d6-3cac670a52c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:08.465146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c94473-124f-4af1-86d6-3cac670a52c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:08.466762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c94473-124f-4af1-86d6-3cac670a52c9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:08.477877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 998/1987] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:08.481858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c94473-124f-4af1-86d6-3cac670a52c9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:08.491836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c94473-124f-4af1-86d6-3cac670a52c9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:08.496468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8053ff0-0722-4290-ac41-cafdc601a8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:08.497667 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8053ff0-0722-4290-ac41-cafdc601a8f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:08.497949 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8053ff0-0722-4290-ac41-cafdc601a8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:08.498229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8053ff0-0722-4290-ac41-cafdc601a8f6 admin admin] PATH_INFO: `/v3/projects/7571e90900da4657b56f046cab6b579f/users/ee13657458ec4f3481fe9465af584979/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:08.513967 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8053ff0-0722-4290-ac41-cafdc601a8f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7571e90900da4657b56f046cab6b579f, user_id=ee13657458ec4f3481fe9465af584979, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:08.516642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8053ff0-0722-4290-ac41-cafdc601a8f6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:08.616555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d615d071-2a0f-4de2-ae3c-755869e0770f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93715302a5dd45c787db9436d63400fe'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:08.617135 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d615d071-2a0f-4de2-ae3c-755869e0770f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93715302a5dd45c787db9436d63400fe'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:08.617758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d615d071-2a0f-4de2-ae3c-755869e0770f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93715302a5dd45c787db9436d63400fe'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:08.625483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d615d071-2a0f-4de2-ae3c-755869e0770f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93715302a5dd45c787db9436d63400fe'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:08.637734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d615d071-2a0f-4de2-ae3c-755869e0770f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93715302a5dd45c787db9436d63400fe'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:08.661844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 999/1988] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:08 2022] PUT /identity/v3/projects/7571e90900da4657b56f046cab6b579f/users/ee13657458ec4f3481fe9465af584979/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:08.663457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8053ff0-0722-4290-ac41-cafdc601a8f6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:08.665251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a8053ff0-0722-4290-ac41-cafdc601a8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:08.728873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 990/1989] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:08 2022] DELETE /identity/v3/users/93715302a5dd45c787db9436d63400fe => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:08.730824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8053ff0-0722-4290-ac41-cafdc601a8f6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:08.734106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15b1c8-2933-4eba-a635-a71ae3c04e43 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:08.734389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15b1c8-2933-4eba-a635-a71ae3c04e43 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:08.734665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15b1c8-2933-4eba-a635-a71ae3c04e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:08.756763 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ed15b1c8-2933-4eba-a635-a71ae3c04e43 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:08.758125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ed15b1c8-2933-4eba-a635-a71ae3c04e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:08.789596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043b3f2-15a5-42f5-9ff0-d3a73c14e445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:08.790247 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043b3f2-15a5-42f5-9ff0-d3a73c14e445 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:08.790525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043b3f2-15a5-42f5-9ff0-d3a73c14e445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:08.790929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043b3f2-15a5-42f5-9ff0-d3a73c14e445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:08.791580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043b3f2-15a5-42f5-9ff0-d3a73c14e445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:08.793191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043b3f2-15a5-42f5-9ff0-d3a73c14e445 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:08.804116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1000/1990] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:08.811620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043b3f2-15a5-42f5-9ff0-d3a73c14e445 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:08.814171 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0043b3f2-15a5-42f5-9ff0-d3a73c14e445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:08.824144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 991/1991] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:08.827546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15b1c8-2933-4eba-a635-a71ae3c04e43 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:08.827883 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043b3f2-15a5-42f5-9ff0-d3a73c14e445 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:08.833743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6d54-64b8-4617-a809-ae752e48e364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:08.836960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6d54-64b8-4617-a809-ae752e48e364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:08.836960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6d54-64b8-4617-a809-ae752e48e364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:08.836960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6d54-64b8-4617-a809-ae752e48e364 admin admin] PATH_INFO: `/v3/projects/5abb2927f181458e9536f79e19896604` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:08.837638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c6d54-64b8-4617-a809-ae752e48e364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5abb2927f181458e9536f79e19896604)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:08.839198 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c6d54-64b8-4617-a809-ae752e48e364 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:08.839317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15b1c8-2933-4eba-a635-a71ae3c04e43 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:08.844325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5e02d-747b-4b37-b433-18ded45361b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:08.844964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5e02d-747b-4b37-b433-18ded45361b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:08.845338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5e02d-747b-4b37-b433-18ded45361b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:08.845675 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5e02d-747b-4b37-b433-18ded45361b2 admin admin] PATH_INFO: `/v3/projects/7571e90900da4657b56f046cab6b579f/users/ee13657458ec4f3481fe9465af584979/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:08.847643 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5e02d-747b-4b37-b433-18ded45361b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7571e90900da4657b56f046cab6b579f, user_id=ee13657458ec4f3481fe9465af584979, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:08.850529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5e02d-747b-4b37-b433-18ded45361b2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:08.861528 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 992/1992] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:08 2022] PUT /identity/v3/projects/7571e90900da4657b56f046cab6b579f/users/ee13657458ec4f3481fe9465af584979/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:08.862331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5e02d-747b-4b37-b433-18ded45361b2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:08.863917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-52b5e02d-747b-4b37-b433-18ded45361b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:08.923360 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5e02d-747b-4b37-b433-18ded45361b2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:08.927617 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb4352-63ac-4075-ae2e-e76a97dbd5fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:08.928228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb4352-63ac-4075-ae2e-e76a97dbd5fe service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:08.928654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb4352-63ac-4075-ae2e-e76a97dbd5fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:08.928927 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb4352-63ac-4075-ae2e-e76a97dbd5fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:08.961939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a76c6d54-64b8-4617-a809-ae752e48e364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5abb2927f181458e9536f79e19896604', 'request_id': 'req-a76c6d54-64b8-4617-a809-ae752e48e364'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:08.970325 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a76c6d54-64b8-4617-a809-ae752e48e364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5abb2927f181458e9536f79e19896604', 'request_id': 'req-a76c6d54-64b8-4617-a809-ae752e48e364'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:08.994141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb4352-63ac-4075-ae2e-e76a97dbd5fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:08.995586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb4352-63ac-4075-ae2e-e76a97dbd5fe service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:09.006141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 993/1993] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:09.007230 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015e60-5f60-4124-91eb-4f91e2a2b710 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:09.009006 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015e60-5f60-4124-91eb-4f91e2a2b710 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:09.009006 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015e60-5f60-4124-91eb-4f91e2a2b710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:09.035459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-19015e60-5f60-4124-91eb-4f91e2a2b710 None None] MFA Rules not processed for user `ee13657458ec4f3481fe9465af584979`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:09.036676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-19015e60-5f60-4124-91eb-4f91e2a2b710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:09.057551 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a76c6d54-64b8-4617-a809-ae752e48e364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5abb2927f181458e9536f79e19896604', 'request_id': 'req-a76c6d54-64b8-4617-a809-ae752e48e364'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:09.075268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a76c6d54-64b8-4617-a809-ae752e48e364 admin admin] The token cache is being invalidate because project 5abb2927f181458e9536f79e19896604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:09.075635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a76c6d54-64b8-4617-a809-ae752e48e364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:09.076791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a76c6d54-64b8-4617-a809-ae752e48e364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:09.079844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1001/1994] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:08 2022] DELETE /identity/v3/projects/5abb2927f181458e9536f79e19896604 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:09.085216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5d724-a363-4f82-93f1-4b9514ed5401 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:09.085599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5d724-a363-4f82-93f1-4b9514ed5401 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:09.093830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5d724-a363-4f82-93f1-4b9514ed5401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:09.107697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-80e5d724-a363-4f82-93f1-4b9514ed5401 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:09.109337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-80e5d724-a363-4f82-93f1-4b9514ed5401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:09.122972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 994/1995] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:09.135285 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19015e60-5f60-4124-91eb-4f91e2a2b710 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:09.136732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-19015e60-5f60-4124-91eb-4f91e2a2b710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:09.229087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1002/1996] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:09.244822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580df2-421b-4d08-b276-24847ed101cb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:09.245547 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580df2-421b-4d08-b276-24847ed101cb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:09.246197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580df2-421b-4d08-b276-24847ed101cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:09.255633 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19015e60-5f60-4124-91eb-4f91e2a2b710 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:09.260373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa29e19-379a-467c-8878-1265397aaca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:09.261425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa29e19-379a-467c-8878-1265397aaca3 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:09.261711 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa29e19-379a-467c-8878-1265397aaca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:09.261962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa29e19-379a-467c-8878-1265397aaca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:09.263800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2aa29e19-379a-467c-8878-1265397aaca3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:09.273776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-84580df2-421b-4d08-b276-24847ed101cb None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:09.275377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-84580df2-421b-4d08-b276-24847ed101cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:09.290735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1003/1997] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:09.290735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84580df2-421b-4d08-b276-24847ed101cb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:09.304916 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84580df2-421b-4d08-b276-24847ed101cb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:09.312684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed20b8-1e35-4e75-ab93-60673b186c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:09.313860 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed20b8-1e35-4e75-ab93-60673b186c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:09.314133 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed20b8-1e35-4e75-ab93-60673b186c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:09.318902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed20b8-1e35-4e75-ab93-60673b186c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:09.318902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed20b8-1e35-4e75-ab93-60673b186c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:09.318902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed20b8-1e35-4e75-ab93-60673b186c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:09.318902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed20b8-1e35-4e75-ab93-60673b186c80 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:09.349297 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1004/1998] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:31:09.355768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed20b8-1e35-4e75-ab93-60673b186c80 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:09.368907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed20b8-1e35-4e75-ab93-60673b186c80 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:09.375744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c4284-5527-46c9-a9a9-03efc4ddcfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:09.376746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c4284-5527-46c9-a9a9-03efc4ddcfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:09.377125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c4284-5527-46c9-a9a9-03efc4ddcfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:09.377520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c4284-5527-46c9-a9a9-03efc4ddcfe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:09.379046 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c4284-5527-46c9-a9a9-03efc4ddcfe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:09.380079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa29e19-379a-467c-8878-1265397aaca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:09.380722 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c4284-5527-46c9-a9a9-03efc4ddcfe5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:09.382820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa29e19-379a-467c-8878-1265397aaca3 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:09.400320 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 995/1999] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:31:09.452320 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:09.459299 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1005/2000] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:09 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:31:09.463453 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa29e19-379a-467c-8878-1265397aaca3 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:09.475382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa29e19-379a-467c-8878-1265397aaca3 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:09.532198 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c4284-5527-46c9-a9a9-03efc4ddcfe5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:09.534494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-071c4284-5527-46c9-a9a9-03efc4ddcfe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:09.539380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1133f25-1fde-43df-975e-5de4360cd6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:09.540067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1133f25-1fde-43df-975e-5de4360cd6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:09.540480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1133f25-1fde-43df-975e-5de4360cd6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:09.540773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1133f25-1fde-43df-975e-5de4360cd6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:09.541546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1133f25-1fde-43df-975e-5de4360cd6f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:09.544138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1133f25-1fde-43df-975e-5de4360cd6f7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:09.555233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c4284-5527-46c9-a9a9-03efc4ddcfe5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:09.566338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:09.567049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:09.567629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:09.568098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] PATH_INFO: `/v3/projects/70de23e995ce46e6b6a99e3fa1b8d1ec` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:09.569468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=70de23e995ce46e6b6a99e3fa1b8d1ec)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:09.571619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:09.646886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 996/2001] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:09 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:09.652519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1133f25-1fde-43df-975e-5de4360cd6f7 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:09.661693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1133f25-1fde-43df-975e-5de4360cd6f7 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:09.666386 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002aa568-6f74-4bea-a216-c59f28beb3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:09.666980 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002aa568-6f74-4bea-a216-c59f28beb3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:09.667252 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002aa568-6f74-4bea-a216-c59f28beb3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:09.667576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002aa568-6f74-4bea-a216-c59f28beb3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:09.668358 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002aa568-6f74-4bea-a216-c59f28beb3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:09.670060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002aa568-6f74-4bea-a216-c59f28beb3b2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:09.680509 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 997/2002] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:09.684569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002aa568-6f74-4bea-a216-c59f28beb3b2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:09.694416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002aa568-6f74-4bea-a216-c59f28beb3b2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:09.699177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c657328-f1c3-4f2d-a7a6-8d804c9980cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:09.714393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c657328-f1c3-4f2d-a7a6-8d804c9980cb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:09.714393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c657328-f1c3-4f2d-a7a6-8d804c9980cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:09.714393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c657328-f1c3-4f2d-a7a6-8d804c9980cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:09.714393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c657328-f1c3-4f2d-a7a6-8d804c9980cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:09.714393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c657328-f1c3-4f2d-a7a6-8d804c9980cb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:09.714393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 998/2003] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:09.722198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c657328-f1c3-4f2d-a7a6-8d804c9980cb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:09.732173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c657328-f1c3-4f2d-a7a6-8d804c9980cb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:09.743138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b20035-e4ab-4c05-9af4-02486dc880c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:09.743138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20035-e4ab-4c05-9af4-02486dc880c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:09.743138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20035-e4ab-4c05-9af4-02486dc880c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:09.743138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20035-e4ab-4c05-9af4-02486dc880c1 admin admin] PATH_INFO: `/v3/projects/609a3226a5094f829ac18d750317bc11/users/507c9b3fffb845dc9e6b153860a7b281/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:09.754665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20035-e4ab-4c05-9af4-02486dc880c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=609a3226a5094f829ac18d750317bc11, user_id=507c9b3fffb845dc9e6b153860a7b281, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:09.757417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20035-e4ab-4c05-9af4-02486dc880c1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:09.763606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:09.914334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 999/2004] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:09 2022] PUT /identity/v3/projects/609a3226a5094f829ac18d750317bc11/users/507c9b3fffb845dc9e6b153860a7b281/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:09.924216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934291c-16a8-4d95-ae83-a67d964a7230 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:09.924506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934291c-16a8-4d95-ae83-a67d964a7230 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:09.924806 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934291c-16a8-4d95-ae83-a67d964a7230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:09.926980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70de23e995ce46e6b6a99e3fa1b8d1ec', 'request_id': 'req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:09.933712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70de23e995ce46e6b6a99e3fa1b8d1ec', 'request_id': 'req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:09.953938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9934291c-16a8-4d95-ae83-a67d964a7230 None None] MFA Rules not processed for user `507c9b3fffb845dc9e6b153860a7b281`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:09.955220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9934291c-16a8-4d95-ae83-a67d964a7230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:10.007661 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70de23e995ce46e6b6a99e3fa1b8d1ec', 'request_id': 'req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:10.030802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] The token cache is being invalidate because project 70de23e995ce46e6b6a99e3fa1b8d1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:10.031097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:10.032722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1000/2005] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:10.037217 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:10.038331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934291c-16a8-4d95-ae83-a67d964a7230 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:10.038877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1006/2006] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:09 2022] DELETE /identity/v3/projects/70de23e995ce46e6b6a99e3fa1b8d1ec => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:10.042556 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:10.043944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:10.123544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff74337-d5bc-44de-ae4f-23d99f78c6ed admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:10.133898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66252ec8-a920-4f25-8ab9-e5cc64964efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:10.134817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66252ec8-a920-4f25-8ab9-e5cc64964efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:10.135272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66252ec8-a920-4f25-8ab9-e5cc64964efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:10.135645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66252ec8-a920-4f25-8ab9-e5cc64964efa admin admin] PATH_INFO: `/v3/users/7a58040299524fdaa7630a6b1f82a5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:10.136897 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66252ec8-a920-4f25-8ab9-e5cc64964efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a58040299524fdaa7630a6b1f82a5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:10.139705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66252ec8-a920-4f25-8ab9-e5cc64964efa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:10.145333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934291c-16a8-4d95-ae83-a67d964a7230 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:10.148887 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafd01c-3bb5-4a8c-a904-553ecf27b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:10.149611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafd01c-3bb5-4a8c-a904-553ecf27b96d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:10.150475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafd01c-3bb5-4a8c-a904-553ecf27b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:10.150881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafd01c-3bb5-4a8c-a904-553ecf27b96d admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:10.151627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafd01c-3bb5-4a8c-a904-553ecf27b96d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:10.153658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafd01c-3bb5-4a8c-a904-553ecf27b96d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:10.281964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1001/2007] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:10 2022] POST /identity/v3/projects => generated 373 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:10.287226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafd01c-3bb5-4a8c-a904-553ecf27b96d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:10.288987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eeafd01c-3bb5-4a8c-a904-553ecf27b96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:10.363078 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafd01c-3bb5-4a8c-a904-553ecf27b96d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:10.374248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66252ec8-a920-4f25-8ab9-e5cc64964efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a58040299524fdaa7630a6b1f82a5ce'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:10.377775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55127283-d095-4be0-8f41-c448993a4ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:10.379216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55127283-d095-4be0-8f41-c448993a4ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:10.381638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55127283-d095-4be0-8f41-c448993a4ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:10.381638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55127283-d095-4be0-8f41-c448993a4ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:10.381638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55127283-d095-4be0-8f41-c448993a4ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:10.383186 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55127283-d095-4be0-8f41-c448993a4ef3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:10.486543 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66252ec8-a920-4f25-8ab9-e5cc64964efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a58040299524fdaa7630a6b1f82a5ce'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:10.487174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66252ec8-a920-4f25-8ab9-e5cc64964efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a58040299524fdaa7630a6b1f82a5ce'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:10.487836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66252ec8-a920-4f25-8ab9-e5cc64964efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a58040299524fdaa7630a6b1f82a5ce'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:10.499796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1002/2008] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:10 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:10.499983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66252ec8-a920-4f25-8ab9-e5cc64964efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a58040299524fdaa7630a6b1f82a5ce'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:10.501304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55127283-d095-4be0-8f41-c448993a4ef3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:10.504879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-55127283-d095-4be0-8f41-c448993a4ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:10.520763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1007/2009] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:10 2022] DELETE /identity/v3/users/7a58040299524fdaa7630a6b1f82a5ce => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:10.535053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55127283-d095-4be0-8f41-c448993a4ef3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:10.599108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8e1cc-52d6-4c2c-b4ed-972457ec1bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:10.599720 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8e1cc-52d6-4c2c-b4ed-972457ec1bbd admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:10.600009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8e1cc-52d6-4c2c-b4ed-972457ec1bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:10.600305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8e1cc-52d6-4c2c-b4ed-972457ec1bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:10.600955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8e1cc-52d6-4c2c-b4ed-972457ec1bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:10.602610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8e1cc-52d6-4c2c-b4ed-972457ec1bbd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:10.616684 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1003/2010] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:10.617923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66252ec8-a920-4f25-8ab9-e5cc64964efa admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:10.628720 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66252ec8-a920-4f25-8ab9-e5cc64964efa admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:10.631854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:10.634902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6776042-724b-446d-aadc-f8317a2d7854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:10.635566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6776042-724b-446d-aadc-f8317a2d7854 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:10.635848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6776042-724b-446d-aadc-f8317a2d7854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:10.636120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6776042-724b-446d-aadc-f8317a2d7854 admin admin] PATH_INFO: `/v3/projects/fa5b9ad330c54c9ea8b9000a6df47621/users/3307ae8e546542b284285b137a60d3fc/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:10.665524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6776042-724b-446d-aadc-f8317a2d7854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5b9ad330c54c9ea8b9000a6df47621, user_id=3307ae8e546542b284285b137a60d3fc, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:10.668327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6776042-724b-446d-aadc-f8317a2d7854 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:10.748814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1008/2011] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:10 2022] PUT /identity/v3/projects/fa5b9ad330c54c9ea8b9000a6df47621/users/3307ae8e546542b284285b137a60d3fc/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:10.752869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8e1cc-52d6-4c2c-b4ed-972457ec1bbd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:10.765613 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8e1cc-52d6-4c2c-b4ed-972457ec1bbd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:10.853677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1693e-aacf-4d84-8f44-fe396682f078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:10.854439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1693e-aacf-4d84-8f44-fe396682f078 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:10.854825 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1693e-aacf-4d84-8f44-fe396682f078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:10.855201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1693e-aacf-4d84-8f44-fe396682f078 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:10.855942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1693e-aacf-4d84-8f44-fe396682f078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:10.858367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1693e-aacf-4d84-8f44-fe396682f078 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:10.923228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1004/2012] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:10.924480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6776042-724b-446d-aadc-f8317a2d7854 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:10.941416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6776042-724b-446d-aadc-f8317a2d7854 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:10.947616 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69b66d-436b-4242-901e-257184086e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:10.950504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69b66d-436b-4242-901e-257184086e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:10.950504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69b66d-436b-4242-901e-257184086e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:10.950504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69b66d-436b-4242-901e-257184086e80 admin admin] PATH_INFO: `/v3/projects/fa5b9ad330c54c9ea8b9000a6df47621/users/3307ae8e546542b284285b137a60d3fc/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:10.953838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69b66d-436b-4242-901e-257184086e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5b9ad330c54c9ea8b9000a6df47621, user_id=3307ae8e546542b284285b137a60d3fc, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:10.957873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69b66d-436b-4242-901e-257184086e80 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:10.974277 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1009/2013] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:10 2022] PUT /identity/v3/projects/fa5b9ad330c54c9ea8b9000a6df47621/users/3307ae8e546542b284285b137a60d3fc/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:10.986408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27735bdd-712a-4029-8417-a4f3d9d7f84f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:10.990338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27735bdd-712a-4029-8417-a4f3d9d7f84f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:10.990704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27735bdd-712a-4029-8417-a4f3d9d7f84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:11.036548 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-27735bdd-712a-4029-8417-a4f3d9d7f84f None None] MFA Rules not processed for user `3307ae8e546542b284285b137a60d3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:11.043336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-27735bdd-712a-4029-8417-a4f3d9d7f84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:11.123946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1005/2014] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:11.174828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69b66d-436b-4242-901e-257184086e80 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:11.175505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6b69b66d-436b-4242-901e-257184086e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:11.242155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69b66d-436b-4242-901e-257184086e80 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:11.247160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae24d9-b943-4500-8394-3975ddba5f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:11.247790 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae24d9-b943-4500-8394-3975ddba5f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:11.248070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae24d9-b943-4500-8394-3975ddba5f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:11.248343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae24d9-b943-4500-8394-3975ddba5f80 admin admin] PATH_INFO: `/v3/projects/6f8eda1fe02448d7bbe866ee68030f2e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:11.249529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae24d9-b943-4500-8394-3975ddba5f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8eda1fe02448d7bbe866ee68030f2e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:11.250590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27735bdd-712a-4029-8417-a4f3d9d7f84f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:11.251495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae24d9-b943-4500-8394-3975ddba5f80 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:11.252057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-27735bdd-712a-4029-8417-a4f3d9d7f84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:11.319013 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27735bdd-712a-4029-8417-a4f3d9d7f84f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:11.322742 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc32ee-cc81-4605-a757-5db054fc9b9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:11.323363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc32ee-cc81-4605-a757-5db054fc9b9a service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:11.323639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc32ee-cc81-4605-a757-5db054fc9b9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:11.323913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc32ee-cc81-4605-a757-5db054fc9b9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:11.326186 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-59cc32ee-cc81-4605-a757-5db054fc9b9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:11.383102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-42ae24d9-b943-4500-8394-3975ddba5f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8eda1fe02448d7bbe866ee68030f2e', 'request_id': 'req-42ae24d9-b943-4500-8394-3975ddba5f80'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:11.390258 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc32ee-cc81-4605-a757-5db054fc9b9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:11.390506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-42ae24d9-b943-4500-8394-3975ddba5f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8eda1fe02448d7bbe866ee68030f2e', 'request_id': 'req-42ae24d9-b943-4500-8394-3975ddba5f80'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:11.391862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc32ee-cc81-4605-a757-5db054fc9b9a service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:11.401097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1006/2015] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:11.485379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-42ae24d9-b943-4500-8394-3975ddba5f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8eda1fe02448d7bbe866ee68030f2e', 'request_id': 'req-42ae24d9-b943-4500-8394-3975ddba5f80'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:11.500037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-42ae24d9-b943-4500-8394-3975ddba5f80 admin admin] The token cache is being invalidate because project 6f8eda1fe02448d7bbe866ee68030f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:11.500037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-42ae24d9-b943-4500-8394-3975ddba5f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:11.500277 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-42ae24d9-b943-4500-8394-3975ddba5f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:11.502078 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1010/2016] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:11 2022] DELETE /identity/v3/projects/6f8eda1fe02448d7bbe866ee68030f2e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:11.506792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751dbe3-f194-46de-9226-f9b4a5b76fd1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:11.507048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751dbe3-f194-46de-9226-f9b4a5b76fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:11.507323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751dbe3-f194-46de-9226-f9b4a5b76fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:11.527364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a751dbe3-f194-46de-9226-f9b4a5b76fd1 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:11.528697 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a751dbe3-f194-46de-9226-f9b4a5b76fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:11.591474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1007/2017] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:11.599463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188ddb4-36f1-4548-bfc8-154cabc0aaa7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:11.599753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188ddb4-36f1-4548-bfc8-154cabc0aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:11.600030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188ddb4-36f1-4548-bfc8-154cabc0aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:11.629378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4188ddb4-36f1-4548-bfc8-154cabc0aaa7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:11.630649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4188ddb4-36f1-4548-bfc8-154cabc0aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:11.640316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1011/2018] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:11.644453 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751dbe3-f194-46de-9226-f9b4a5b76fd1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:11.658688 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751dbe3-f194-46de-9226-f9b4a5b76fd1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:11.681628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2a2df-0b5f-4bbb-85c8-238653d1b06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:11.681628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2a2df-0b5f-4bbb-85c8-238653d1b06f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:11.681628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2a2df-0b5f-4bbb-85c8-238653d1b06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:11.681628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2a2df-0b5f-4bbb-85c8-238653d1b06f admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:11.682148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2a2df-0b5f-4bbb-85c8-238653d1b06f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:11.682148 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2a2df-0b5f-4bbb-85c8-238653d1b06f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:11.682306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2a2df-0b5f-4bbb-85c8-238653d1b06f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:11.714433 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1008/2019] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:31:11.722353 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188ddb4-36f1-4548-bfc8-154cabc0aaa7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:11.739594 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188ddb4-36f1-4548-bfc8-154cabc0aaa7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:11.741231 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131ae59-ae49-460c-b2c8-e0c6a142a5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:11.741231 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ae59-ae49-460c-b2c8-e0c6a142a5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:11.741647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ae59-ae49-460c-b2c8-e0c6a142a5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:11.741647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131ae59-ae49-460c-b2c8-e0c6a142a5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:11.742262 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131ae59-ae49-460c-b2c8-e0c6a142a5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:11.744171 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131ae59-ae49-460c-b2c8-e0c6a142a5a4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:11.780651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2a2df-0b5f-4bbb-85c8-238653d1b06f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:11.780651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d2e2a2df-0b5f-4bbb-85c8-238653d1b06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:11.837747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1012/2020] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:11 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:11.842088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131ae59-ae49-460c-b2c8-e0c6a142a5a4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:11.844031 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2a2df-0b5f-4bbb-85c8-238653d1b06f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:11.907216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dca55-e95e-4b7b-885f-dafe782a26a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:11.907820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dca55-e95e-4b7b-885f-dafe782a26a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:11.908101 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dca55-e95e-4b7b-885f-dafe782a26a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:11.908373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dca55-e95e-4b7b-885f-dafe782a26a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:11.908767 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131ae59-ae49-460c-b2c8-e0c6a142a5a4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:11.910251 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6a2dca55-e95e-4b7b-885f-dafe782a26a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:11.914655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731168a9-73f2-4305-b1e6-438cb2265ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:11.915259 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731168a9-73f2-4305-b1e6-438cb2265ceb admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:11.915741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731168a9-73f2-4305-b1e6-438cb2265ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:11.916299 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731168a9-73f2-4305-b1e6-438cb2265ceb admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:11.917034 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731168a9-73f2-4305-b1e6-438cb2265ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:11.919665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731168a9-73f2-4305-b1e6-438cb2265ceb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:11.941075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:11.969928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dca55-e95e-4b7b-885f-dafe782a26a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:11.971372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dca55-e95e-4b7b-885f-dafe782a26a4 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:11.980019 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1009/2021] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:31:12.043046 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1013/2022] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:11 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:31:12.045288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dca55-e95e-4b7b-885f-dafe782a26a4 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:12.057354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dca55-e95e-4b7b-885f-dafe782a26a4 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:12.062858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199aa67-c10f-4967-8045-536a4f812fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:12.063589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199aa67-c10f-4967-8045-536a4f812fdb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:12.065555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199aa67-c10f-4967-8045-536a4f812fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:12.065555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199aa67-c10f-4967-8045-536a4f812fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:12.065555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199aa67-c10f-4967-8045-536a4f812fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:12.066423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199aa67-c10f-4967-8045-536a4f812fdb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:12.077294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1010/2023] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:12.081295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731168a9-73f2-4305-b1e6-438cb2265ceb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:12.091815 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731168a9-73f2-4305-b1e6-438cb2265ceb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:12.096459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dc19e-418f-405a-80e5-17eb0bc865ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:12.097052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dc19e-418f-405a-80e5-17eb0bc865ad admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:12.097356 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dc19e-418f-405a-80e5-17eb0bc865ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:12.097629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dc19e-418f-405a-80e5-17eb0bc865ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:12.098261 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dc19e-418f-405a-80e5-17eb0bc865ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:12.099874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dc19e-418f-405a-80e5-17eb0bc865ad admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:12.111968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1014/2024] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:12.116171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199aa67-c10f-4967-8045-536a4f812fdb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:12.126583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199aa67-c10f-4967-8045-536a4f812fdb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:12.131211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3169b-c3b9-4fc1-81aa-717c1e98439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:12.131857 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3169b-c3b9-4fc1-81aa-717c1e98439e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:12.132136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3169b-c3b9-4fc1-81aa-717c1e98439e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:12.132415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3169b-c3b9-4fc1-81aa-717c1e98439e admin admin] PATH_INFO: `/v3/projects/c8ce8748bf254082a4091a19084bb9a5/users/92df30bbd7a54e5fadd1aeb054d5645e/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:12.163637 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3169b-c3b9-4fc1-81aa-717c1e98439e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ce8748bf254082a4091a19084bb9a5, user_id=92df30bbd7a54e5fadd1aeb054d5645e, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:12.166885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3169b-c3b9-4fc1-81aa-717c1e98439e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:12.247838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:12.254765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1011/2025] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:12 2022] PUT /identity/v3/projects/c8ce8748bf254082a4091a19084bb9a5/users/92df30bbd7a54e5fadd1aeb054d5645e/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:12.265699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a9166-488e-41c5-9dd3-ff921b4471e7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:12.265998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a9166-488e-41c5-9dd3-ff921b4471e7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:12.266384 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a9166-488e-41c5-9dd3-ff921b4471e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:12.299844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fd1a9166-488e-41c5-9dd3-ff921b4471e7 None None] MFA Rules not processed for user `92df30bbd7a54e5fadd1aeb054d5645e`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:12.300981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fd1a9166-488e-41c5-9dd3-ff921b4471e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:12.368364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1015/2026] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:12.372917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3169b-c3b9-4fc1-81aa-717c1e98439e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:12.445507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3169b-c3b9-4fc1-81aa-717c1e98439e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:12.450395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fc944-4978-4f66-903f-cb845f4c13ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:12.450937 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fc944-4978-4f66-903f-cb845f4c13ad admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:12.451217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fc944-4978-4f66-903f-cb845f4c13ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:12.451491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fc944-4978-4f66-903f-cb845f4c13ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:12.452137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fc944-4978-4f66-903f-cb845f4c13ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:12.454084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fc944-4978-4f66-903f-cb845f4c13ad admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:12.566119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1012/2027] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:12 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:31:12.567442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a9166-488e-41c5-9dd3-ff921b4471e7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:12.579727 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a9166-488e-41c5-9dd3-ff921b4471e7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:12.644896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98d1d1-a800-4f90-8e04-de6521cf4594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:12.645649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98d1d1-a800-4f90-8e04-de6521cf4594 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:12.645931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98d1d1-a800-4f90-8e04-de6521cf4594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:12.646208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98d1d1-a800-4f90-8e04-de6521cf4594 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:12.646894 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98d1d1-a800-4f90-8e04-de6521cf4594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:12.648997 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98d1d1-a800-4f90-8e04-de6521cf4594 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:12.800950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1016/2028] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:12 2022] POST /identity/v3/users => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:12.804993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fc944-4978-4f66-903f-cb845f4c13ad admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:12.815978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fc944-4978-4f66-903f-cb845f4c13ad admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:12.820412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b951014-4510-4ca1-8641-3a21c8c89761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:12.821501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951014-4510-4ca1-8641-3a21c8c89761 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:12.821783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951014-4510-4ca1-8641-3a21c8c89761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:12.822108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951014-4510-4ca1-8641-3a21c8c89761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:12.822777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b951014-4510-4ca1-8641-3a21c8c89761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:12.824403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b951014-4510-4ca1-8641-3a21c8c89761 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:12.835397 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1013/2029] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:12.839596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98d1d1-a800-4f90-8e04-de6521cf4594 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:12.851095 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98d1d1-a800-4f90-8e04-de6521cf4594 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:12.855768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe41f3-9d96-4869-a5c2-9e4266deaeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:12.856709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe41f3-9d96-4869-a5c2-9e4266deaeb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:12.856991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe41f3-9d96-4869-a5c2-9e4266deaeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:12.857354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe41f3-9d96-4869-a5c2-9e4266deaeb3 admin admin] PATH_INFO: `/v3/projects/235546e936bc445abff7c5c5718fe3ba/users/6b73819ead6e4efd8e9b6e0282d0c5e5/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:12.872716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe41f3-9d96-4869-a5c2-9e4266deaeb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=235546e936bc445abff7c5c5718fe3ba, user_id=6b73819ead6e4efd8e9b6e0282d0c5e5, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:12.875492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe41f3-9d96-4869-a5c2-9e4266deaeb3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:12.966524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1017/2030] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:12 2022] PUT /identity/v3/projects/235546e936bc445abff7c5c5718fe3ba/users/6b73819ead6e4efd8e9b6e0282d0c5e5/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:12.970474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b951014-4510-4ca1-8641-3a21c8c89761 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:12.984509 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b951014-4510-4ca1-8641-3a21c8c89761 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:13.061440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fed78-4a4e-4552-9bb0-8fb4c0b7b0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:13.061440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fed78-4a4e-4552-9bb0-8fb4c0b7b0ba admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:13.061440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fed78-4a4e-4552-9bb0-8fb4c0b7b0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:13.061440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fed78-4a4e-4552-9bb0-8fb4c0b7b0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:13.061849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fed78-4a4e-4552-9bb0-8fb4c0b7b0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:13.061849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fed78-4a4e-4552-9bb0-8fb4c0b7b0ba admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:13.073135 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1014/2031] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:13.074041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe41f3-9d96-4869-a5c2-9e4266deaeb3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:13.087152 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe41f3-9d96-4869-a5c2-9e4266deaeb3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:13.092607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e4b51-8e9c-451c-a77f-0a057ecc0c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:13.093399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4b51-8e9c-451c-a77f-0a057ecc0c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:13.093681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4b51-8e9c-451c-a77f-0a057ecc0c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:13.093952 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4b51-8e9c-451c-a77f-0a057ecc0c0f admin admin] PATH_INFO: `/v3/projects/235546e936bc445abff7c5c5718fe3ba/users/6b73819ead6e4efd8e9b6e0282d0c5e5/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:13.095862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e4b51-8e9c-451c-a77f-0a057ecc0c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=235546e936bc445abff7c5c5718fe3ba, user_id=6b73819ead6e4efd8e9b6e0282d0c5e5, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:13.098643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e4b51-8e9c-451c-a77f-0a057ecc0c0f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:13.109138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1018/2032] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:13 2022] PUT /identity/v3/projects/235546e936bc445abff7c5c5718fe3ba/users/6b73819ead6e4efd8e9b6e0282d0c5e5/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:13.120158 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0de9-4db9-49ef-a1f9-dc9812b92a89 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:13.120449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0de9-4db9-49ef-a1f9-dc9812b92a89 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:13.120722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0de9-4db9-49ef-a1f9-dc9812b92a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:13.154333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-09fd0de9-4db9-49ef-a1f9-dc9812b92a89 None None] MFA Rules not processed for user `6b73819ead6e4efd8e9b6e0282d0c5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:13.163531 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-09fd0de9-4db9-49ef-a1f9-dc9812b92a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:13.238197 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1015/2033] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:13.285051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e4b51-8e9c-451c-a77f-0a057ecc0c0f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:13.286825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7b0e4b51-8e9c-451c-a77f-0a057ecc0c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:13.343893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e4b51-8e9c-451c-a77f-0a057ecc0c0f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:13.348021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cabdd-985d-4278-84f7-29fcbc5f922f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:13.348682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cabdd-985d-4278-84f7-29fcbc5f922f service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:13.348995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cabdd-985d-4278-84f7-29fcbc5f922f service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:13.349282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cabdd-985d-4278-84f7-29fcbc5f922f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:13.359362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cabdd-985d-4278-84f7-29fcbc5f922f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:13.360801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cabdd-985d-4278-84f7-29fcbc5f922f service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:13.370504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1019/2034] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:13.649349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd0de9-4db9-49ef-a1f9-dc9812b92a89 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:13.660774 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd0de9-4db9-49ef-a1f9-dc9812b92a89 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:13.664314 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30004329-84ac-47df-ba27-55aab8514adc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:13.664923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30004329-84ac-47df-ba27-55aab8514adc service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:13.665199 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30004329-84ac-47df-ba27-55aab8514adc service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:13.665502 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30004329-84ac-47df-ba27-55aab8514adc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:13.726679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30004329-84ac-47df-ba27-55aab8514adc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:13.728162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30004329-84ac-47df-ba27-55aab8514adc service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:13.737794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1016/2035] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:13.915133 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cabdd-985d-4278-84f7-29fcbc5f922f service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:13.924282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cabdd-985d-4278-84f7-29fcbc5f922f service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:13.928056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022cb8d-d721-4361-96c2-67ed2f194953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:13.928681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022cb8d-d721-4361-96c2-67ed2f194953 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:13.928958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022cb8d-d721-4361-96c2-67ed2f194953 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:13.929227 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022cb8d-d721-4361-96c2-67ed2f194953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:13.931042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6022cb8d-d721-4361-96c2-67ed2f194953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:13.995669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022cb8d-d721-4361-96c2-67ed2f194953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:13.997924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022cb8d-d721-4361-96c2-67ed2f194953 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:14.007815 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1020/2036] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:14.279545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:14.359290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30004329-84ac-47df-ba27-55aab8514adc service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:14.415216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:14.424958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30004329-84ac-47df-ba27-55aab8514adc service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:14.429805 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:14.430425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:14.430702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:14.431098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] PATH_INFO: `/v3/users/92df30bbd7a54e5fadd1aeb054d5645e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:14.432238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92df30bbd7a54e5fadd1aeb054d5645e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:14.434765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:14.640712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92df30bbd7a54e5fadd1aeb054d5645e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:14.641367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92df30bbd7a54e5fadd1aeb054d5645e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:14.641971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92df30bbd7a54e5fadd1aeb054d5645e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:14.649991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92df30bbd7a54e5fadd1aeb054d5645e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:14.663567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92df30bbd7a54e5fadd1aeb054d5645e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:14.751149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1017/2037] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:14 2022] DELETE /identity/v3/users/92df30bbd7a54e5fadd1aeb054d5645e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:14.755773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd509f0-a97c-4032-a05c-dd67dba9db2a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:14.756056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd509f0-a97c-4032-a05c-dd67dba9db2a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:14.756339 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd509f0-a97c-4032-a05c-dd67dba9db2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:14.775540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-afd509f0-a97c-4032-a05c-dd67dba9db2a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:14.776770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-afd509f0-a97c-4032-a05c-dd67dba9db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:14.838297 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1021/2038] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:14.849606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:14.850902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:14.921318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cbad9-a8ee-4b3a-b4ab-7b161a1bde86 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:14.926547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92686214-9010-4d40-abe0-ba2061bc01d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:14.927269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92686214-9010-4d40-abe0-ba2061bc01d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:14.927713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92686214-9010-4d40-abe0-ba2061bc01d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:14.928318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92686214-9010-4d40-abe0-ba2061bc01d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:14.941714 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92686214-9010-4d40-abe0-ba2061bc01d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:14.943444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92686214-9010-4d40-abe0-ba2061bc01d4 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:14.953908 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1018/2039] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:14.969222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd509f0-a97c-4032-a05c-dd67dba9db2a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:14.970828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-afd509f0-a97c-4032-a05c-dd67dba9db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:14.983427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd509f0-a97c-4032-a05c-dd67dba9db2a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:14.988418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:14.989064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:14.989359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:14.989799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] PATH_INFO: `/v3/users/507c9b3fffb845dc9e6b153860a7b281` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:14.990969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=507c9b3fffb845dc9e6b153860a7b281)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:14.992996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:15.181468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507c9b3fffb845dc9e6b153860a7b281'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:15.245513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507c9b3fffb845dc9e6b153860a7b281'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:15.246276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507c9b3fffb845dc9e6b153860a7b281'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:15.247388 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507c9b3fffb845dc9e6b153860a7b281'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:15.255266 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507c9b3fffb845dc9e6b153860a7b281'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:15.312709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1022/2040] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:14 2022] DELETE /identity/v3/users/507c9b3fffb845dc9e6b153860a7b281 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:15.320687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5cd03-d28c-4141-a742-2027e3a92b62 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:15.320687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5cd03-d28c-4141-a742-2027e3a92b62 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:15.320687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5cd03-d28c-4141-a742-2027e3a92b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:15.342340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-20f5cd03-d28c-4141-a742-2027e3a92b62 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:15.343897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-20f5cd03-d28c-4141-a742-2027e3a92b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:15.447129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1019/2041] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:15.461075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:15.461075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:15.528926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fc4dd-23ed-4564-a1f9-9c88f1ff7384 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:15.533695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473756c-6551-41c7-a833-9913ecfd8848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:15.533968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473756c-6551-41c7-a833-9913ecfd8848 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:15.534248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473756c-6551-41c7-a833-9913ecfd8848 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:15.534518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473756c-6551-41c7-a833-9913ecfd8848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:15.545029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473756c-6551-41c7-a833-9913ecfd8848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:15.546465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473756c-6551-41c7-a833-9913ecfd8848 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:15.558107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1023/2042] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:15.875489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5cd03-d28c-4141-a742-2027e3a92b62 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:15.877007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-20f5cd03-d28c-4141-a742-2027e3a92b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:15.890960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5cd03-d28c-4141-a742-2027e3a92b62 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:15.898402 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:15.899257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:15.899709 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:15.900132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] PATH_INFO: `/v3/projects/c8ce8748bf254082a4091a19084bb9a5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:15.901482 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ce8748bf254082a4091a19084bb9a5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:15.906030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:15.910743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:16.030579 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473756c-6551-41c7-a833-9913ecfd8848 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:16.032053 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1473756c-6551-41c7-a833-9913ecfd8848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:16.071741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473756c-6551-41c7-a833-9913ecfd8848 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:16.086622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ce8748bf254082a4091a19084bb9a5', 'request_id': 'req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.097952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ce8748bf254082a4091a19084bb9a5', 'request_id': 'req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.138474 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:16.139124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:16.139404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:16.139826 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] PATH_INFO: `/v3/projects/609a3226a5094f829ac18d750317bc11` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:16.141110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=609a3226a5094f829ac18d750317bc11)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:16.143203 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:16.169413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:16.171039 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ce8748bf254082a4091a19084bb9a5', 'request_id': 'req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.189136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] The token cache is being invalidate because project c8ce8748bf254082a4091a19084bb9a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:16.189550 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.190298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.192181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1020/2043] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:15 2022] DELETE /identity/v3/projects/c8ce8748bf254082a4091a19084bb9a5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:16.195801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:16.197228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:16.209898 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5b19d-beba-4ca2-88f2-eeb7d44e7992 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:16.214615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:16.215761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:16.216294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:16.216566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] PATH_INFO: `/v3/users/6b73819ead6e4efd8e9b6e0282d0c5e5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:16.217731 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b73819ead6e4efd8e9b6e0282d0c5e5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:16.220051 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:16.284504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609a3226a5094f829ac18d750317bc11', 'request_id': 'req-1a9091cb-0195-49fb-9016-edff72142bda'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.301645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609a3226a5094f829ac18d750317bc11', 'request_id': 'req-1a9091cb-0195-49fb-9016-edff72142bda'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.371440 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609a3226a5094f829ac18d750317bc11', 'request_id': 'req-1a9091cb-0195-49fb-9016-edff72142bda'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.399614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] The token cache is being invalidate because project 609a3226a5094f829ac18d750317bc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:16.400000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.401223 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.404294 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1024/2044] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:16 2022] DELETE /identity/v3/projects/609a3226a5094f829ac18d750317bc11 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:16.408516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:16.410360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:16.491024 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b73819ead6e4efd8e9b6e0282d0c5e5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.492697 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b73819ead6e4efd8e9b6e0282d0c5e5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.495379 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b73819ead6e4efd8e9b6e0282d0c5e5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.505506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b73819ead6e4efd8e9b6e0282d0c5e5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.532787 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b73819ead6e4efd8e9b6e0282d0c5e5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.532956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9091cb-0195-49fb-9016-edff72142bda admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:16.538727 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:16.539557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:16.539842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:16.540115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] PATH_INFO: `/v3/users/3307ae8e546542b284285b137a60d3fc` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:16.541353 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3307ae8e546542b284285b137a60d3fc)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:16.543329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:16.650984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1021/2045] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:16 2022] DELETE /identity/v3/users/6b73819ead6e4efd8e9b6e0282d0c5e5 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:16.785032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3307ae8e546542b284285b137a60d3fc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.851929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3307ae8e546542b284285b137a60d3fc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.852875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3307ae8e546542b284285b137a60d3fc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.854073 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3307ae8e546542b284285b137a60d3fc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.863488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3307ae8e546542b284285b137a60d3fc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:16.892272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1025/2046] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:16 2022] DELETE /identity/v3/users/3307ae8e546542b284285b137a60d3fc => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:17.159397 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:17.160802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:17.257638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:17.304473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c6d73-b917-463f-a9a2-6f3b4e40dd3d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:17.411231 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:17.411932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:17.412449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:17.413008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0 admin admin] PATH_INFO: `/v3/projects/235546e936bc445abff7c5c5718fe3ba` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:17.416171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=235546e936bc445abff7c5c5718fe3ba)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:17.417765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:17.523165 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:17.525377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:17.542567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235546e936bc445abff7c5c5718fe3ba', 'request_id': 'req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:17.553994 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62752786-35ca-4f11-9559-f1825cb5acd8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:17.555193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235546e936bc445abff7c5c5718fe3ba', 'request_id': 'req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:17.654396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235546e936bc445abff7c5c5718fe3ba', 'request_id': 'req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:17.672020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0 admin admin] The token cache is being invalidate because project 235546e936bc445abff7c5c5718fe3ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:17.672568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:17.673468 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc4f13d4-832a-41ee-82f9-5f113ba2cdc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:17.675546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1022/2047] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:17 2022] DELETE /identity/v3/projects/235546e936bc445abff7c5c5718fe3ba => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:17.680219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cab8a7-4970-4c0a-93d7-23b92e85a9c8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:17.681062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cab8a7-4970-4c0a-93d7-23b92e85a9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:17.681740 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cab8a7-4970-4c0a-93d7-23b92e85a9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:17.688040 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:17.689044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:17.689422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:17.689746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f admin admin] PATH_INFO: `/v3/projects/fa5b9ad330c54c9ea8b9000a6df47621` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:17.690925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5b9ad330c54c9ea8b9000a6df47621)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:17.693383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:17.727075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-07cab8a7-4970-4c0a-93d7-23b92e85a9c8 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:17.729126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-07cab8a7-4970-4c0a-93d7-23b92e85a9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:17.738380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1023/2048] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:17.747452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b977-f87e-49f4-b68d-e65e9f9e9d63 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:17.747452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b977-f87e-49f4-b68d-e65e9f9e9d63 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:17.747452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8b977-f87e-49f4-b68d-e65e9f9e9d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:17.774603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-baf8b977-f87e-49f4-b68d-e65e9f9e9d63 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:17.776089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-baf8b977-f87e-49f4-b68d-e65e9f9e9d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:17.785081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1024/2049] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:17.788859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8b977-f87e-49f4-b68d-e65e9f9e9d63 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:17.800539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8b977-f87e-49f4-b68d-e65e9f9e9d63 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:17.806558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afa043-e6a1-4359-adbc-f7753ba8c97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:17.807356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afa043-e6a1-4359-adbc-f7753ba8c97d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:17.807935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afa043-e6a1-4359-adbc-f7753ba8c97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:17.808351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afa043-e6a1-4359-adbc-f7753ba8c97d admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:17.810170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afa043-e6a1-4359-adbc-f7753ba8c97d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:17.811798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afa043-e6a1-4359-adbc-f7753ba8c97d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:17.814037 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afa043-e6a1-4359-adbc-f7753ba8c97d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:17.833050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1025/2050] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:31:17.837599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afa043-e6a1-4359-adbc-f7753ba8c97d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:17.849672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afa043-e6a1-4359-adbc-f7753ba8c97d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:17.868564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5b9ad330c54c9ea8b9000a6df47621', 'request_id': 'req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:17.897744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5b9ad330c54c9ea8b9000a6df47621', 'request_id': 'req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:17.951131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae551b9-7a0d-4388-a5b2-73fb2a629d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:17.951975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae551b9-7a0d-4388-a5b2-73fb2a629d45 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:17.952329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae551b9-7a0d-4388-a5b2-73fb2a629d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:17.952614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae551b9-7a0d-4388-a5b2-73fb2a629d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:17.953439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae551b9-7a0d-4388-a5b2-73fb2a629d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:17.956143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae551b9-7a0d-4388-a5b2-73fb2a629d45 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:17.997642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5b9ad330c54c9ea8b9000a6df47621', 'request_id': 'req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:18.009655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f admin admin] The token cache is being invalidate because project fa5b9ad330c54c9ea8b9000a6df47621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:18.010064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:18.010818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-17b0bf9e-89a2-4c99-8e57-063412ad2c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:18.012446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1026/2051] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:17 2022] DELETE /identity/v3/projects/fa5b9ad330c54c9ea8b9000a6df47621 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:18.017746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63177-55dc-41e4-a395-6794d54b2753 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.018300 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63177-55dc-41e4-a395-6794d54b2753 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.018492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63177-55dc-41e4-a395-6794d54b2753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.040637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a1e63177-55dc-41e4-a395-6794d54b2753 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:18.041892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a1e63177-55dc-41e4-a395-6794d54b2753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:18.051252 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1027/2052] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:18.059905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4f6fb-7966-4832-ae21-5828bdaa5852 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.060252 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4f6fb-7966-4832-ae21-5828bdaa5852 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.060583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4f6fb-7966-4832-ae21-5828bdaa5852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.078990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:18.092173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-36a4f6fb-7966-4832-ae21-5828bdaa5852 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:18.093518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-36a4f6fb-7966-4832-ae21-5828bdaa5852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:18.099852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1026/2053] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:17 2022] POST /identity/v3/projects => generated 383 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:18.103810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae551b9-7a0d-4388-a5b2-73fb2a629d45 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:18.110432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-aae551b9-7a0d-4388-a5b2-73fb2a629d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:18.224769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1028/2054] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:18.228973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4f6fb-7966-4832-ae21-5828bdaa5852 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:18.235001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae551b9-7a0d-4388-a5b2-73fb2a629d45 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:18.243315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1327d9d-f815-4222-ad0c-5b3f2e90a714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:18.244456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1327d9d-f815-4222-ad0c-5b3f2e90a714 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.247503 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1327d9d-f815-4222-ad0c-5b3f2e90a714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.248121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1327d9d-f815-4222-ad0c-5b3f2e90a714 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.249582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1327d9d-f815-4222-ad0c-5b3f2e90a714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:18.251915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1327d9d-f815-4222-ad0c-5b3f2e90a714 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:18.252901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4f6fb-7966-4832-ae21-5828bdaa5852 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:18.259177 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ba516-86ed-414e-8224-7c2e07667009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:18.262211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ba516-86ed-414e-8224-7c2e07667009 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.262211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ba516-86ed-414e-8224-7c2e07667009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.262211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ba516-86ed-414e-8224-7c2e07667009 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.262431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ba516-86ed-414e-8224-7c2e07667009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:18.262950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ba516-86ed-414e-8224-7c2e07667009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:18.265043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ba516-86ed-414e-8224-7c2e07667009 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:18.281158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1029/2055] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:31:18.294964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ba516-86ed-414e-8224-7c2e07667009 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:18.309944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ba516-86ed-414e-8224-7c2e07667009 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:18.315285 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38146d-d771-4a21-a6fb-a810ca9e6b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:18.316130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38146d-d771-4a21-a6fb-a810ca9e6b43 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.316494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38146d-d771-4a21-a6fb-a810ca9e6b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.316825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38146d-d771-4a21-a6fb-a810ca9e6b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.317564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38146d-d771-4a21-a6fb-a810ca9e6b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:18.319676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38146d-d771-4a21-a6fb-a810ca9e6b43 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:18.372661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1027/2056] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:18 2022] POST /identity/v3/users => generated 292 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:18.378504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1327d9d-f815-4222-ad0c-5b3f2e90a714 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:18.388118 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1327d9d-f815-4222-ad0c-5b3f2e90a714 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:18.395165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d43df-3db1-4a4a-8acb-2dfdf11ee3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:18.395896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d43df-3db1-4a4a-8acb-2dfdf11ee3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.396247 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d43df-3db1-4a4a-8acb-2dfdf11ee3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.396625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d43df-3db1-4a4a-8acb-2dfdf11ee3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.397428 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d43df-3db1-4a4a-8acb-2dfdf11ee3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:18.399443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d43df-3db1-4a4a-8acb-2dfdf11ee3c9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:18.417294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1028/2057] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:18.419139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d43df-3db1-4a4a-8acb-2dfdf11ee3c9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:18.432287 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:18.437317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d43df-3db1-4a4a-8acb-2dfdf11ee3c9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:18.442964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b12885-6c7b-4885-8ce2-e337947ae05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:18.443844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b12885-6c7b-4885-8ce2-e337947ae05c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.444075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b12885-6c7b-4885-8ce2-e337947ae05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.444451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b12885-6c7b-4885-8ce2-e337947ae05c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.445106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b12885-6c7b-4885-8ce2-e337947ae05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:18.446761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b12885-6c7b-4885-8ce2-e337947ae05c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:18.457942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1029/2058] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:18.467851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b12885-6c7b-4885-8ce2-e337947ae05c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:18.476150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1030/2059] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:18 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:18.477544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38146d-d771-4a21-a6fb-a810ca9e6b43 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:18.479083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b12885-6c7b-4885-8ce2-e337947ae05c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:18.538207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b0e19-6a53-4410-b388-b5826ff3f3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:18.538871 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b0e19-6a53-4410-b388-b5826ff3f3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.539142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b0e19-6a53-4410-b388-b5826ff3f3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.539429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b0e19-6a53-4410-b388-b5826ff3f3ba admin admin] PATH_INFO: `/v3/projects/0336669d39014885938eccfca817981a/users/77f3f37e420c454daca679098f6f5c84/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.547382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38146d-d771-4a21-a6fb-a810ca9e6b43 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:18.553716 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab8efd-773d-4f7c-bef9-e22995853c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:18.556990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8efd-773d-4f7c-bef9-e22995853c8c admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.556990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8efd-773d-4f7c-bef9-e22995853c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.556990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab8efd-773d-4f7c-bef9-e22995853c8c admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.557564 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b0e19-6a53-4410-b388-b5826ff3f3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0336669d39014885938eccfca817981a, user_id=77f3f37e420c454daca679098f6f5c84, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:18.557998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab8efd-773d-4f7c-bef9-e22995853c8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:18.558086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab8efd-773d-4f7c-bef9-e22995853c8c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:18.558780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b0e19-6a53-4410-b388-b5826ff3f3ba admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:18.654325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1030/2060] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:18 2022] PUT /identity/v3/projects/0336669d39014885938eccfca817981a/users/77f3f37e420c454daca679098f6f5c84/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:18.655881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8d68-2238-4a71-9308-7a1bdc77196c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.656168 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8d68-2238-4a71-9308-7a1bdc77196c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.656438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b8d68-2238-4a71-9308-7a1bdc77196c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.666065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:18.675704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1031/2061] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:18 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:18.679434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab8efd-773d-4f7c-bef9-e22995853c8c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:18.693281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab8efd-773d-4f7c-bef9-e22995853c8c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:18.698373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-659b8d68-2238-4a71-9308-7a1bdc77196c None None] MFA Rules not processed for user `77f3f37e420c454daca679098f6f5c84`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:18.700339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-659b8d68-2238-4a71-9308-7a1bdc77196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:18.760355 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74548ecb-e5a6-4fe1-a862-40e060d12a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:18.760971 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74548ecb-e5a6-4fe1-a862-40e060d12a88 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.761808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74548ecb-e5a6-4fe1-a862-40e060d12a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.762751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74548ecb-e5a6-4fe1-a862-40e060d12a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.763575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74548ecb-e5a6-4fe1-a862-40e060d12a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:18.765226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74548ecb-e5a6-4fe1-a862-40e060d12a88 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:18.777194 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1032/2062] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:18.777386 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1031/2063] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:18.781542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b8d68-2238-4a71-9308-7a1bdc77196c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:18.795027 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74548ecb-e5a6-4fe1-a862-40e060d12a88 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:18.797217 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-74548ecb-e5a6-4fe1-a862-40e060d12a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:18.805667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b8d68-2238-4a71-9308-7a1bdc77196c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:18.811706 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ff0d2-8086-4f77-811f-6de5569e08e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:18.812635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ff0d2-8086-4f77-811f-6de5569e08e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.812999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ff0d2-8086-4f77-811f-6de5569e08e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.813710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ff0d2-8086-4f77-811f-6de5569e08e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.814487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ff0d2-8086-4f77-811f-6de5569e08e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:18.816866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ff0d2-8086-4f77-811f-6de5569e08e6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:18.832650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1032/2064] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:18.834682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ff0d2-8086-4f77-811f-6de5569e08e6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:18.845599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ff0d2-8086-4f77-811f-6de5569e08e6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:18.850934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2faf6-a8e4-49f4-a895-82036dd858de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:18.851659 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2faf6-a8e4-49f4-a895-82036dd858de admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.851940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2faf6-a8e4-49f4-a895-82036dd858de admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.852216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2faf6-a8e4-49f4-a895-82036dd858de admin admin] PATH_INFO: `/v3/projects/e6761f30e9f04e269775cd9b08290e12/users/dc2f3e0eb2bf4465b3c49284e4f23706/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.867719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2faf6-a8e4-49f4-a895-82036dd858de admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6761f30e9f04e269775cd9b08290e12, user_id=dc2f3e0eb2bf4465b3c49284e4f23706, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:18.870184 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74548ecb-e5a6-4fe1-a862-40e060d12a88 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:18.870692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2faf6-a8e4-49f4-a895-82036dd858de admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:18.876402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3432d3d-7c85-4327-8820-976d9810d056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:18.877052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3432d3d-7c85-4327-8820-976d9810d056 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.877381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3432d3d-7c85-4327-8820-976d9810d056 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.877657 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3432d3d-7c85-4327-8820-976d9810d056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.887541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3432d3d-7c85-4327-8820-976d9810d056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:18.889079 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3432d3d-7c85-4327-8820-976d9810d056 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:18.899965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1033/2065] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:31:18.924084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3432d3d-7c85-4327-8820-976d9810d056 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:18.948302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3432d3d-7c85-4327-8820-976d9810d056 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:18.958653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1033/2066] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:18 2022] PUT /identity/v3/projects/e6761f30e9f04e269775cd9b08290e12/users/dc2f3e0eb2bf4465b3c49284e4f23706/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:18.970506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fc250-60ae-4d02-a871-deb0d7307a4b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.970800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fc250-60ae-4d02-a871-deb0d7307a4b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.971064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fc250-60ae-4d02-a871-deb0d7307a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.976345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:18.976982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:18.977284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:18.977564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] PATH_INFO: `/v3/users/77f3f37e420c454daca679098f6f5c84` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:18.983546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f3f37e420c454daca679098f6f5c84)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:18.989638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:19.035859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-164fc250-60ae-4d02-a871-deb0d7307a4b None None] MFA Rules not processed for user `dc2f3e0eb2bf4465b3c49284e4f23706`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:19.037102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-164fc250-60ae-4d02-a871-deb0d7307a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:19.132185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1034/2067] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:19.133131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fc250-60ae-4d02-a871-deb0d7307a4b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:19.139115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-164fc250-60ae-4d02-a871-deb0d7307a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:19.219531 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f3f37e420c454daca679098f6f5c84'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:19.235543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fc250-60ae-4d02-a871-deb0d7307a4b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:19.248384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:19.249228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:19.249566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:19.249841 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] PATH_INFO: `/v3/users/c4e5a3eafd7a4364a1e0f4d9c67ab2c4` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:19.251144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e5a3eafd7a4364a1e0f4d9c67ab2c4)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:19.253542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:19.305156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f3f37e420c454daca679098f6f5c84'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:19.306092 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f3f37e420c454daca679098f6f5c84'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:19.306797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f3f37e420c454daca679098f6f5c84'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:19.315303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f3f37e420c454daca679098f6f5c84'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:19.340873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1034/2068] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:18 2022] DELETE /identity/v3/users/77f3f37e420c454daca679098f6f5c84 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:19.343761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:19.343761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:19.419296 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f39e0-0091-45d1-905b-b6b88ee98d8c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:19.424658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe71399-06d1-4c47-b8b6-de111f33fc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:19.425416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe71399-06d1-4c47-b8b6-de111f33fc44 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:19.427985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe71399-06d1-4c47-b8b6-de111f33fc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:19.427985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe71399-06d1-4c47-b8b6-de111f33fc44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:19.427985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe71399-06d1-4c47-b8b6-de111f33fc44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:19.435479 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe71399-06d1-4c47-b8b6-de111f33fc44 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:19.456614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e5a3eafd7a4364a1e0f4d9c67ab2c4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:19.456614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e5a3eafd7a4364a1e0f4d9c67ab2c4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:19.456614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e5a3eafd7a4364a1e0f4d9c67ab2c4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:19.474590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e5a3eafd7a4364a1e0f4d9c67ab2c4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:19.491960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e5a3eafd7a4364a1e0f4d9c67ab2c4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:19.571926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1035/2069] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:19 2022] POST /identity/v3/projects => generated 377 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:19.576885 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628cd61-03f0-4652-a40f-3bfc06a7fccd None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:19.577248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628cd61-03f0-4652-a40f-3bfc06a7fccd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:19.577681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628cd61-03f0-4652-a40f-3bfc06a7fccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:19.596896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1035/2070] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:19 2022] DELETE /identity/v3/users/c4e5a3eafd7a4364a1e0f4d9c67ab2c4 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:19.598128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:19.600616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:19.630682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f628cd61-03f0-4652-a40f-3bfc06a7fccd None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:19.635714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f628cd61-03f0-4652-a40f-3bfc06a7fccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:19.699955 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:19.731164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1055b0-5163-4489-82f1-71f5e01b68f5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:19.740079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cad57-02ca-4070-9d6a-047f3d505bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:19.741641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cad57-02ca-4070-9d6a-047f3d505bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:19.741899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cad57-02ca-4070-9d6a-047f3d505bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:19.742950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cad57-02ca-4070-9d6a-047f3d505bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:19.744248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cad57-02ca-4070-9d6a-047f3d505bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:19.747700 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cad57-02ca-4070-9d6a-047f3d505bc6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:19.768773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1036/2071] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:19.772162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bb0a0-b91c-4f92-8f5c-7adda75497a5 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:19.772162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bb0a0-b91c-4f92-8f5c-7adda75497a5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:19.772162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bb0a0-b91c-4f92-8f5c-7adda75497a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:19.798397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-876bb0a0-b91c-4f92-8f5c-7adda75497a5 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:19.799660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-876bb0a0-b91c-4f92-8f5c-7adda75497a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:19.808968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1037/2072] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:19.810038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bb0a0-b91c-4f92-8f5c-7adda75497a5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:19.811831 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-876bb0a0-b91c-4f92-8f5c-7adda75497a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:19.869591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bb0a0-b91c-4f92-8f5c-7adda75497a5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:19.874816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01499f1b-77e4-47fc-8d74-3f6a1fe7239a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:19.875474 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499f1b-77e4-47fc-8d74-3f6a1fe7239a service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:19.875749 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499f1b-77e4-47fc-8d74-3f6a1fe7239a service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:19.876022 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499f1b-77e4-47fc-8d74-3f6a1fe7239a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:19.880125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1036/2073] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:19 2022] POST /identity/v3/users => generated 289 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:19.881145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cad57-02ca-4070-9d6a-047f3d505bc6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:19.885895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01499f1b-77e4-47fc-8d74-3f6a1fe7239a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:19.887420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01499f1b-77e4-47fc-8d74-3f6a1fe7239a service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:19.892845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cad57-02ca-4070-9d6a-047f3d505bc6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:19.896765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63db1a7-ea24-4991-ace7-e11af221b65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:19.899986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63db1a7-ea24-4991-ace7-e11af221b65c service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:19.899986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63db1a7-ea24-4991-ace7-e11af221b65c service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:19.899986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63db1a7-ea24-4991-ace7-e11af221b65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:19.904422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1038/2074] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:19.905691 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01499f1b-77e4-47fc-8d74-3f6a1fe7239a service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:19.908480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63db1a7-ea24-4991-ace7-e11af221b65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:19.909957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63db1a7-ea24-4991-ace7-e11af221b65c service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:19.916704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01499f1b-77e4-47fc-8d74-3f6a1fe7239a service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:19.920575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1037/2075] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:19.935051 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63db1a7-ea24-4991-ace7-e11af221b65c service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:19.937061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c63db1a7-ea24-4991-ace7-e11af221b65c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:19.938195 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007698d-f533-4450-a9fb-387dfa36ca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:19.938987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007698d-f533-4450-a9fb-387dfa36ca55 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:19.939407 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007698d-f533-4450-a9fb-387dfa36ca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:19.939841 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3007698d-f533-4450-a9fb-387dfa36ca55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:19.940994 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007698d-f533-4450-a9fb-387dfa36ca55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:19.942979 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3007698d-f533-4450-a9fb-387dfa36ca55 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:19.953346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:19.959723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63db1a7-ea24-4991-ace7-e11af221b65c service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:19.971625 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:19.972288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:19.972518 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:19.972850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] PATH_INFO: `/v3/users/c83b01ab2d254b0a9e44caee9db02ed4` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:19.973337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1039/2076] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:19.974169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83b01ab2d254b0a9e44caee9db02ed4)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:19.976071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:19.978539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007698d-f533-4450-a9fb-387dfa36ca55 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:19.990509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3007698d-f533-4450-a9fb-387dfa36ca55 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:19.995189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766068b-dbd1-474b-958d-f789da5ff633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:19.996185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766068b-dbd1-474b-958d-f789da5ff633 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:19.996185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766068b-dbd1-474b-958d-f789da5ff633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:19.996390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766068b-dbd1-474b-958d-f789da5ff633 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:19.997011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766068b-dbd1-474b-958d-f789da5ff633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:19.998651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766068b-dbd1-474b-958d-f789da5ff633 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:20.009493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1040/2077] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:20.014048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766068b-dbd1-474b-958d-f789da5ff633 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:20.024100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766068b-dbd1-474b-958d-f789da5ff633 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:20.030087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac8f45-16df-47a0-9883-cf4233ae2b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:20.030897 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac8f45-16df-47a0-9883-cf4233ae2b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:20.031197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac8f45-16df-47a0-9883-cf4233ae2b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:20.031537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac8f45-16df-47a0-9883-cf4233ae2b9e admin admin] PATH_INFO: `/v3/projects/6ee268f7a46f4e3393fbaab7fd78dd1f/users/732b199802304d3bb023de6750e912a8/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:20.046676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac8f45-16df-47a0-9883-cf4233ae2b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee268f7a46f4e3393fbaab7fd78dd1f, user_id=732b199802304d3bb023de6750e912a8, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:20.049400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac8f45-16df-47a0-9883-cf4233ae2b9e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:20.168194 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1041/2078] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:20 2022] PUT /identity/v3/projects/6ee268f7a46f4e3393fbaab7fd78dd1f/users/732b199802304d3bb023de6750e912a8/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:20.179377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda7d0b-7d64-4e14-95a6-f4092ac745ef None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:20.179667 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda7d0b-7d64-4e14-95a6-f4092ac745ef None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:20.179938 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda7d0b-7d64-4e14-95a6-f4092ac745ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:20.209391 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83b01ab2d254b0a9e44caee9db02ed4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:20.210883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83b01ab2d254b0a9e44caee9db02ed4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:20.211867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83b01ab2d254b0a9e44caee9db02ed4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:20.218344 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bdda7d0b-7d64-4e14-95a6-f4092ac745ef None None] MFA Rules not processed for user `732b199802304d3bb023de6750e912a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:20.219595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bdda7d0b-7d64-4e14-95a6-f4092ac745ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:20.222983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83b01ab2d254b0a9e44caee9db02ed4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:20.240321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83b01ab2d254b0a9e44caee9db02ed4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:20.350844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1042/2079] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:20.355930 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda7d0b-7d64-4e14-95a6-f4092ac745ef None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:20.357730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bdda7d0b-7d64-4e14-95a6-f4092ac745ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:20.403923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1038/2080] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:19 2022] DELETE /identity/v3/users/c83b01ab2d254b0a9e44caee9db02ed4 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:20.441774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda7d0b-7d64-4e14-95a6-f4092ac745ef None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:20.490534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:20.492027 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:20.528869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32493061-c9a8-4a5a-96e6-2657f93e5041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:20.529578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32493061-c9a8-4a5a-96e6-2657f93e5041 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:20.529855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32493061-c9a8-4a5a-96e6-2657f93e5041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:20.530168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32493061-c9a8-4a5a-96e6-2657f93e5041 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:20.530757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32493061-c9a8-4a5a-96e6-2657f93e5041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:20.532626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32493061-c9a8-4a5a-96e6-2657f93e5041 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:20.577215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655bfcd-45ee-41a6-9713-2006fa16fa2d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:20.585010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:20.585912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:20.586271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:20.586654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] PATH_INFO: `/v3/projects/0336669d39014885938eccfca817981a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:20.588017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0336669d39014885938eccfca817981a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:20.590957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:20.721638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1043/2081] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:20 2022] POST /identity/v3/projects => generated 377 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:31:20.722889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32493061-c9a8-4a5a-96e6-2657f93e5041 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:20.724815 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-32493061-c9a8-4a5a-96e6-2657f93e5041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:20.785676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0336669d39014885938eccfca817981a', 'request_id': 'req-c45d8c44-a266-43de-8df7-b1da1dab0559'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:20.796414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0336669d39014885938eccfca817981a', 'request_id': 'req-c45d8c44-a266-43de-8df7-b1da1dab0559'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:20.806170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32493061-c9a8-4a5a-96e6-2657f93e5041 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:20.861673 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116c543-3a3c-4ab2-83c9-d3a84fabefad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:20.862298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c543-3a3c-4ab2-83c9-d3a84fabefad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:20.862577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c543-3a3c-4ab2-83c9-d3a84fabefad admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:20.862848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c543-3a3c-4ab2-83c9-d3a84fabefad admin admin] PATH_INFO: `/v3/projects/7d25e32eaaf747478d925d7bb1eca033` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:20.863954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116c543-3a3c-4ab2-83c9-d3a84fabefad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d25e32eaaf747478d925d7bb1eca033)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:20.865886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116c543-3a3c-4ab2-83c9-d3a84fabefad admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:20.870833 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0336669d39014885938eccfca817981a', 'request_id': 'req-c45d8c44-a266-43de-8df7-b1da1dab0559'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:20.883157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] The token cache is being invalidate because project 0336669d39014885938eccfca817981a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:20.883506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:20.884255 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:20.885983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1039/2082] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:20 2022] DELETE /identity/v3/projects/0336669d39014885938eccfca817981a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:20.887016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:20.888440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:20.901249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d8c44-a266-43de-8df7-b1da1dab0559 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:20.905958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0214-fdd4-4e67-9253-4904f35b0012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:20.906564 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0214-fdd4-4e67-9253-4904f35b0012 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:20.906839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0214-fdd4-4e67-9253-4904f35b0012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:20.907110 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b0214-fdd4-4e67-9253-4904f35b0012 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:20.907730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b0214-fdd4-4e67-9253-4904f35b0012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:20.909736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b0214-fdd4-4e67-9253-4904f35b0012 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:21.014032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1040/2083] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:20 2022] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:21.015224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0214-fdd4-4e67-9253-4904f35b0012 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:21.017134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-425b0214-fdd4-4e67-9253-4904f35b0012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:21.026557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7116c543-3a3c-4ab2-83c9-d3a84fabefad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d25e32eaaf747478d925d7bb1eca033', 'request_id': 'req-7116c543-3a3c-4ab2-83c9-d3a84fabefad'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.029043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b0214-fdd4-4e67-9253-4904f35b0012 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:21.033786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7116c543-3a3c-4ab2-83c9-d3a84fabefad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d25e32eaaf747478d925d7bb1eca033', 'request_id': 'req-7116c543-3a3c-4ab2-83c9-d3a84fabefad'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.085321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1ed89-699f-4b05-bc94-813543aef611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:21.085945 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ed89-699f-4b05-bc94-813543aef611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.086223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ed89-699f-4b05-bc94-813543aef611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.086500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ed89-699f-4b05-bc94-813543aef611 admin admin] PATH_INFO: `/v3/projects/88e7ab95d68b461182bf1b7cbd08f5de` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.087595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1ed89-699f-4b05-bc94-813543aef611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e7ab95d68b461182bf1b7cbd08f5de)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:21.089545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1ed89-699f-4b05-bc94-813543aef611 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:21.124974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7116c543-3a3c-4ab2-83c9-d3a84fabefad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d25e32eaaf747478d925d7bb1eca033', 'request_id': 'req-7116c543-3a3c-4ab2-83c9-d3a84fabefad'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.135984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7116c543-3a3c-4ab2-83c9-d3a84fabefad admin admin] The token cache is being invalidate because project 7d25e32eaaf747478d925d7bb1eca033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:21.136272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7116c543-3a3c-4ab2-83c9-d3a84fabefad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.136950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7116c543-3a3c-4ab2-83c9-d3a84fabefad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.138624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1044/2084] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:20 2022] DELETE /identity/v3/projects/7d25e32eaaf747478d925d7bb1eca033 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:21.139874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b91d1-4690-4161-987a-480e3dc2950d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.140153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b91d1-4690-4161-987a-480e3dc2950d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.140422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b91d1-4690-4161-987a-480e3dc2950d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.160583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d92b91d1-4690-4161-987a-480e3dc2950d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:21.161866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d92b91d1-4690-4161-987a-480e3dc2950d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:21.170513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1045/2085] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:21.171304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b91d1-4690-4161-987a-480e3dc2950d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:21.172544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d92b91d1-4690-4161-987a-480e3dc2950d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:21.184324 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b91d1-4690-4161-987a-480e3dc2950d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:21.188986 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027d8a4-2997-4a52-9301-dffba4103110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:21.189599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027d8a4-2997-4a52-9301-dffba4103110 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.189877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027d8a4-2997-4a52-9301-dffba4103110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.190149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027d8a4-2997-4a52-9301-dffba4103110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.190784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027d8a4-2997-4a52-9301-dffba4103110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:21.192368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027d8a4-2997-4a52-9301-dffba4103110 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:21.202129 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1046/2086] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:21.202922 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027d8a4-2997-4a52-9301-dffba4103110 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:21.204525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4027d8a4-2997-4a52-9301-dffba4103110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:21.216037 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9be1ed89-699f-4b05-bc94-813543aef611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e7ab95d68b461182bf1b7cbd08f5de', 'request_id': 'req-9be1ed89-699f-4b05-bc94-813543aef611'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.217512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027d8a4-2997-4a52-9301-dffba4103110 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:21.223277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9be1ed89-699f-4b05-bc94-813543aef611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e7ab95d68b461182bf1b7cbd08f5de', 'request_id': 'req-9be1ed89-699f-4b05-bc94-813543aef611'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.272227 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8c3ca-62d8-4824-83d8-d23b73031111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:21.272795 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8c3ca-62d8-4824-83d8-d23b73031111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.273060 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8c3ca-62d8-4824-83d8-d23b73031111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.273419 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8c3ca-62d8-4824-83d8-d23b73031111 admin admin] PATH_INFO: `/v3/users/8457ced7bf9a4c63884ef225c195b790` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.274552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8c3ca-62d8-4824-83d8-d23b73031111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8457ced7bf9a4c63884ef225c195b790)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:21.276518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8c3ca-62d8-4824-83d8-d23b73031111 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:21.287733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9be1ed89-699f-4b05-bc94-813543aef611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e7ab95d68b461182bf1b7cbd08f5de', 'request_id': 'req-9be1ed89-699f-4b05-bc94-813543aef611'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.299798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9be1ed89-699f-4b05-bc94-813543aef611 admin admin] The token cache is being invalidate because project 88e7ab95d68b461182bf1b7cbd08f5de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:21.300083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9be1ed89-699f-4b05-bc94-813543aef611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.300849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9be1ed89-699f-4b05-bc94-813543aef611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.302381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1041/2087] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:21 2022] DELETE /identity/v3/projects/88e7ab95d68b461182bf1b7cbd08f5de => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:21.303594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bebba-2d50-4e97-9296-19e3d43abe29 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.303868 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bebba-2d50-4e97-9296-19e3d43abe29 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.304135 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bebba-2d50-4e97-9296-19e3d43abe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.323351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c24bebba-2d50-4e97-9296-19e3d43abe29 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:21.324529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c24bebba-2d50-4e97-9296-19e3d43abe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:21.332435 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1042/2088] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:21.333158 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bebba-2d50-4e97-9296-19e3d43abe29 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:21.334363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c24bebba-2d50-4e97-9296-19e3d43abe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:21.346203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bebba-2d50-4e97-9296-19e3d43abe29 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:21.350784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231d08b-ebe8-4b8d-abf7-0f286129b205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:21.351388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231d08b-ebe8-4b8d-abf7-0f286129b205 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.351665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231d08b-ebe8-4b8d-abf7-0f286129b205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.351934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231d08b-ebe8-4b8d-abf7-0f286129b205 admin admin] PATH_INFO: `/v3/projects/85d31f663ec14962927cd4922a16ad3f/users/4a05a1b10bf34804983fb3036af613ac/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.366216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231d08b-ebe8-4b8d-abf7-0f286129b205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d31f663ec14962927cd4922a16ad3f, user_id=4a05a1b10bf34804983fb3036af613ac, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:21.368847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231d08b-ebe8-4b8d-abf7-0f286129b205 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:21.451219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1043/2089] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:21 2022] PUT /identity/v3/projects/85d31f663ec14962927cd4922a16ad3f/users/4a05a1b10bf34804983fb3036af613ac/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:21.454720 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f713b-034a-404d-992f-9f0bf7da685f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.455151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f713b-034a-404d-992f-9f0bf7da685f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.455505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f713b-034a-404d-992f-9f0bf7da685f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.473820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:21.477040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-db0f713b-034a-404d-992f-9f0bf7da685f None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:21.478303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-db0f713b-034a-404d-992f-9f0bf7da685f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:21.489411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4cb8c3ca-62d8-4824-83d8-d23b73031111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8457ced7bf9a4c63884ef225c195b790'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.539352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1044/2090] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:21.540112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f713b-034a-404d-992f-9f0bf7da685f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:21.549010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f713b-034a-404d-992f-9f0bf7da685f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:21.552035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4cb8c3ca-62d8-4824-83d8-d23b73031111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8457ced7bf9a4c63884ef225c195b790'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.552733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4cb8c3ca-62d8-4824-83d8-d23b73031111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8457ced7bf9a4c63884ef225c195b790'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.560372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4cb8c3ca-62d8-4824-83d8-d23b73031111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8457ced7bf9a4c63884ef225c195b790'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.560458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d613-5b88-40db-84b6-b98b10c1ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:21.560458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d613-5b88-40db-84b6-b98b10c1ea64 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.560458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d613-5b88-40db-84b6-b98b10c1ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.560458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d613-5b88-40db-84b6-b98b10c1ea64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.560751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38d613-5b88-40db-84b6-b98b10c1ea64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:21.560751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38d613-5b88-40db-84b6-b98b10c1ea64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:21.561007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38d613-5b88-40db-84b6-b98b10c1ea64 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:21.564632 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4cb8c3ca-62d8-4824-83d8-d23b73031111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8457ced7bf9a4c63884ef225c195b790'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:21.577484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1045/2091] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:31:21.577484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d613-5b88-40db-84b6-b98b10c1ea64 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:21.577484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1a38d613-5b88-40db-84b6-b98b10c1ea64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:21.591062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1047/2092] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:21 2022] DELETE /identity/v3/users/8457ced7bf9a4c63884ef225c195b790 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:21.592405 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22672937-6c79-4eff-9c15-88094323bfbd None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.592689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22672937-6c79-4eff-9c15-88094323bfbd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.592958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22672937-6c79-4eff-9c15-88094323bfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.593778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d613-5b88-40db-84b6-b98b10c1ea64 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:21.610227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:21.620824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-22672937-6c79-4eff-9c15-88094323bfbd None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:21.620824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-22672937-6c79-4eff-9c15-88094323bfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:21.663550 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa514b-b93d-40dc-befb-2a232c4a4d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:21.664302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa514b-b93d-40dc-befb-2a232c4a4d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.664588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa514b-b93d-40dc-befb-2a232c4a4d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.664862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa514b-b93d-40dc-befb-2a232c4a4d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.665547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa514b-b93d-40dc-befb-2a232c4a4d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:21.667169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa514b-b93d-40dc-befb-2a232c4a4d39 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:21.679130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1046/2093] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:21.679851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa514b-b93d-40dc-befb-2a232c4a4d39 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:21.681746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b5aa514b-b93d-40dc-befb-2a232c4a4d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:21.692594 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1048/2094] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:21.695875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22672937-6c79-4eff-9c15-88094323bfbd None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:21.695955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa514b-b93d-40dc-befb-2a232c4a4d39 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:21.699043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967a8a4-8c25-48ce-b225-70a43d9caac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:21.700177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967a8a4-8c25-48ce-b225-70a43d9caac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.700515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967a8a4-8c25-48ce-b225-70a43d9caac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.700790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967a8a4-8c25-48ce-b225-70a43d9caac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.701463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967a8a4-8c25-48ce-b225-70a43d9caac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:21.703446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967a8a4-8c25-48ce-b225-70a43d9caac3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:21.705051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22672937-6c79-4eff-9c15-88094323bfbd None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:21.709771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a31e2d-04d9-49cb-aedb-ab83296dd7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:21.710455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31e2d-04d9-49cb-aedb-ab83296dd7be admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.710732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31e2d-04d9-49cb-aedb-ab83296dd7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.711005 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a31e2d-04d9-49cb-aedb-ab83296dd7be admin admin] PATH_INFO: `/v3/projects/85d31f663ec14962927cd4922a16ad3f/users/4a05a1b10bf34804983fb3036af613ac/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.712918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a31e2d-04d9-49cb-aedb-ab83296dd7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d31f663ec14962927cd4922a16ad3f, user_id=4a05a1b10bf34804983fb3036af613ac, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:21.716483 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a31e2d-04d9-49cb-aedb-ab83296dd7be admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:21.726732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1049/2095] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:21 2022] PUT /identity/v3/projects/85d31f663ec14962927cd4922a16ad3f/users/4a05a1b10bf34804983fb3036af613ac/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:21.727606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a31e2d-04d9-49cb-aedb-ab83296dd7be admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:21.790651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a31e2d-04d9-49cb-aedb-ab83296dd7be admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:21.795266 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf970e02-0a5a-44f5-96ca-20ce4e873485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:21.796016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf970e02-0a5a-44f5-96ca-20ce4e873485 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.796295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf970e02-0a5a-44f5-96ca-20ce4e873485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.796596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf970e02-0a5a-44f5-96ca-20ce4e873485 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.797244 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf970e02-0a5a-44f5-96ca-20ce4e873485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:21.797567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf970e02-0a5a-44f5-96ca-20ce4e873485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:21.799222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf970e02-0a5a-44f5-96ca-20ce4e873485 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:21.812100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1050/2096] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:31:21.812862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee3854-9e04-4daf-acac-64cd3a65a61b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.813153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee3854-9e04-4daf-acac-64cd3a65a61b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.813458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee3854-9e04-4daf-acac-64cd3a65a61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.817456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1047/2097] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:21 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:21.825456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967a8a4-8c25-48ce-b225-70a43d9caac3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:21.847919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-faee3854-9e04-4daf-acac-64cd3a65a61b None None] MFA Rules not processed for user `4a05a1b10bf34804983fb3036af613ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:21.849388 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-faee3854-9e04-4daf-acac-64cd3a65a61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:21.920811 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967a8a4-8c25-48ce-b225-70a43d9caac3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:21.926934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967470b8-71c6-4d89-ac16-06038df854a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:21.927557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967470b8-71c6-4d89-ac16-06038df854a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.927835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967470b8-71c6-4d89-ac16-06038df854a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.928105 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967470b8-71c6-4d89-ac16-06038df854a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.928744 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967470b8-71c6-4d89-ac16-06038df854a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:21.930980 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967470b8-71c6-4d89-ac16-06038df854a4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:21.942273 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1051/2098] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:21.947013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee3854-9e04-4daf-acac-64cd3a65a61b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:21.956582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee3854-9e04-4daf-acac-64cd3a65a61b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:21.961655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949a9ef-7655-4132-b582-4123e64eb419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:21.962408 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949a9ef-7655-4132-b582-4123e64eb419 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:21.962690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949a9ef-7655-4132-b582-4123e64eb419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:21.963005 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949a9ef-7655-4132-b582-4123e64eb419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:21.963599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949a9ef-7655-4132-b582-4123e64eb419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:21.965836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949a9ef-7655-4132-b582-4123e64eb419 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:22.021910 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1048/2099] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:21 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:22.022886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967470b8-71c6-4d89-ac16-06038df854a4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:22.024656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-967470b8-71c6-4d89-ac16-06038df854a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:22.075665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1052/2100] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:21 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:22.076460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949a9ef-7655-4132-b582-4123e64eb419 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:22.084266 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967470b8-71c6-4d89-ac16-06038df854a4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:22.142991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b10b1e-6ee8-42ff-be9b-59c26bcdd10c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:22.143612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b10b1e-6ee8-42ff-be9b-59c26bcdd10c service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:22.143891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b10b1e-6ee8-42ff-be9b-59c26bcdd10c service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:22.144165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b10b1e-6ee8-42ff-be9b-59c26bcdd10c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:22.146291 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f1b10b1e-6ee8-42ff-be9b-59c26bcdd10c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:22.153112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949a9ef-7655-4132-b582-4123e64eb419 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:22.158146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bebc7-5243-44bf-a37c-0478302c3e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:22.158753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bebc7-5243-44bf-a37c-0478302c3e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:22.159028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bebc7-5243-44bf-a37c-0478302c3e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:22.159297 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bebc7-5243-44bf-a37c-0478302c3e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:22.160026 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bebc7-5243-44bf-a37c-0478302c3e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:22.161681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bebc7-5243-44bf-a37c-0478302c3e36 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:22.172105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1053/2101] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:22.172879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bebc7-5243-44bf-a37c-0478302c3e36 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:22.186819 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bebc7-5243-44bf-a37c-0478302c3e36 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:22.197492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aac9f-c5b7-4bd7-b1e5-8ad6e63d3596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:22.198154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aac9f-c5b7-4bd7-b1e5-8ad6e63d3596 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:22.198433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aac9f-c5b7-4bd7-b1e5-8ad6e63d3596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:22.198703 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aac9f-c5b7-4bd7-b1e5-8ad6e63d3596 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:22.199966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67aac9f-c5b7-4bd7-b1e5-8ad6e63d3596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:22.201926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67aac9f-c5b7-4bd7-b1e5-8ad6e63d3596 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:22.207517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b10b1e-6ee8-42ff-be9b-59c26bcdd10c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:22.209054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b10b1e-6ee8-42ff-be9b-59c26bcdd10c service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:22.218576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1049/2102] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:22.219456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b10b1e-6ee8-42ff-be9b-59c26bcdd10c service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:22.220862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f1b10b1e-6ee8-42ff-be9b-59c26bcdd10c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:22.235032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b10b1e-6ee8-42ff-be9b-59c26bcdd10c service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:22.239756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:22.240395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:22.240669 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:22.240941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] PATH_INFO: `/v3/projects/5e2bdcbbc1204deda19f7c68407ae6c9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:22.242221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e2bdcbbc1204deda19f7c68407ae6c9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:22.244202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:22.305368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1054/2103] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:22 2022] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:22.305368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aac9f-c5b7-4bd7-b1e5-8ad6e63d3596 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:22.313515 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aac9f-c5b7-4bd7-b1e5-8ad6e63d3596 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:22.318208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b7b74-9cd8-4c60-9dd7-7bf1d1eb6afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:22.318792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b7b74-9cd8-4c60-9dd7-7bf1d1eb6afc admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:22.319067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b7b74-9cd8-4c60-9dd7-7bf1d1eb6afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:22.319337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b7b74-9cd8-4c60-9dd7-7bf1d1eb6afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:22.319963 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b7b74-9cd8-4c60-9dd7-7bf1d1eb6afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:22.321648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b7b74-9cd8-4c60-9dd7-7bf1d1eb6afc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:22.332393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1055/2104] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:22.333353 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b7b74-9cd8-4c60-9dd7-7bf1d1eb6afc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:22.344339 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b7b74-9cd8-4c60-9dd7-7bf1d1eb6afc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:22.358153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e2bdcbbc1204deda19f7c68407ae6c9', 'request_id': 'req-a584b78d-7ec3-4418-a2c6-75589951b20a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:22.364447 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e2bdcbbc1204deda19f7c68407ae6c9', 'request_id': 'req-a584b78d-7ec3-4418-a2c6-75589951b20a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:22.400462 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d7893-c67c-4a72-a09f-eb6fdca4bf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:22.401064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d7893-c67c-4a72-a09f-eb6fdca4bf90 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:22.401364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d7893-c67c-4a72-a09f-eb6fdca4bf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:22.401635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d7893-c67c-4a72-a09f-eb6fdca4bf90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:22.402320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d7893-c67c-4a72-a09f-eb6fdca4bf90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:22.403895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d7893-c67c-4a72-a09f-eb6fdca4bf90 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:22.413618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1056/2105] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:22.414513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d7893-c67c-4a72-a09f-eb6fdca4bf90 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:22.424434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d7893-c67c-4a72-a09f-eb6fdca4bf90 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:22.429063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09253ba-62ff-4cf9-b5e8-4d3abd17cd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:22.429727 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09253ba-62ff-4cf9-b5e8-4d3abd17cd45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:22.434904 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09253ba-62ff-4cf9-b5e8-4d3abd17cd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:22.434904 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09253ba-62ff-4cf9-b5e8-4d3abd17cd45 admin admin] PATH_INFO: `/v3/projects/cfec099af98d4d51af2fb28128abfef2/users/5fb20fa516424e9aae86c3fa5fcf9cdb/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:22.445780 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09253ba-62ff-4cf9-b5e8-4d3abd17cd45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfec099af98d4d51af2fb28128abfef2, user_id=5fb20fa516424e9aae86c3fa5fcf9cdb, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:22.448423 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09253ba-62ff-4cf9-b5e8-4d3abd17cd45 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:22.454446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:22.457504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e2bdcbbc1204deda19f7c68407ae6c9', 'request_id': 'req-a584b78d-7ec3-4418-a2c6-75589951b20a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:22.466359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] The token cache is being invalidate because project 5e2bdcbbc1204deda19f7c68407ae6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:22.466645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:22.467281 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:22.468770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1050/2106] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:22 2022] DELETE /identity/v3/projects/5e2bdcbbc1204deda19f7c68407ae6c9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:22.469614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:22.470882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:22.484000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584b78d-7ec3-4418-a2c6-75589951b20a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:22.488853 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc2dac-b6ee-4329-9111-5f8db9a83ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:22.489600 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc2dac-b6ee-4329-9111-5f8db9a83ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:22.489867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc2dac-b6ee-4329-9111-5f8db9a83ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:22.490165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc2dac-b6ee-4329-9111-5f8db9a83ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:22.490814 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc2dac-b6ee-4329-9111-5f8db9a83ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:22.492464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc2dac-b6ee-4329-9111-5f8db9a83ea6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:22.503218 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1051/2107] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:22.504012 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc2dac-b6ee-4329-9111-5f8db9a83ea6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:22.505650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2cbc2dac-b6ee-4329-9111-5f8db9a83ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:22.518141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc2dac-b6ee-4329-9111-5f8db9a83ea6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:22.522665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:22.523358 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:22.523638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:22.523911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] PATH_INFO: `/v3/users/ee13657458ec4f3481fe9465af584979` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:22.525065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee13657458ec4f3481fe9465af584979)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:22.526976 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:22.560328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1057/2108] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:22 2022] PUT /identity/v3/projects/cfec099af98d4d51af2fb28128abfef2/users/5fb20fa516424e9aae86c3fa5fcf9cdb/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:22.561351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09253ba-62ff-4cf9-b5e8-4d3abd17cd45 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:22.622700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09253ba-62ff-4cf9-b5e8-4d3abd17cd45 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:22.627580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c5fc1-5723-4f46-a7da-9b26fa0a9466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:22.628262 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5fc1-5723-4f46-a7da-9b26fa0a9466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:22.628545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5fc1-5723-4f46-a7da-9b26fa0a9466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:22.628817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5fc1-5723-4f46-a7da-9b26fa0a9466 admin admin] PATH_INFO: `/v3/projects/2907d9f97f8a4a43b24c7c1f579c9b08/users/5f29972b115f4ac6948faee7cd12be38/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:22.644304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c5fc1-5723-4f46-a7da-9b26fa0a9466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2907d9f97f8a4a43b24c7c1f579c9b08, user_id=5f29972b115f4ac6948faee7cd12be38, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:22.647076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c5fc1-5723-4f46-a7da-9b26fa0a9466 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:22.692685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:22.747841 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1058/2109] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:22 2022] PUT /identity/v3/projects/2907d9f97f8a4a43b24c7c1f579c9b08/users/5f29972b115f4ac6948faee7cd12be38/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:22.749231 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b31fb-bcb0-4fd3-b6a2-fbfef3706d1d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:22.749548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b31fb-bcb0-4fd3-b6a2-fbfef3706d1d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:22.749819 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b31fb-bcb0-4fd3-b6a2-fbfef3706d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:22.787148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bd9b31fb-bcb0-4fd3-b6a2-fbfef3706d1d None None] MFA Rules not processed for user `5fb20fa516424e9aae86c3fa5fcf9cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:22.788401 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bd9b31fb-bcb0-4fd3-b6a2-fbfef3706d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:22.789439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee13657458ec4f3481fe9465af584979'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:22.790096 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee13657458ec4f3481fe9465af584979'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:22.790910 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee13657458ec4f3481fe9465af584979'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:22.799087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee13657458ec4f3481fe9465af584979'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:22.811948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee13657458ec4f3481fe9465af584979'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:22.865323 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1059/2110] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:22.865323 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365afb1-4b9b-464f-8525-1a263967640a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:22.865323 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365afb1-4b9b-464f-8525-1a263967640a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:22.865323 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365afb1-4b9b-464f-8525-1a263967640a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:22.890539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1052/2111] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:22 2022] DELETE /identity/v3/users/ee13657458ec4f3481fe9465af584979 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:22.894842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d365afb1-4b9b-464f-8525-1a263967640a None None] MFA Rules not processed for user `5f29972b115f4ac6948faee7cd12be38`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:22.896028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d365afb1-4b9b-464f-8525-1a263967640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:22.905648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:22.907295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:22.990604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1060/2112] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:22.998906 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53900a39-b097-443c-a4c9-5b805c831bf5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:23.002886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365afb1-4b9b-464f-8525-1a263967640a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:23.003997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074baaa-9400-48f4-9d95-b42b9d7ecb5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:23.004399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d365afb1-4b9b-464f-8525-1a263967640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:23.004838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074baaa-9400-48f4-9d95-b42b9d7ecb5b service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:23.005233 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074baaa-9400-48f4-9d95-b42b9d7ecb5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:23.005842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074baaa-9400-48f4-9d95-b42b9d7ecb5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:23.094597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074baaa-9400-48f4-9d95-b42b9d7ecb5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:23.096728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074baaa-9400-48f4-9d95-b42b9d7ecb5b service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:23.100093 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365afb1-4b9b-464f-8525-1a263967640a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:23.106416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572c32d-d101-4de1-bb19-7c1c0537d5a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:23.107137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c32d-d101-4de1-bb19-7c1c0537d5a4 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:23.107496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c32d-d101-4de1-bb19-7c1c0537d5a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:23.107835 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c32d-d101-4de1-bb19-7c1c0537d5a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:23.115741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1053/2113] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:31:23.117131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572c32d-d101-4de1-bb19-7c1c0537d5a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:23.118782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572c32d-d101-4de1-bb19-7c1c0537d5a4 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:23.129142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1061/2114] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:23.145430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:23.424463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074baaa-9400-48f4-9d95-b42b9d7ecb5b service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:23.427036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c074baaa-9400-48f4-9d95-b42b9d7ecb5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:23.496370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074baaa-9400-48f4-9d95-b42b9d7ecb5b service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:23.501371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:23.502005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:23.502301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:23.502563 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a admin admin] PATH_INFO: `/v3/projects/7571e90900da4657b56f046cab6b579f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:23.503749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7571e90900da4657b56f046cab6b579f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:23.505828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:23.602942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:23.622069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7571e90900da4657b56f046cab6b579f', 'request_id': 'req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:23.628275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7571e90900da4657b56f046cab6b579f', 'request_id': 'req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:23.699603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7571e90900da4657b56f046cab6b579f', 'request_id': 'req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:23.710830 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a admin admin] The token cache is being invalidate because project 7571e90900da4657b56f046cab6b579f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:23.711121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:23.711753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-671bbc4c-a62a-40a3-bb2a-fc22fa1e069a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:23.713309 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1054/2115] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:23 2022] DELETE /identity/v3/projects/7571e90900da4657b56f046cab6b579f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:23.718485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c60b8e-a5fe-4d78-9fce-96aa511ed93a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:23.718971 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c60b8e-a5fe-4d78-9fce-96aa511ed93a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:23.719061 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c60b8e-a5fe-4d78-9fce-96aa511ed93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:23.739096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-22c60b8e-a5fe-4d78-9fce-96aa511ed93a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:23.740301 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-22c60b8e-a5fe-4d78-9fce-96aa511ed93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:23.799308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1062/2116] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:23.808225 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4adad-a843-49cb-8467-833dea115272 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:23.809180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4adad-a843-49cb-8467-833dea115272 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:23.809552 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4adad-a843-49cb-8467-833dea115272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:23.832264 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-50c4adad-a843-49cb-8467-833dea115272 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:23.833881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-50c4adad-a843-49cb-8467-833dea115272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:23.842953 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1055/2117] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:23.847110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c60b8e-a5fe-4d78-9fce-96aa511ed93a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:23.857010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c60b8e-a5fe-4d78-9fce-96aa511ed93a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:23.861593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd9ba7-fcd2-48e4-9d10-7459320496e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:23.862196 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd9ba7-fcd2-48e4-9d10-7459320496e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:23.862570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd9ba7-fcd2-48e4-9d10-7459320496e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:23.862840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd9ba7-fcd2-48e4-9d10-7459320496e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:23.863481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd9ba7-fcd2-48e4-9d10-7459320496e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:23.863781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd9ba7-fcd2-48e4-9d10-7459320496e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:23.865393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd9ba7-fcd2-48e4-9d10-7459320496e5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:23.881244 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1063/2118] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:31:23.885592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4adad-a843-49cb-8467-833dea115272 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:23.894170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:23.895476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4adad-a843-49cb-8467-833dea115272 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:23.900258 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f566a1-a943-4a3c-8dce-9bbb8a31f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:23.900863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f566a1-a943-4a3c-8dce-9bbb8a31f0cb admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:23.901136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f566a1-a943-4a3c-8dce-9bbb8a31f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:23.901453 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f566a1-a943-4a3c-8dce-9bbb8a31f0cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:23.902112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f566a1-a943-4a3c-8dce-9bbb8a31f0cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:23.904072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f566a1-a943-4a3c-8dce-9bbb8a31f0cb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:23.994268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1056/2119] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:23 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:23.999072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd9ba7-fcd2-48e4-9d10-7459320496e5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:24.017537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd9ba7-fcd2-48e4-9d10-7459320496e5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:24.084021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4986f8-960c-4da1-8eae-bd6beebf5d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:24.084359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4986f8-960c-4da1-8eae-bd6beebf5d6c admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:24.084734 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4986f8-960c-4da1-8eae-bd6beebf5d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:24.085100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4986f8-960c-4da1-8eae-bd6beebf5d6c admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:24.085851 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4986f8-960c-4da1-8eae-bd6beebf5d6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:24.088172 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4986f8-960c-4da1-8eae-bd6beebf5d6c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:24.171545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1064/2120] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:23 2022] POST /identity/v3/users => generated 284 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:24.175706 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f566a1-a943-4a3c-8dce-9bbb8a31f0cb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:24.187045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f566a1-a943-4a3c-8dce-9bbb8a31f0cb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:24.191790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb259bd-1270-4947-b296-69b0f7e17841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:24.192514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb259bd-1270-4947-b296-69b0f7e17841 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:24.192800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb259bd-1270-4947-b296-69b0f7e17841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:24.193077 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb259bd-1270-4947-b296-69b0f7e17841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:24.193780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb259bd-1270-4947-b296-69b0f7e17841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:24.195483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb259bd-1270-4947-b296-69b0f7e17841 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:24.205815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1057/2121] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:24.210332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4986f8-960c-4da1-8eae-bd6beebf5d6c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:24.221048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4986f8-960c-4da1-8eae-bd6beebf5d6c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:24.225901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f2712-ccdf-48a3-9852-00c0d9b4506a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:24.233087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f2712-ccdf-48a3-9852-00c0d9b4506a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:24.233421 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f2712-ccdf-48a3-9852-00c0d9b4506a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:24.233736 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f2712-ccdf-48a3-9852-00c0d9b4506a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:24.234343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f2712-ccdf-48a3-9852-00c0d9b4506a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:24.235950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f2712-ccdf-48a3-9852-00c0d9b4506a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:24.250309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1065/2122] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:24.251377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb259bd-1270-4947-b296-69b0f7e17841 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:24.262182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb259bd-1270-4947-b296-69b0f7e17841 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:24.269913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fc36e-9002-4472-98f6-fcbb9491ef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:24.270744 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fc36e-9002-4472-98f6-fcbb9491ef9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:24.271024 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fc36e-9002-4472-98f6-fcbb9491ef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:24.271297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fc36e-9002-4472-98f6-fcbb9491ef9b admin admin] PATH_INFO: `/v3/projects/ddb12dabcbb947dd8aa51b7c89a78938/users/aefeccc4c44e4c739b7c4933c0d61065/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:24.280866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f2712-ccdf-48a3-9852-00c0d9b4506a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:24.284070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5b2f2712-ccdf-48a3-9852-00c0d9b4506a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:24.290563 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fc36e-9002-4472-98f6-fcbb9491ef9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb12dabcbb947dd8aa51b7c89a78938, user_id=aefeccc4c44e4c739b7c4933c0d61065, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:24.293843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fc36e-9002-4472-98f6-fcbb9491ef9b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:24.342879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f2712-ccdf-48a3-9852-00c0d9b4506a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:24.346567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be6cc9-1ee8-41a5-810c-8caf5204276a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:24.347169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be6cc9-1ee8-41a5-810c-8caf5204276a service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:24.347445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be6cc9-1ee8-41a5-810c-8caf5204276a service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:24.347714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be6cc9-1ee8-41a5-810c-8caf5204276a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:24.349471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e1be6cc9-1ee8-41a5-810c-8caf5204276a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:24.394736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1058/2123] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:24 2022] PUT /identity/v3/projects/ddb12dabcbb947dd8aa51b7c89a78938/users/aefeccc4c44e4c739b7c4933c0d61065/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:24.405725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f9145-bf95-490b-8a23-4c89d7aadda9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:24.406133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f9145-bf95-490b-8a23-4c89d7aadda9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:24.406502 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f9145-bf95-490b-8a23-4c89d7aadda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:24.414246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be6cc9-1ee8-41a5-810c-8caf5204276a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:24.415724 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be6cc9-1ee8-41a5-810c-8caf5204276a service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:24.425871 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1066/2124] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:31:24.439632 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9f0f9145-bf95-490b-8a23-4c89d7aadda9 None None] MFA Rules not processed for user `aefeccc4c44e4c739b7c4933c0d61065`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:24.440829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9f0f9145-bf95-490b-8a23-4c89d7aadda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:24.507360 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1059/2125] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:24.520365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be6cc9-1ee8-41a5-810c-8caf5204276a service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:24.521924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e1be6cc9-1ee8-41a5-810c-8caf5204276a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:24.599497 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be6cc9-1ee8-41a5-810c-8caf5204276a service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:24.649648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130f546-d9cc-4ae2-8af3-180769c4a40c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f746dd2ce4404b679db81794c4d23f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:24.650250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130f546-d9cc-4ae2-8af3-180769c4a40c service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:24.650532 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130f546-d9cc-4ae2-8af3-180769c4a40c service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:24.650808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130f546-d9cc-4ae2-8af3-180769c4a40c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:24.660301 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130f546-d9cc-4ae2-8af3-180769c4a40c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:24.661781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130f546-d9cc-4ae2-8af3-180769c4a40c service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:24.670787 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1067/2126] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:25.525910 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:25.682299 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:26.399112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:26.599406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:26.634752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f9145-bf95-490b-8a23-4c89d7aadda9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:26.636201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9f0f9145-bf95-490b-8a23-4c89d7aadda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:26.713826 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f9145-bf95-490b-8a23-4c89d7aadda9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:26.718494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6208b00-95fe-4ca4-9be3-45e0827817df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:26.719194 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6208b00-95fe-4ca4-9be3-45e0827817df service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:26.719478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6208b00-95fe-4ca4-9be3-45e0827817df service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:26.719754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6208b00-95fe-4ca4-9be3-45e0827817df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:26.721567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c6208b00-95fe-4ca4-9be3-45e0827817df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:26.806777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6208b00-95fe-4ca4-9be3-45e0827817df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:26.808411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6208b00-95fe-4ca4-9be3-45e0827817df service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:26.827897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1060/2127] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:27.416309 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:27.553289 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:27.854363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:28.058245 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130f546-d9cc-4ae2-8af3-180769c4a40c service glance] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:28.060414 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b130f546-d9cc-4ae2-8af3-180769c4a40c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:28.142097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130f546-d9cc-4ae2-8af3-180769c4a40c service glance] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:28.147244 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:28.147974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:28.148322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:28.148664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] PATH_INFO: `/v3/users/5f29972b115f4ac6948faee7cd12be38` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:28.150637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f29972b115f4ac6948faee7cd12be38)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:28.152613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:28.272957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:28.365267 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f29972b115f4ac6948faee7cd12be38'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:28.421637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f29972b115f4ac6948faee7cd12be38'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:28.422308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f29972b115f4ac6948faee7cd12be38'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:28.422954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f29972b115f4ac6948faee7cd12be38'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:28.430309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f29972b115f4ac6948faee7cd12be38'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:28.447938 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1068/2128] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:28 2022] DELETE /identity/v3/users/5f29972b115f4ac6948faee7cd12be38 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:28.452464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f83de-5093-4dab-8e06-9a8a2ae3257c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:28.454736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f83de-5093-4dab-8e06-9a8a2ae3257c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:28.454736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f83de-5093-4dab-8e06-9a8a2ae3257c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:28.472048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fd4f83de-5093-4dab-8e06-9a8a2ae3257c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:28.473192 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fd4f83de-5093-4dab-8e06-9a8a2ae3257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:28.497147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:28.538556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1061/2129] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:28.549020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:28.550455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:28.612659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cdff8-1133-4ed4-bbcd-bcb7263de381 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:28.616371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512d7df-e137-4470-90f6-de48230efe16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:28.616968 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512d7df-e137-4470-90f6-de48230efe16 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:28.617242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512d7df-e137-4470-90f6-de48230efe16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:28.617535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512d7df-e137-4470-90f6-de48230efe16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:28.626616 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512d7df-e137-4470-90f6-de48230efe16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:28.637484 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512d7df-e137-4470-90f6-de48230efe16 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:28.637484 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1069/2130] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:29.070830 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f83de-5093-4dab-8e06-9a8a2ae3257c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:29.072742 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fd4f83de-5093-4dab-8e06-9a8a2ae3257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:29.089228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f83de-5093-4dab-8e06-9a8a2ae3257c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:29.099672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:29.099672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:29.099672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:29.099672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0 admin admin] PATH_INFO: `/v3/projects/2907d9f97f8a4a43b24c7c1f579c9b08` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:29.100137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2907d9f97f8a4a43b24c7c1f579c9b08)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:29.100137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:29.234685 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2907d9f97f8a4a43b24c7c1f579c9b08', 'request_id': 'req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:29.241089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2907d9f97f8a4a43b24c7c1f579c9b08', 'request_id': 'req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:29.333610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2907d9f97f8a4a43b24c7c1f579c9b08', 'request_id': 'req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:29.345425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0 admin admin] The token cache is being invalidate because project 2907d9f97f8a4a43b24c7c1f579c9b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:29.345721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:29.346380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-20a78144-4cc3-4ebe-b1d3-cab1d265d2c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:29.347867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1062/2131] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:29 2022] DELETE /identity/v3/projects/2907d9f97f8a4a43b24c7c1f579c9b08 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:29.352887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74438e32-7a83-4f15-b4e4-16d0c4aee8d7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:29.353167 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74438e32-7a83-4f15-b4e4-16d0c4aee8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:29.353471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74438e32-7a83-4f15-b4e4-16d0c4aee8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:29.375273 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-74438e32-7a83-4f15-b4e4-16d0c4aee8d7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:29.376524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-74438e32-7a83-4f15-b4e4-16d0c4aee8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:29.435416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1070/2132] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:29.442401 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:29.444414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2405-5064-4baf-a09d-a1793c589900 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:29.449111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2405-5064-4baf-a09d-a1793c589900 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:29.449111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab2405-5064-4baf-a09d-a1793c589900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:29.466891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-62ab2405-5064-4baf-a09d-a1793c589900 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:29.468216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-62ab2405-5064-4baf-a09d-a1793c589900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:29.476715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1063/2133] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:29.481067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74438e32-7a83-4f15-b4e4-16d0c4aee8d7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:29.490932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74438e32-7a83-4f15-b4e4-16d0c4aee8d7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:29.495430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a27d1-00ec-4be0-a5a0-1145ef8156f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:29.496548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a27d1-00ec-4be0-a5a0-1145ef8156f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:29.496821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a27d1-00ec-4be0-a5a0-1145ef8156f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:29.497089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a27d1-00ec-4be0-a5a0-1145ef8156f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:29.497765 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a27d1-00ec-4be0-a5a0-1145ef8156f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:29.498066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a27d1-00ec-4be0-a5a0-1145ef8156f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:29.499652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a27d1-00ec-4be0-a5a0-1145ef8156f1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:29.510955 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1071/2134] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:31:29.515727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab2405-5064-4baf-a09d-a1793c589900 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:29.524968 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab2405-5064-4baf-a09d-a1793c589900 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:29.531118 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2cd5-f7cb-42f0-aefe-b7ec7d90d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:29.531941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2cd5-f7cb-42f0-aefe-b7ec7d90d27a admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:29.532289 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2cd5-f7cb-42f0-aefe-b7ec7d90d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:29.532651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2cd5-f7cb-42f0-aefe-b7ec7d90d27a admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:29.533409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2cd5-f7cb-42f0-aefe-b7ec7d90d27a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:29.535544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2cd5-f7cb-42f0-aefe-b7ec7d90d27a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:29.634132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1064/2135] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:29 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:29.643950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a27d1-00ec-4be0-a5a0-1145ef8156f1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:29.655107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a27d1-00ec-4be0-a5a0-1145ef8156f1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:29.711653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda002c7-9531-4b04-9e98-b799d594fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:29.712272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda002c7-9531-4b04-9e98-b799d594fbaa admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:29.712553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda002c7-9531-4b04-9e98-b799d594fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:29.712817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda002c7-9531-4b04-9e98-b799d594fbaa admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:29.713616 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda002c7-9531-4b04-9e98-b799d594fbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:29.715844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda002c7-9531-4b04-9e98-b799d594fbaa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:29.744678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:29.830366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1072/2136] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:29 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:29.834440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2cd5-f7cb-42f0-aefe-b7ec7d90d27a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:29.845183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2cd5-f7cb-42f0-aefe-b7ec7d90d27a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:29.850068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7764d-8b46-4da8-ab80-9ee21da69a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:29.850786 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7764d-8b46-4da8-ab80-9ee21da69a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:29.851411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7764d-8b46-4da8-ab80-9ee21da69a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:29.851558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7764d-8b46-4da8-ab80-9ee21da69a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:29.852207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7764d-8b46-4da8-ab80-9ee21da69a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:29.853871 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7764d-8b46-4da8-ab80-9ee21da69a5b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:29.864878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1065/2137] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:29.869028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda002c7-9531-4b04-9e98-b799d594fbaa admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:29.879516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda002c7-9531-4b04-9e98-b799d594fbaa admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:29.884126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fce73d-e153-4237-99cc-5f625b85fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:29.884744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fce73d-e153-4237-99cc-5f625b85fa6d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:29.885021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fce73d-e153-4237-99cc-5f625b85fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:29.885350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fce73d-e153-4237-99cc-5f625b85fa6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:29.886125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fce73d-e153-4237-99cc-5f625b85fa6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:29.887731 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fce73d-e153-4237-99cc-5f625b85fa6d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:29.898234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1073/2138] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:29.902364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7764d-8b46-4da8-ab80-9ee21da69a5b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:29.912330 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7764d-8b46-4da8-ab80-9ee21da69a5b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:29.917005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefe6a7-f85c-44f7-8046-74cc8e66e5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:29.918166 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefe6a7-f85c-44f7-8046-74cc8e66e5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:29.918448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefe6a7-f85c-44f7-8046-74cc8e66e5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:29.918721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefe6a7-f85c-44f7-8046-74cc8e66e5e4 admin admin] PATH_INFO: `/v3/projects/090c19dba177439d9b3e2b6086a440f3/users/159f7419460247ad99a77716c83cf125/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:29.934737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefe6a7-f85c-44f7-8046-74cc8e66e5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=090c19dba177439d9b3e2b6086a440f3, user_id=159f7419460247ad99a77716c83cf125, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:29.938553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefe6a7-f85c-44f7-8046-74cc8e66e5e4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:30.032879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1066/2139] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:29 2022] PUT /identity/v3/projects/090c19dba177439d9b3e2b6086a440f3/users/159f7419460247ad99a77716c83cf125/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:30.042225 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:30.043976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b28d3d-e87d-4fcd-9c95-fee012ff65ae None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:30.044252 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b28d3d-e87d-4fcd-9c95-fee012ff65ae None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:30.044519 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b28d3d-e87d-4fcd-9c95-fee012ff65ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:30.074831 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-13b28d3d-e87d-4fcd-9c95-fee012ff65ae None None] MFA Rules not processed for user `159f7419460247ad99a77716c83cf125`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:30.076124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-13b28d3d-e87d-4fcd-9c95-fee012ff65ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:30.149891 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1074/2140] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:30.154801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefe6a7-f85c-44f7-8046-74cc8e66e5e4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:30.250738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefe6a7-f85c-44f7-8046-74cc8e66e5e4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:30.256325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da813175-02e9-4a43-920a-a2948613f6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:30.262601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da813175-02e9-4a43-920a-a2948613f6ae admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:30.262601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da813175-02e9-4a43-920a-a2948613f6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:30.262601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da813175-02e9-4a43-920a-a2948613f6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:30.262601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da813175-02e9-4a43-920a-a2948613f6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:30.263115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da813175-02e9-4a43-920a-a2948613f6ae admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:30.397543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1067/2141] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:30 2022] POST /identity/v3/projects => generated 365 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:31:30.398746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b28d3d-e87d-4fcd-9c95-fee012ff65ae None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:30.409955 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b28d3d-e87d-4fcd-9c95-fee012ff65ae None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:30.463855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a3565-588f-41c6-bfb9-aed5e6520bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:30.464451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a3565-588f-41c6-bfb9-aed5e6520bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:30.465502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a3565-588f-41c6-bfb9-aed5e6520bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:30.465773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a3565-588f-41c6-bfb9-aed5e6520bfa admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:30.466390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a3565-588f-41c6-bfb9-aed5e6520bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:30.468329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a3565-588f-41c6-bfb9-aed5e6520bfa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:30.568084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1075/2142] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:30 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:30.572192 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da813175-02e9-4a43-920a-a2948613f6ae admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:30.582907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da813175-02e9-4a43-920a-a2948613f6ae admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:30.587486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc03fe-d108-4cd4-9feb-ab71283998f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:30.588078 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc03fe-d108-4cd4-9feb-ab71283998f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:30.588356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc03fe-d108-4cd4-9feb-ab71283998f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:30.588631 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc03fe-d108-4cd4-9feb-ab71283998f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:30.590537 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc03fe-d108-4cd4-9feb-ab71283998f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:30.592169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc03fe-d108-4cd4-9feb-ab71283998f0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:30.602649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1068/2143] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:30.606915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a3565-588f-41c6-bfb9-aed5e6520bfa admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:30.617459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a3565-588f-41c6-bfb9-aed5e6520bfa admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:30.622346 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8fb4f-300e-4032-bfbd-ced7b51e1cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:30.622998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8fb4f-300e-4032-bfbd-ced7b51e1cba admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:30.623340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8fb4f-300e-4032-bfbd-ced7b51e1cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:30.623644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8fb4f-300e-4032-bfbd-ced7b51e1cba admin admin] PATH_INFO: `/v3/projects/8980ce35c3f742f3ba4cd96b1de98bd0/users/db72de5832684c14935de32d9a35f244/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:30.639069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8fb4f-300e-4032-bfbd-ced7b51e1cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8980ce35c3f742f3ba4cd96b1de98bd0, user_id=db72de5832684c14935de32d9a35f244, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:30.641899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8fb4f-300e-4032-bfbd-ced7b51e1cba admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:30.672457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:30.742984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1076/2144] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:30 2022] PUT /identity/v3/projects/8980ce35c3f742f3ba4cd96b1de98bd0/users/db72de5832684c14935de32d9a35f244/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:30.746749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc03fe-d108-4cd4-9feb-ab71283998f0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:30.757753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc03fe-d108-4cd4-9feb-ab71283998f0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:30.826235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52050b5-8c27-43d0-8424-eba633caa030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:30.826851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52050b5-8c27-43d0-8424-eba633caa030 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:30.827131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52050b5-8c27-43d0-8424-eba633caa030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:30.827405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52050b5-8c27-43d0-8424-eba633caa030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:30.828190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52050b5-8c27-43d0-8424-eba633caa030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:30.829841 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52050b5-8c27-43d0-8424-eba633caa030 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:30.843971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1069/2145] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:30.844931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8fb4f-300e-4032-bfbd-ced7b51e1cba admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:30.855432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8fb4f-300e-4032-bfbd-ced7b51e1cba admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:30.859102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:30.860523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed858e7-5f49-48c4-9e7c-5f655787ec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:30.861181 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed858e7-5f49-48c4-9e7c-5f655787ec3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:30.861496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed858e7-5f49-48c4-9e7c-5f655787ec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:30.861772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed858e7-5f49-48c4-9e7c-5f655787ec3e admin admin] PATH_INFO: `/v3/projects/8980ce35c3f742f3ba4cd96b1de98bd0/users/db72de5832684c14935de32d9a35f244/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:30.863826 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed858e7-5f49-48c4-9e7c-5f655787ec3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8980ce35c3f742f3ba4cd96b1de98bd0, user_id=db72de5832684c14935de32d9a35f244, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:30.866518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed858e7-5f49-48c4-9e7c-5f655787ec3e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:30.878177 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1077/2146] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:30 2022] PUT /identity/v3/projects/8980ce35c3f742f3ba4cd96b1de98bd0/users/db72de5832684c14935de32d9a35f244/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:30.891708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2fb81-b528-4cc8-85ee-611fd5d45115 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:30.891708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2fb81-b528-4cc8-85ee-611fd5d45115 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:30.891708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2fb81-b528-4cc8-85ee-611fd5d45115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:30.918285 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-43c2fb81-b528-4cc8-85ee-611fd5d45115 None None] MFA Rules not processed for user `db72de5832684c14935de32d9a35f244`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:30.919585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-43c2fb81-b528-4cc8-85ee-611fd5d45115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:30.997192 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1070/2147] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:31.004954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed858e7-5f49-48c4-9e7c-5f655787ec3e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:31.006753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0ed858e7-5f49-48c4-9e7c-5f655787ec3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:31.076798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed858e7-5f49-48c4-9e7c-5f655787ec3e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:31.080536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ff623-955d-4944-bbaa-7c8186828a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:31.081132 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ff623-955d-4944-bbaa-7c8186828a93 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:31.081441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ff623-955d-4944-bbaa-7c8186828a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:31.081712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ff623-955d-4944-bbaa-7c8186828a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:31.092281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ff623-955d-4944-bbaa-7c8186828a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:31.093774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ff623-955d-4944-bbaa-7c8186828a93 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:31.113708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1078/2148] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:31.383986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2fb81-b528-4cc8-85ee-611fd5d45115 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:31.385465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-43c2fb81-b528-4cc8-85ee-611fd5d45115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:31.397196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2fb81-b528-4cc8-85ee-611fd5d45115 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:31.407567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1645d-e519-4bee-ab4b-9d466c09d8a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:31.408030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1645d-e519-4bee-ab4b-9d466c09d8a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:31.408562 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1645d-e519-4bee-ab4b-9d466c09d8a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:31.408915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1645d-e519-4bee-ab4b-9d466c09d8a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:31.416445 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:31.473711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:31.477520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1645d-e519-4bee-ab4b-9d466c09d8a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:31.479826 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1645d-e519-4bee-ab4b-9d466c09d8a7 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:31.490214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1071/2149] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:31.659238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ff623-955d-4944-bbaa-7c8186828a93 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:31.660722 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c93ff623-955d-4944-bbaa-7c8186828a93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:31.726042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ff623-955d-4944-bbaa-7c8186828a93 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:31.731268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:31.731896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:31.732175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:31.732448 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] PATH_INFO: `/v3/users/dc2f3e0eb2bf4465b3c49284e4f23706` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:31.733638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2f3e0eb2bf4465b3c49284e4f23706)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:31.735643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:31.747769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:31.970281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2f3e0eb2bf4465b3c49284e4f23706'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:32.047993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:32.049482 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2f3e0eb2bf4465b3c49284e4f23706'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:32.050176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2f3e0eb2bf4465b3c49284e4f23706'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:32.050786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2f3e0eb2bf4465b3c49284e4f23706'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:32.058345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2f3e0eb2bf4465b3c49284e4f23706'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:32.076702 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1079/2150] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:31 2022] DELETE /identity/v3/users/dc2f3e0eb2bf4465b3c49284e4f23706 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:32.081440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12346b4-18b0-4645-9d5d-c003f8f79ece None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:32.081729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12346b4-18b0-4645-9d5d-c003f8f79ece None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:32.082006 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12346b4-18b0-4645-9d5d-c003f8f79ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:32.101541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e12346b4-18b0-4645-9d5d-c003f8f79ece None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:32.102796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e12346b4-18b0-4645-9d5d-c003f8f79ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:32.144399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:32.161589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1072/2151] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:32.171158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:32.172693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:32.241992 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8cf79-024f-4e87-bf54-14e5fb598ed2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:32.245612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a097c-708f-48d3-843b-f5ef093e9682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:32.246213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a097c-708f-48d3-843b-f5ef093e9682 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:32.246491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a097c-708f-48d3-843b-f5ef093e9682 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:32.246761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a097c-708f-48d3-843b-f5ef093e9682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:32.255502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a097c-708f-48d3-843b-f5ef093e9682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:32.256924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a097c-708f-48d3-843b-f5ef093e9682 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:32.267146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1080/2152] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:32.293730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:32.472876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:32.671414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:32.750347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12346b4-18b0-4645-9d5d-c003f8f79ece None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:32.752115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e12346b4-18b0-4645-9d5d-c003f8f79ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:32.776587 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12346b4-18b0-4645-9d5d-c003f8f79ece None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:32.802300 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:32.804913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:32.808180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:32.808180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] PATH_INFO: `/v3/projects/e6761f30e9f04e269775cd9b08290e12` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:32.810975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6761f30e9f04e269775cd9b08290e12)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:32.814827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:32.977776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6761f30e9f04e269775cd9b08290e12', 'request_id': 'req-9344f673-dd03-4c64-9b77-71cb47f31da9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:32.984708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6761f30e9f04e269775cd9b08290e12', 'request_id': 'req-9344f673-dd03-4c64-9b77-71cb47f31da9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:33.050265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6761f30e9f04e269775cd9b08290e12', 'request_id': 'req-9344f673-dd03-4c64-9b77-71cb47f31da9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:33.062236 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] The token cache is being invalidate because project e6761f30e9f04e269775cd9b08290e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:33.062529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:33.064203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:33.065924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1073/2153] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:32 2022] DELETE /identity/v3/projects/e6761f30e9f04e269775cd9b08290e12 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:33.069950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a097c-708f-48d3-843b-f5ef093e9682 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:33.080114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a097c-708f-48d3-843b-f5ef093e9682 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:33.136844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:33.137593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:33.137867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:33.138137 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] PATH_INFO: `/v3/users/732b199802304d3bb023de6750e912a8` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:33.142316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=732b199802304d3bb023de6750e912a8)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:33.142316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:33.362187 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:33.366651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732b199802304d3bb023de6750e912a8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:33.453283 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732b199802304d3bb023de6750e912a8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:33.453990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732b199802304d3bb023de6750e912a8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:33.454631 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732b199802304d3bb023de6750e912a8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:33.462212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732b199802304d3bb023de6750e912a8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:33.482490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1081/2154] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:33 2022] DELETE /identity/v3/users/732b199802304d3bb023de6750e912a8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:33.621727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:33.968852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:33.971287 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:33.998905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344f673-dd03-4c64-9b77-71cb47f31da9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:34.063267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:34.063918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:34.064185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:34.064484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] PATH_INFO: `/v3/projects/6ee268f7a46f4e3393fbaab7fd78dd1f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:34.065707 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee268f7a46f4e3393fbaab7fd78dd1f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:34.067683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:34.274027 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee268f7a46f4e3393fbaab7fd78dd1f', 'request_id': 'req-39b67f03-125b-4bad-88e8-4f6e121108e2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:34.280345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee268f7a46f4e3393fbaab7fd78dd1f', 'request_id': 'req-39b67f03-125b-4bad-88e8-4f6e121108e2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:34.366768 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee268f7a46f4e3393fbaab7fd78dd1f', 'request_id': 'req-39b67f03-125b-4bad-88e8-4f6e121108e2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:34.378640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] The token cache is being invalidate because project 6ee268f7a46f4e3393fbaab7fd78dd1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:34.378930 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:34.379562 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:34.381036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1074/2155] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:33 2022] DELETE /identity/v3/projects/6ee268f7a46f4e3393fbaab7fd78dd1f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:34.385245 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:34.386760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:34.399217 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60adf6-dcf7-4d67-be68-b89a153f6e5f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:34.456494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540783f-deb7-48c7-ad53-26272c0e1b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:34.457332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540783f-deb7-48c7-ad53-26272c0e1b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:34.457615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540783f-deb7-48c7-ad53-26272c0e1b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:34.457890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540783f-deb7-48c7-ad53-26272c0e1b87 admin admin] PATH_INFO: `/v3/users/4a05a1b10bf34804983fb3036af613ac` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:34.459031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540783f-deb7-48c7-ad53-26272c0e1b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a05a1b10bf34804983fb3036af613ac)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:34.460948 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540783f-deb7-48c7-ad53-26272c0e1b87 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:34.521971 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:34.663752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5540783f-deb7-48c7-ad53-26272c0e1b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a05a1b10bf34804983fb3036af613ac'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:34.775873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5540783f-deb7-48c7-ad53-26272c0e1b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a05a1b10bf34804983fb3036af613ac'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:34.776118 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:34.777162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5540783f-deb7-48c7-ad53-26272c0e1b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a05a1b10bf34804983fb3036af613ac'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:34.777875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5540783f-deb7-48c7-ad53-26272c0e1b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a05a1b10bf34804983fb3036af613ac'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:34.785516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5540783f-deb7-48c7-ad53-26272c0e1b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a05a1b10bf34804983fb3036af613ac'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:34.803478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1082/2156] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:34 2022] DELETE /identity/v3/users/4a05a1b10bf34804983fb3036af613ac => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:35.190293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:35.304284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:35.307848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:35.332036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b67f03-125b-4bad-88e8-4f6e121108e2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:35.436452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c14f4-3418-4547-8cc0-f4cc985d8d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:35.437136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c14f4-3418-4547-8cc0-f4cc985d8d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:35.437460 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c14f4-3418-4547-8cc0-f4cc985d8d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:35.437803 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c14f4-3418-4547-8cc0-f4cc985d8d38 admin admin] PATH_INFO: `/v3/projects/85d31f663ec14962927cd4922a16ad3f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:35.438967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c14f4-3418-4547-8cc0-f4cc985d8d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d31f663ec14962927cd4922a16ad3f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:35.440967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c14f4-3418-4547-8cc0-f4cc985d8d38 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:35.491781 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:35.558915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-462c14f4-3418-4547-8cc0-f4cc985d8d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d31f663ec14962927cd4922a16ad3f', 'request_id': 'req-462c14f4-3418-4547-8cc0-f4cc985d8d38'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:35.564896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-462c14f4-3418-4547-8cc0-f4cc985d8d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d31f663ec14962927cd4922a16ad3f', 'request_id': 'req-462c14f4-3418-4547-8cc0-f4cc985d8d38'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:35.638439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-462c14f4-3418-4547-8cc0-f4cc985d8d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d31f663ec14962927cd4922a16ad3f', 'request_id': 'req-462c14f4-3418-4547-8cc0-f4cc985d8d38'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:35.650738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-462c14f4-3418-4547-8cc0-f4cc985d8d38 admin admin] The token cache is being invalidate because project 85d31f663ec14962927cd4922a16ad3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:35.651069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-462c14f4-3418-4547-8cc0-f4cc985d8d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:35.651851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-462c14f4-3418-4547-8cc0-f4cc985d8d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:35.653580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1075/2157] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:35 2022] DELETE /identity/v3/projects/85d31f663ec14962927cd4922a16ad3f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:35.658636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464aaff9-abe9-4d19-9e8f-2070524a09e6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:35.659472 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464aaff9-abe9-4d19-9e8f-2070524a09e6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:35.660030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464aaff9-abe9-4d19-9e8f-2070524a09e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:35.679480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-464aaff9-abe9-4d19-9e8f-2070524a09e6 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:35.680753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-464aaff9-abe9-4d19-9e8f-2070524a09e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:35.741197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1083/2158] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:35.750917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f341fb-b002-43e6-87d7-46ce595309eb None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:35.751219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f341fb-b002-43e6-87d7-46ce595309eb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:35.751473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f341fb-b002-43e6-87d7-46ce595309eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:35.772814 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e2f341fb-b002-43e6-87d7-46ce595309eb None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:35.774084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e2f341fb-b002-43e6-87d7-46ce595309eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:35.792111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1076/2159] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:35.796988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464aaff9-abe9-4d19-9e8f-2070524a09e6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:35.806659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464aaff9-abe9-4d19-9e8f-2070524a09e6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:35.811983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863bb77-0841-4589-8db7-9a29cc67d0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:35.812518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863bb77-0841-4589-8db7-9a29cc67d0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:35.812792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863bb77-0841-4589-8db7-9a29cc67d0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:35.813064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863bb77-0841-4589-8db7-9a29cc67d0e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:35.813765 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863bb77-0841-4589-8db7-9a29cc67d0e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:35.814065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863bb77-0841-4589-8db7-9a29cc67d0e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:35.815682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863bb77-0841-4589-8db7-9a29cc67d0e4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:35.827303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1084/2160] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:31:35.831730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f341fb-b002-43e6-87d7-46ce595309eb None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:35.853669 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f341fb-b002-43e6-87d7-46ce595309eb None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:35.853669 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea197be-4de7-4acc-a5a8-51c7b0ec95b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:35.853669 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea197be-4de7-4acc-a5a8-51c7b0ec95b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:35.853669 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea197be-4de7-4acc-a5a8-51c7b0ec95b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:35.854075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea197be-4de7-4acc-a5a8-51c7b0ec95b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:35.854075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea197be-4de7-4acc-a5a8-51c7b0ec95b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:35.854075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea197be-4de7-4acc-a5a8-51c7b0ec95b5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:35.954346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1077/2161] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:35 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:35.955575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863bb77-0841-4589-8db7-9a29cc67d0e4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:35.966469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863bb77-0841-4589-8db7-9a29cc67d0e4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:36.026943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff506fa-7e2b-47ff-a57f-2015d9f64c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:36.027810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff506fa-7e2b-47ff-a57f-2015d9f64c49 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:36.028098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff506fa-7e2b-47ff-a57f-2015d9f64c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:36.028476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff506fa-7e2b-47ff-a57f-2015d9f64c49 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:36.029008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff506fa-7e2b-47ff-a57f-2015d9f64c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:36.031646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff506fa-7e2b-47ff-a57f-2015d9f64c49 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:36.144774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:36.158679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1085/2162] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:35 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:36.162998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea197be-4de7-4acc-a5a8-51c7b0ec95b5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:36.174313 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea197be-4de7-4acc-a5a8-51c7b0ec95b5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:36.193108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e631b-8d39-4e4e-8519-86dfe893d935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:36.193901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e631b-8d39-4e4e-8519-86dfe893d935 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:36.194358 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e631b-8d39-4e4e-8519-86dfe893d935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:36.194919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e631b-8d39-4e4e-8519-86dfe893d935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:36.195486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e631b-8d39-4e4e-8519-86dfe893d935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:36.197093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e631b-8d39-4e4e-8519-86dfe893d935 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:36.209004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1078/2163] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:36.212593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:36.213755 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff506fa-7e2b-47ff-a57f-2015d9f64c49 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:36.226619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff506fa-7e2b-47ff-a57f-2015d9f64c49 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:36.232494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2c603-30d8-4297-8b5c-17f3a5f7f7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:36.233346 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2c603-30d8-4297-8b5c-17f3a5f7f7fd admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:36.243365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2c603-30d8-4297-8b5c-17f3a5f7f7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:36.243365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2c603-30d8-4297-8b5c-17f3a5f7f7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:36.243365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2c603-30d8-4297-8b5c-17f3a5f7f7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:36.243365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2c603-30d8-4297-8b5c-17f3a5f7f7fd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:36.253163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1086/2164] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:36.257924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e631b-8d39-4e4e-8519-86dfe893d935 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:36.271164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e631b-8d39-4e4e-8519-86dfe893d935 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:36.275907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e3d39-d27c-444c-a285-6a997f615586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:36.277352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e3d39-d27c-444c-a285-6a997f615586 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:36.277633 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e3d39-d27c-444c-a285-6a997f615586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:36.277908 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e3d39-d27c-444c-a285-6a997f615586 admin admin] PATH_INFO: `/v3/projects/90c2cb84cd66427080adb0bf149de721/users/e8d6f3d467b747b0acc15894a1091b7c/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:36.293581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e3d39-d27c-444c-a285-6a997f615586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c2cb84cd66427080adb0bf149de721, user_id=e8d6f3d467b747b0acc15894a1091b7c, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:36.296306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e3d39-d27c-444c-a285-6a997f615586 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:36.375070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1079/2165] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:36 2022] PUT /identity/v3/projects/90c2cb84cd66427080adb0bf149de721/users/e8d6f3d467b747b0acc15894a1091b7c/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:36.398134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd3796-7be9-42d0-a6d1-5ca173724c0e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:36.398589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd3796-7be9-42d0-a6d1-5ca173724c0e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:36.398938 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd3796-7be9-42d0-a6d1-5ca173724c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:36.432669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c0bd3796-7be9-42d0-a6d1-5ca173724c0e None None] MFA Rules not processed for user `e8d6f3d467b747b0acc15894a1091b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:36.434179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c0bd3796-7be9-42d0-a6d1-5ca173724c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:36.500198 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1087/2166] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:36.512739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e3d39-d27c-444c-a285-6a997f615586 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:36.520967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8a9e3d39-d27c-444c-a285-6a997f615586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:36.570072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e3d39-d27c-444c-a285-6a997f615586 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:36.574454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c578eed-fbb7-4ec3-b48a-cf62a9f4c104 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f746dd2ce4404b679db81794c4d23f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:36.578556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c578eed-fbb7-4ec3-b48a-cf62a9f4c104 service glance] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:36.578556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c578eed-fbb7-4ec3-b48a-cf62a9f4c104 service glance] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:36.578556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c578eed-fbb7-4ec3-b48a-cf62a9f4c104 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:36.584904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c578eed-fbb7-4ec3-b48a-cf62a9f4c104 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:36.586370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c578eed-fbb7-4ec3-b48a-cf62a9f4c104 service glance] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:36.596091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1080/2167] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:36.678923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd3796-7be9-42d0-a6d1-5ca173724c0e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:36.680666 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c0bd3796-7be9-42d0-a6d1-5ca173724c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:36.718628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:36.766495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd3796-7be9-42d0-a6d1-5ca173724c0e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:36.772211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:36.772947 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:36.773466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:36.773812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] PATH_INFO: `/v3/users/5fb20fa516424e9aae86c3fa5fcf9cdb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:36.775163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb20fa516424e9aae86c3fa5fcf9cdb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:36.777186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:37.022427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb20fa516424e9aae86c3fa5fcf9cdb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:37.083219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb20fa516424e9aae86c3fa5fcf9cdb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:37.084016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb20fa516424e9aae86c3fa5fcf9cdb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:37.084677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb20fa516424e9aae86c3fa5fcf9cdb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:37.094283 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb20fa516424e9aae86c3fa5fcf9cdb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:37.112012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1088/2168] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:36 2022] DELETE /identity/v3/users/5fb20fa516424e9aae86c3fa5fcf9cdb => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:37.116458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf4d5-cd1b-4720-a63a-e290609d45aa None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:37.116743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf4d5-cd1b-4720-a63a-e290609d45aa None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:37.117020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf4d5-cd1b-4720-a63a-e290609d45aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:37.135759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b0dcf4d5-cd1b-4720-a63a-e290609d45aa None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:37.137601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b0dcf4d5-cd1b-4720-a63a-e290609d45aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:37.160852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:37.214140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1081/2169] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:37.226096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:37.227499 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:37.288490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f277fa-a098-4d16-a697-5cbed4e45b49 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:37.292669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ca1bb-619b-4881-853d-e3b50e00269c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:37.294249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ca1bb-619b-4881-853d-e3b50e00269c service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:37.294533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ca1bb-619b-4881-853d-e3b50e00269c service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:37.294801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ca1bb-619b-4881-853d-e3b50e00269c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:37.304638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ca1bb-619b-4881-853d-e3b50e00269c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:37.306340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ca1bb-619b-4881-853d-e3b50e00269c service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:37.316512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1089/2170] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:37.356781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:37.806730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf4d5-cd1b-4720-a63a-e290609d45aa None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:37.810182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b0dcf4d5-cd1b-4720-a63a-e290609d45aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:37.825553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf4d5-cd1b-4720-a63a-e290609d45aa None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:37.835557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d79db-4b73-4117-9d64-346622641673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:37.836602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d79db-4b73-4117-9d64-346622641673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:37.837414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d79db-4b73-4117-9d64-346622641673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:37.841766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d79db-4b73-4117-9d64-346622641673 admin admin] PATH_INFO: `/v3/projects/cfec099af98d4d51af2fb28128abfef2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:37.844324 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d79db-4b73-4117-9d64-346622641673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfec099af98d4d51af2fb28128abfef2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:37.853520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d79db-4b73-4117-9d64-346622641673 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:38.023582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a77d79db-4b73-4117-9d64-346622641673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfec099af98d4d51af2fb28128abfef2', 'request_id': 'req-a77d79db-4b73-4117-9d64-346622641673'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:38.032194 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a77d79db-4b73-4117-9d64-346622641673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfec099af98d4d51af2fb28128abfef2', 'request_id': 'req-a77d79db-4b73-4117-9d64-346622641673'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:38.098666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a77d79db-4b73-4117-9d64-346622641673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfec099af98d4d51af2fb28128abfef2', 'request_id': 'req-a77d79db-4b73-4117-9d64-346622641673'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:38.110701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a77d79db-4b73-4117-9d64-346622641673 admin admin] The token cache is being invalidate because project cfec099af98d4d51af2fb28128abfef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:38.110918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a77d79db-4b73-4117-9d64-346622641673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:38.111609 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a77d79db-4b73-4117-9d64-346622641673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:38.113215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1082/2171] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:37 2022] DELETE /identity/v3/projects/cfec099af98d4d51af2fb28128abfef2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:38.310861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:38.602315 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:39.749881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ca1bb-619b-4881-853d-e3b50e00269c service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:39.751492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7d9ca1bb-619b-4881-853d-e3b50e00269c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:39.765912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ca1bb-619b-4881-853d-e3b50e00269c service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:39.839911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:39.839911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:39.839911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:39.839911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] PATH_INFO: `/v3/users/159f7419460247ad99a77716c83cf125` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:39.840305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=159f7419460247ad99a77716c83cf125)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:39.840305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:39.964196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:40.056844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159f7419460247ad99a77716c83cf125'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:40.129399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159f7419460247ad99a77716c83cf125'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:40.142413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159f7419460247ad99a77716c83cf125'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:40.142413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159f7419460247ad99a77716c83cf125'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:40.142413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159f7419460247ad99a77716c83cf125'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:40.155637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:40.163717 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1090/2172] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:39 2022] DELETE /identity/v3/users/159f7419460247ad99a77716c83cf125 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:40.168432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2c93-bcb6-43aa-b15d-ab1b1e58a106 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:40.168771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2c93-bcb6-43aa-b15d-ab1b1e58a106 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:40.169586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2c93-bcb6-43aa-b15d-ab1b1e58a106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:40.188604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-038b2c93-bcb6-43aa-b15d-ab1b1e58a106 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:40.189890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-038b2c93-bcb6-43aa-b15d-ab1b1e58a106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:40.254373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1083/2173] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:40.264735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:40.266283 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:40.333733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:40.336764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab09d4-bb8e-4674-bbd6-4ad6f8dfbd1c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:40.340714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c0683-65d4-4745-9ed3-fa4a056af599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:40.341831 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c0683-65d4-4745-9ed3-fa4a056af599 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:40.342114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c0683-65d4-4745-9ed3-fa4a056af599 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:40.342377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c0683-65d4-4745-9ed3-fa4a056af599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:40.351588 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c0683-65d4-4745-9ed3-fa4a056af599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:40.353035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c0683-65d4-4745-9ed3-fa4a056af599 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:40.362480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:40.364518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1091/2174] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:40.464295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:40.515778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:40.678708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:40.786662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b2c93-bcb6-43aa-b15d-ab1b1e58a106 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:40.790969 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-038b2c93-bcb6-43aa-b15d-ab1b1e58a106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:40.808799 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b2c93-bcb6-43aa-b15d-ab1b1e58a106 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:40.816326 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:40.816977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:40.817251 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:40.817712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] PATH_INFO: `/v3/projects/090c19dba177439d9b3e2b6086a440f3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:40.818982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=090c19dba177439d9b3e2b6086a440f3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:40.821097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:40.832818 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:40.878361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:40.939882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '090c19dba177439d9b3e2b6086a440f3', 'request_id': 'req-a096308a-edce-4db9-8884-d96b797cc9e1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:40.946594 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '090c19dba177439d9b3e2b6086a440f3', 'request_id': 'req-a096308a-edce-4db9-8884-d96b797cc9e1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:40.989485 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '090c19dba177439d9b3e2b6086a440f3', 'request_id': 'req-a096308a-edce-4db9-8884-d96b797cc9e1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:41.001663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] The token cache is being invalidate because project 090c19dba177439d9b3e2b6086a440f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:41.004080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:41.004080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:41.004080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1084/2175] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:40 2022] DELETE /identity/v3/projects/090c19dba177439d9b3e2b6086a440f3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:41.008148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c0683-65d4-4745-9ed3-fa4a056af599 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:41.017980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c0683-65d4-4745-9ed3-fa4a056af599 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:41.070254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:41.075455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990ecd9-7f23-47d0-9de0-9383aa1d45d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:41.076077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990ecd9-7f23-47d0-9de0-9383aa1d45d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:41.076505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990ecd9-7f23-47d0-9de0-9383aa1d45d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:41.076713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990ecd9-7f23-47d0-9de0-9383aa1d45d0 admin admin] PATH_INFO: `/v3/users/db72de5832684c14935de32d9a35f244` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:41.077827 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990ecd9-7f23-47d0-9de0-9383aa1d45d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db72de5832684c14935de32d9a35f244)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:41.079737 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990ecd9-7f23-47d0-9de0-9383aa1d45d0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:41.096171 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:41.250316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6990ecd9-7f23-47d0-9de0-9383aa1d45d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db72de5832684c14935de32d9a35f244'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:41.258627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:41.311829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6990ecd9-7f23-47d0-9de0-9383aa1d45d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db72de5832684c14935de32d9a35f244'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:41.312529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6990ecd9-7f23-47d0-9de0-9383aa1d45d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db72de5832684c14935de32d9a35f244'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:41.313196 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6990ecd9-7f23-47d0-9de0-9383aa1d45d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db72de5832684c14935de32d9a35f244'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:41.323077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6990ecd9-7f23-47d0-9de0-9383aa1d45d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db72de5832684c14935de32d9a35f244'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:41.325011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:41.341947 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1092/2176] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:41 2022] DELETE /identity/v3/users/db72de5832684c14935de32d9a35f244 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:41.662121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:41.762758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:41.766342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:41.769311 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:41.786411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096308a-edce-4db9-8884-d96b797cc9e1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:41.849379 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43859-b198-488b-be9a-3fa3a208e898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:41.850854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43859-b198-488b-be9a-3fa3a208e898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:41.850854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43859-b198-488b-be9a-3fa3a208e898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:41.850854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43859-b198-488b-be9a-3fa3a208e898 admin admin] PATH_INFO: `/v3/projects/8980ce35c3f742f3ba4cd96b1de98bd0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:41.851791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43859-b198-488b-be9a-3fa3a208e898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8980ce35c3f742f3ba4cd96b1de98bd0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:41.853738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43859-b198-488b-be9a-3fa3a208e898 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:42.001443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fe43859-b198-488b-be9a-3fa3a208e898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8980ce35c3f742f3ba4cd96b1de98bd0', 'request_id': 'req-7fe43859-b198-488b-be9a-3fa3a208e898'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:42.007713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fe43859-b198-488b-be9a-3fa3a208e898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8980ce35c3f742f3ba4cd96b1de98bd0', 'request_id': 'req-7fe43859-b198-488b-be9a-3fa3a208e898'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:42.069740 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fe43859-b198-488b-be9a-3fa3a208e898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8980ce35c3f742f3ba4cd96b1de98bd0', 'request_id': 'req-7fe43859-b198-488b-be9a-3fa3a208e898'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:42.081553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fe43859-b198-488b-be9a-3fa3a208e898 admin admin] The token cache is being invalidate because project 8980ce35c3f742f3ba4cd96b1de98bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:42.081844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fe43859-b198-488b-be9a-3fa3a208e898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:42.082512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fe43859-b198-488b-be9a-3fa3a208e898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:42.084032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1085/2177] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:41 2022] DELETE /identity/v3/projects/8980ce35c3f742f3ba4cd96b1de98bd0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:42.089182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042934e-845b-4ae4-821a-f36ce49bea5e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:42.089962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042934e-845b-4ae4-821a-f36ce49bea5e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:42.090057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042934e-845b-4ae4-821a-f36ce49bea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:42.110376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3042934e-845b-4ae4-821a-f36ce49bea5e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:42.111865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3042934e-845b-4ae4-821a-f36ce49bea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:42.172941 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1093/2178] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:42.182219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2db9b0-b899-4854-9f50-ff9fae423f89 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:42.182553 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2db9b0-b899-4854-9f50-ff9fae423f89 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:42.182780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2db9b0-b899-4854-9f50-ff9fae423f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:42.203399 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ca2db9b0-b899-4854-9f50-ff9fae423f89 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:42.204617 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ca2db9b0-b899-4854-9f50-ff9fae423f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:42.212807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1086/2179] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:42.220721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042934e-845b-4ae4-821a-f36ce49bea5e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:42.231414 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042934e-845b-4ae4-821a-f36ce49bea5e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:42.236073 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b852b7-77a7-445e-9550-90017216c2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:42.236674 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b852b7-77a7-445e-9550-90017216c2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:42.236950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b852b7-77a7-445e-9550-90017216c2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:42.237246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b852b7-77a7-445e-9550-90017216c2c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:42.237918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b852b7-77a7-445e-9550-90017216c2c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:42.238213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b852b7-77a7-445e-9550-90017216c2c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:42.239867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b852b7-77a7-445e-9550-90017216c2c2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:42.253396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1094/2180] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:31:42.257803 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2db9b0-b899-4854-9f50-ff9fae423f89 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:42.267990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2db9b0-b899-4854-9f50-ff9fae423f89 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:42.273000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3ae17-b99b-4b5c-99f9-fd37ce3d7d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:42.273799 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3ae17-b99b-4b5c-99f9-fd37ce3d7d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:42.274079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3ae17-b99b-4b5c-99f9-fd37ce3d7d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:42.274354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3ae17-b99b-4b5c-99f9-fd37ce3d7d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:42.275009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3ae17-b99b-4b5c-99f9-fd37ce3d7d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:42.277577 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3ae17-b99b-4b5c-99f9-fd37ce3d7d93 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:42.360242 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1087/2181] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:42 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:31:42.364686 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b852b7-77a7-445e-9550-90017216c2c2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:42.375630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b852b7-77a7-445e-9550-90017216c2c2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:42.433302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74277d1f-1800-45ba-8863-162822eb0dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:42.433926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277d1f-1800-45ba-8863-162822eb0dba admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:42.434239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277d1f-1800-45ba-8863-162822eb0dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:42.434457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277d1f-1800-45ba-8863-162822eb0dba admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:42.435082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74277d1f-1800-45ba-8863-162822eb0dba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:42.437574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74277d1f-1800-45ba-8863-162822eb0dba admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:42.529773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1095/2182] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:42 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:31:42.534000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3ae17-b99b-4b5c-99f9-fd37ce3d7d93 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:42.545162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3ae17-b99b-4b5c-99f9-fd37ce3d7d93 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:42.550794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f100bbb-cb7a-4d3e-ba71-c5b5571a7cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:42.551369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f100bbb-cb7a-4d3e-ba71-c5b5571a7cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:42.551628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f100bbb-cb7a-4d3e-ba71-c5b5571a7cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:42.551891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f100bbb-cb7a-4d3e-ba71-c5b5571a7cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:42.554342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f100bbb-cb7a-4d3e-ba71-c5b5571a7cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:42.555967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f100bbb-cb7a-4d3e-ba71-c5b5571a7cb8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:42.567776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1088/2183] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:42.574214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74277d1f-1800-45ba-8863-162822eb0dba admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:42.584281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74277d1f-1800-45ba-8863-162822eb0dba admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:42.589125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df482335-82f0-4800-96c6-9ce0ec5a8a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:42.589999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df482335-82f0-4800-96c6-9ce0ec5a8a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:42.590273 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df482335-82f0-4800-96c6-9ce0ec5a8a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:42.590540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df482335-82f0-4800-96c6-9ce0ec5a8a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:42.591174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df482335-82f0-4800-96c6-9ce0ec5a8a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:42.592788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df482335-82f0-4800-96c6-9ce0ec5a8a6f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:42.603737 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1096/2184] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:42.609329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f100bbb-cb7a-4d3e-ba71-c5b5571a7cb8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:42.620244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f100bbb-cb7a-4d3e-ba71-c5b5571a7cb8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:42.625655 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2836-1a0d-46c9-bd1c-5dbeeb73621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:42.626306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2836-1a0d-46c9-bd1c-5dbeeb73621a admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:42.626582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2836-1a0d-46c9-bd1c-5dbeeb73621a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:42.626854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2836-1a0d-46c9-bd1c-5dbeeb73621a admin admin] PATH_INFO: `/v3/projects/6174a58a471e40249b07e8d7db5cd3af/users/bfe47be0da4946e4b2edbc6d3ecfc361/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:42.641560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb2836-1a0d-46c9-bd1c-5dbeeb73621a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6174a58a471e40249b07e8d7db5cd3af, user_id=bfe47be0da4946e4b2edbc6d3ecfc361, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:42.644222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb2836-1a0d-46c9-bd1c-5dbeeb73621a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:42.676080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:42.723821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1089/2185] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:42 2022] PUT /identity/v3/projects/6174a58a471e40249b07e8d7db5cd3af/users/bfe47be0da4946e4b2edbc6d3ecfc361/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:42.734752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9693e7-9a7b-4fcf-a41e-057f8b2e80cb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:42.735064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9693e7-9a7b-4fcf-a41e-057f8b2e80cb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:42.735368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9693e7-9a7b-4fcf-a41e-057f8b2e80cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:42.765681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6b9693e7-9a7b-4fcf-a41e-057f8b2e80cb None None] MFA Rules not processed for user `bfe47be0da4946e4b2edbc6d3ecfc361`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:42.766873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6b9693e7-9a7b-4fcf-a41e-057f8b2e80cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:42.821250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:42.833084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1097/2186] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:42.836989 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2836-1a0d-46c9-bd1c-5dbeeb73621a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:42.907046 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2836-1a0d-46c9-bd1c-5dbeeb73621a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:42.913633 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677d0d1-43fa-4065-9d8c-92630c91f48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:42.914317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677d0d1-43fa-4065-9d8c-92630c91f48c admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:42.914597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677d0d1-43fa-4065-9d8c-92630c91f48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:42.914866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677d0d1-43fa-4065-9d8c-92630c91f48c admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:42.915495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677d0d1-43fa-4065-9d8c-92630c91f48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:42.917473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677d0d1-43fa-4065-9d8c-92630c91f48c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:43.003340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1090/2187] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:42 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:43.004774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9693e7-9a7b-4fcf-a41e-057f8b2e80cb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:43.021457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9693e7-9a7b-4fcf-a41e-057f8b2e80cb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:43.021592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:43.075188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff5b5f-1c2a-41a0-9443-1975d15ca8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:43.075799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff5b5f-1c2a-41a0-9443-1975d15ca8bc admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:43.076080 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff5b5f-1c2a-41a0-9443-1975d15ca8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:43.076352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff5b5f-1c2a-41a0-9443-1975d15ca8bc admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:43.077037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff5b5f-1c2a-41a0-9443-1975d15ca8bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:43.079037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff5b5f-1c2a-41a0-9443-1975d15ca8bc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:43.088620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:43.163037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1098/2188] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:43 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:31:43.167268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677d0d1-43fa-4065-9d8c-92630c91f48c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:43.177937 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677d0d1-43fa-4065-9d8c-92630c91f48c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:43.182628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963a460-be2c-4504-a1ba-82d56cb21ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:43.183168 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963a460-be2c-4504-a1ba-82d56cb21ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:43.183448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963a460-be2c-4504-a1ba-82d56cb21ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:43.183722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963a460-be2c-4504-a1ba-82d56cb21ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:43.184828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963a460-be2c-4504-a1ba-82d56cb21ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:43.186023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963a460-be2c-4504-a1ba-82d56cb21ad4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:43.196854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1091/2189] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:43.200862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff5b5f-1c2a-41a0-9443-1975d15ca8bc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:43.211352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff5b5f-1c2a-41a0-9443-1975d15ca8bc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:43.216665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d60ff-90a1-4b2f-b4d6-c47d7fedc8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:43.217345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d60ff-90a1-4b2f-b4d6-c47d7fedc8bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:43.217621 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d60ff-90a1-4b2f-b4d6-c47d7fedc8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:43.217888 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d60ff-90a1-4b2f-b4d6-c47d7fedc8bd admin admin] PATH_INFO: `/v3/projects/415013fb208c4697b6921c7071121838/users/867d0ea7a6b94f52835d37e974d9d5f1/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:43.234258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d60ff-90a1-4b2f-b4d6-c47d7fedc8bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=415013fb208c4697b6921c7071121838, user_id=867d0ea7a6b94f52835d37e974d9d5f1, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:43.238229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d60ff-90a1-4b2f-b4d6-c47d7fedc8bd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:43.338357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1099/2190] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:43 2022] PUT /identity/v3/projects/415013fb208c4697b6921c7071121838/users/867d0ea7a6b94f52835d37e974d9d5f1/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:43.342732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963a460-be2c-4504-a1ba-82d56cb21ad4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:43.353412 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963a460-be2c-4504-a1ba-82d56cb21ad4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:43.410340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90b00d-a9cf-4d7d-821e-8f8bf44ec5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:43.410957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90b00d-a9cf-4d7d-821e-8f8bf44ec5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:43.411234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90b00d-a9cf-4d7d-821e-8f8bf44ec5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:43.411665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90b00d-a9cf-4d7d-821e-8f8bf44ec5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:43.412315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90b00d-a9cf-4d7d-821e-8f8bf44ec5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:43.413977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90b00d-a9cf-4d7d-821e-8f8bf44ec5b5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:43.424170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1092/2191] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:43.428430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d60ff-90a1-4b2f-b4d6-c47d7fedc8bd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:43.440341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d60ff-90a1-4b2f-b4d6-c47d7fedc8bd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:43.445191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f3120-f642-4415-a8e6-09766656c79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:43.446195 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f3120-f642-4415-a8e6-09766656c79a admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:43.446485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f3120-f642-4415-a8e6-09766656c79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:43.446824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:43.446931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f3120-f642-4415-a8e6-09766656c79a admin admin] PATH_INFO: `/v3/projects/415013fb208c4697b6921c7071121838/users/867d0ea7a6b94f52835d37e974d9d5f1/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:43.448894 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f3120-f642-4415-a8e6-09766656c79a admin admin] RBAC: Authorizing `identity:create_grant(project_id=415013fb208c4697b6921c7071121838, user_id=867d0ea7a6b94f52835d37e974d9d5f1, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:43.452212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f3120-f642-4415-a8e6-09766656c79a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:43.463624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1100/2192] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:43 2022] PUT /identity/v3/projects/415013fb208c4697b6921c7071121838/users/867d0ea7a6b94f52835d37e974d9d5f1/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:43.475382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50425d44-f9e9-499f-89cc-8d86243e79bc None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:43.475673 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50425d44-f9e9-499f-89cc-8d86243e79bc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:43.475952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50425d44-f9e9-499f-89cc-8d86243e79bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:43.503964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-50425d44-f9e9-499f-89cc-8d86243e79bc None None] MFA Rules not processed for user `867d0ea7a6b94f52835d37e974d9d5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:43.505379 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-50425d44-f9e9-499f-89cc-8d86243e79bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:43.532457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:43.575063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1093/2193] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:43.587076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f3120-f642-4415-a8e6-09766656c79a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:43.589036 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a79f3120-f642-4415-a8e6-09766656c79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:43.661235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f3120-f642-4415-a8e6-09766656c79a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:43.665364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3256b-9ffa-4d8a-a1e8-91ac8dc8288c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:43.665983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3256b-9ffa-4d8a-a1e8-91ac8dc8288c service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:43.666264 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3256b-9ffa-4d8a-a1e8-91ac8dc8288c service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:43.666535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3256b-9ffa-4d8a-a1e8-91ac8dc8288c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:43.723584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3256b-9ffa-4d8a-a1e8-91ac8dc8288c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:43.725021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3256b-9ffa-4d8a-a1e8-91ac8dc8288c service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:43.734115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1101/2194] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:43.815490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:43.972465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:44.606615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:44.726708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:45.215544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:45.511804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50425d44-f9e9-499f-89cc-8d86243e79bc None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:45.521789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50425d44-f9e9-499f-89cc-8d86243e79bc None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:45.525604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cbef1-61f8-470a-85d0-81bc926c57b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:45.526198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cbef1-61f8-470a-85d0-81bc926c57b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:45.526472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cbef1-61f8-470a-85d0-81bc926c57b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:45.526737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cbef1-61f8-470a-85d0-81bc926c57b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:45.536325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cbef1-61f8-470a-85d0-81bc926c57b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:45.537885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cbef1-61f8-470a-85d0-81bc926c57b4 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:45.548515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1094/2195] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:45.983278 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3256b-9ffa-4d8a-a1e8-91ac8dc8288c service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:45.985463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d0c3256b-9ffa-4d8a-a1e8-91ac8dc8288c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:46.056255 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3256b-9ffa-4d8a-a1e8-91ac8dc8288c service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:46.060915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:46.061571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:46.061919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:46.062146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] PATH_INFO: `/v3/users/eb052aad1aab4f5889c08c7ff80336ff` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:46.063293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb052aad1aab4f5889c08c7ff80336ff)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:46.065175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:46.227904 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:46.229646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb052aad1aab4f5889c08c7ff80336ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:46.313342 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb052aad1aab4f5889c08c7ff80336ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:46.314081 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb052aad1aab4f5889c08c7ff80336ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:46.314831 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb052aad1aab4f5889c08c7ff80336ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:46.324072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb052aad1aab4f5889c08c7ff80336ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:46.341595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1102/2196] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:45 2022] DELETE /identity/v3/users/eb052aad1aab4f5889c08c7ff80336ff => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:46.346263 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b1615-f519-434b-b0cc-505d2f730216 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:46.346746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b1615-f519-434b-b0cc-505d2f730216 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:46.346835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b1615-f519-434b-b0cc-505d2f730216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:46.366862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a12b1615-f519-434b-b0cc-505d2f730216 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:46.368051 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a12b1615-f519-434b-b0cc-505d2f730216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:46.429305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1095/2197] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:46.439676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:46.441167 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:46.499823 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aab129-e08c-43ef-aa08-30ac2220081d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:46.503436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be2512-5ce7-4ac2-9a2f-31c4fa9b3ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:46.504030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be2512-5ce7-4ac2-9a2f-31c4fa9b3ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:46.504305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be2512-5ce7-4ac2-9a2f-31c4fa9b3ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:46.504572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be2512-5ce7-4ac2-9a2f-31c4fa9b3ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:46.513533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be2512-5ce7-4ac2-9a2f-31c4fa9b3ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:46.515046 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be2512-5ce7-4ac2-9a2f-31c4fa9b3ad8 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:46.525863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1103/2198] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:47.000009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b1615-f519-434b-b0cc-505d2f730216 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:47.002885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a12b1615-f519-434b-b0cc-505d2f730216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:47.018896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b1615-f519-434b-b0cc-505d2f730216 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:47.024064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:47.024887 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:47.025313 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:47.025694 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] PATH_INFO: `/v3/projects/9c9193ada36749b7b2000eb4691a194e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:47.026935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c9193ada36749b7b2000eb4691a194e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:47.029105 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:47.058832 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:47.188070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c9193ada36749b7b2000eb4691a194e', 'request_id': 'req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:47.196725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c9193ada36749b7b2000eb4691a194e', 'request_id': 'req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:47.272729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c9193ada36749b7b2000eb4691a194e', 'request_id': 'req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:47.284259 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] The token cache is being invalidate because project 9c9193ada36749b7b2000eb4691a194e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:47.284479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:47.285172 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:47.286828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1096/2199] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:46 2022] DELETE /identity/v3/projects/9c9193ada36749b7b2000eb4691a194e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:47.290954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be2512-5ce7-4ac2-9a2f-31c4fa9b3ad8 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:47.300775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be2512-5ce7-4ac2-9a2f-31c4fa9b3ad8 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:47.366346 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6002d6-9a18-43bc-a1c8-bae8be128e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:47.366977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6002d6-9a18-43bc-a1c8-bae8be128e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:47.367255 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6002d6-9a18-43bc-a1c8-bae8be128e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:47.367556 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6002d6-9a18-43bc-a1c8-bae8be128e05 admin admin] PATH_INFO: `/v3/users/9ab19260a8944db4bc8a60b2196b83f5` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:47.368683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6002d6-9a18-43bc-a1c8-bae8be128e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab19260a8944db4bc8a60b2196b83f5)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:47.370665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6002d6-9a18-43bc-a1c8-bae8be128e05 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:47.605889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4c6002d6-9a18-43bc-a1c8-bae8be128e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab19260a8944db4bc8a60b2196b83f5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:47.689463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4c6002d6-9a18-43bc-a1c8-bae8be128e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab19260a8944db4bc8a60b2196b83f5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:47.690084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4c6002d6-9a18-43bc-a1c8-bae8be128e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab19260a8944db4bc8a60b2196b83f5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:47.690692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4c6002d6-9a18-43bc-a1c8-bae8be128e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab19260a8944db4bc8a60b2196b83f5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:47.698297 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4c6002d6-9a18-43bc-a1c8-bae8be128e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab19260a8944db4bc8a60b2196b83f5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:47.702812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:47.716350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1104/2200] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:47 2022] DELETE /identity/v3/users/9ab19260a8944db4bc8a60b2196b83f5 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:48.162492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:48.162492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:48.178640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8617f67-ea7e-4c6b-b8db-297263bfd0d2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:48.238348 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:48.239129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:48.239526 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:48.239928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58 admin admin] PATH_INFO: `/v3/projects/096fcb1f30c1426f94b7e6fbf50ba315` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:48.241356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=096fcb1f30c1426f94b7e6fbf50ba315)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:48.243317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:48.377163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096fcb1f30c1426f94b7e6fbf50ba315', 'request_id': 'req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:48.383558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096fcb1f30c1426f94b7e6fbf50ba315', 'request_id': 'req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:48.469179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096fcb1f30c1426f94b7e6fbf50ba315', 'request_id': 'req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:48.480815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58 admin admin] The token cache is being invalidate because project 096fcb1f30c1426f94b7e6fbf50ba315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:48.481108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:48.481803 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f3ef452c-4c0b-4f1e-bc72-8c1bfc554e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:48.483293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1097/2201] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:48 2022] DELETE /identity/v3/projects/096fcb1f30c1426f94b7e6fbf50ba315 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:48.488228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d0f7-271d-4d79-ac6b-cb04ea21e4ee None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:48.488715 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d0f7-271d-4d79-ac6b-cb04ea21e4ee None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:48.488825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5d0f7-271d-4d79-ac6b-cb04ea21e4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:48.517132 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f6f5d0f7-271d-4d79-ac6b-cb04ea21e4ee None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:48.518392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f6f5d0f7-271d-4d79-ac6b-cb04ea21e4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:48.590240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1105/2202] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:48.599936 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be7193-fd7a-4f38-8410-9698a7b4c940 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:48.600217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be7193-fd7a-4f38-8410-9698a7b4c940 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:48.600489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be7193-fd7a-4f38-8410-9698a7b4c940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:48.621626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c2be7193-fd7a-4f38-8410-9698a7b4c940 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:48.623001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c2be7193-fd7a-4f38-8410-9698a7b4c940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:48.631167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1098/2203] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:48.635481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5d0f7-271d-4d79-ac6b-cb04ea21e4ee None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:48.645737 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5d0f7-271d-4d79-ac6b-cb04ea21e4ee None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:48.657528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd01592-91da-46c2-bd6c-6702d25e7cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:48.657528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd01592-91da-46c2-bd6c-6702d25e7cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:48.657528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd01592-91da-46c2-bd6c-6702d25e7cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:48.657528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd01592-91da-46c2-bd6c-6702d25e7cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:48.660206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd01592-91da-46c2-bd6c-6702d25e7cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:48.660206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd01592-91da-46c2-bd6c-6702d25e7cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:48.660206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd01592-91da-46c2-bd6c-6702d25e7cd0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:48.670649 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1106/2204] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:31:48.672301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be7193-fd7a-4f38-8410-9698a7b4c940 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:48.681575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be7193-fd7a-4f38-8410-9698a7b4c940 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:48.686387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a8450-c00a-40b3-b0d6-eada59836a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:48.686977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a8450-c00a-40b3-b0d6-eada59836a3f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:48.687252 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a8450-c00a-40b3-b0d6-eada59836a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:48.687516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a8450-c00a-40b3-b0d6-eada59836a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:48.688213 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a8450-c00a-40b3-b0d6-eada59836a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:48.690140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a8450-c00a-40b3-b0d6-eada59836a3f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:48.807648 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1099/2205] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:48 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:48.811811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd01592-91da-46c2-bd6c-6702d25e7cd0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:48.822313 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd01592-91da-46c2-bd6c-6702d25e7cd0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:48.878493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14747b-58a1-49cc-bfdd-ef1bee2878c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:48.878995 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14747b-58a1-49cc-bfdd-ef1bee2878c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:48.879294 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14747b-58a1-49cc-bfdd-ef1bee2878c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:48.879534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14747b-58a1-49cc-bfdd-ef1bee2878c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:48.880153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14747b-58a1-49cc-bfdd-ef1bee2878c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:48.882084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14747b-58a1-49cc-bfdd-ef1bee2878c5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:48.984326 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1107/2206] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:48 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:48.988539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a8450-c00a-40b3-b0d6-eada59836a3f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:48.998795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a8450-c00a-40b3-b0d6-eada59836a3f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:49.004417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f2dc-4bd5-42c9-a70f-bef5c2647dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:49.005177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f2dc-4bd5-42c9-a70f-bef5c2647dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:49.005595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f2dc-4bd5-42c9-a70f-bef5c2647dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:49.006076 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f2dc-4bd5-42c9-a70f-bef5c2647dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:49.006877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797f2dc-4bd5-42c9-a70f-bef5c2647dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:49.008495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797f2dc-4bd5-42c9-a70f-bef5c2647dd0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:49.010827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:49.020207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1100/2207] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:49.030316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14747b-58a1-49cc-bfdd-ef1bee2878c5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:49.040254 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14747b-58a1-49cc-bfdd-ef1bee2878c5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:49.044821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763afccf-f0d9-4d24-ace7-ae74ca79f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:49.045436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763afccf-f0d9-4d24-ace7-ae74ca79f9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:49.045711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763afccf-f0d9-4d24-ace7-ae74ca79f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:49.045976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763afccf-f0d9-4d24-ace7-ae74ca79f9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:49.046598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763afccf-f0d9-4d24-ace7-ae74ca79f9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:49.048342 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763afccf-f0d9-4d24-ace7-ae74ca79f9a1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:49.059225 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1108/2208] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:49.063817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f2dc-4bd5-42c9-a70f-bef5c2647dd0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:49.074354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f2dc-4bd5-42c9-a70f-bef5c2647dd0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:49.080515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ccde9-27a2-4164-a3fb-e8aedddd9531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:49.084739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ccde9-27a2-4164-a3fb-e8aedddd9531 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:49.084739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ccde9-27a2-4164-a3fb-e8aedddd9531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:49.084739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ccde9-27a2-4164-a3fb-e8aedddd9531 admin admin] PATH_INFO: `/v3/projects/930e53b525124324b6b86a3a884704fb/users/1fe3fe8a735a4febb306c09ea319293d/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:49.096753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ccde9-27a2-4164-a3fb-e8aedddd9531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930e53b525124324b6b86a3a884704fb, user_id=1fe3fe8a735a4febb306c09ea319293d, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:49.099501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ccde9-27a2-4164-a3fb-e8aedddd9531 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:49.210530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1101/2209] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:49 2022] PUT /identity/v3/projects/930e53b525124324b6b86a3a884704fb/users/1fe3fe8a735a4febb306c09ea319293d/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:49.215883 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121301c5-2976-4185-b182-2af090800b9e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:49.216163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121301c5-2976-4185-b182-2af090800b9e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:49.216432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121301c5-2976-4185-b182-2af090800b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:49.235528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-121301c5-2976-4185-b182-2af090800b9e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:49.236767 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-121301c5-2976-4185-b182-2af090800b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:49.282408 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:49.296399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1109/2210] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:49.306684 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ccde9-27a2-4164-a3fb-e8aedddd9531 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:49.308365 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d72ccde9-27a2-4164-a3fb-e8aedddd9531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:49.367743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ccde9-27a2-4164-a3fb-e8aedddd9531 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:49.371567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1137ec7-a908-4140-b55f-0ff90a708efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:49.372175 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1137ec7-a908-4140-b55f-0ff90a708efd service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:49.372452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1137ec7-a908-4140-b55f-0ff90a708efd service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:49.372723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1137ec7-a908-4140-b55f-0ff90a708efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:49.382656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1137ec7-a908-4140-b55f-0ff90a708efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:49.384221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1137ec7-a908-4140-b55f-0ff90a708efd service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:49.395279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1102/2211] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:49.995636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121301c5-2976-4185-b182-2af090800b9e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:49.997148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-121301c5-2976-4185-b182-2af090800b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:50.025623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121301c5-2976-4185-b182-2af090800b9e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:50.030721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:50.031374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:50.031650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:50.031974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] PATH_INFO: `/v3/users/bfe47be0da4946e4b2edbc6d3ecfc361` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:50.033068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe47be0da4946e4b2edbc6d3ecfc361)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:50.035015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:50.271999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe47be0da4946e4b2edbc6d3ecfc361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:50.408907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe47be0da4946e4b2edbc6d3ecfc361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:50.409558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe47be0da4946e4b2edbc6d3ecfc361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:50.410175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe47be0da4946e4b2edbc6d3ecfc361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:50.418854 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe47be0da4946e4b2edbc6d3ecfc361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:50.441122 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1110/2212] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:49 2022] DELETE /identity/v3/users/bfe47be0da4946e4b2edbc6d3ecfc361 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:50.442856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecde973-2beb-41bd-932c-6053eac25e46 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:50.443326 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecde973-2beb-41bd-932c-6053eac25e46 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:50.443849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecde973-2beb-41bd-932c-6053eac25e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:50.466032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3ecde973-2beb-41bd-932c-6053eac25e46 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:50.467639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3ecde973-2beb-41bd-932c-6053eac25e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:50.532457 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1103/2213] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:50.541812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:50.543254 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:50.606242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452a04c-7b72-4f32-8164-8487e781bfe5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:50.611093 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5c52e-62f1-4668-acc7-947a5d026e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:50.612383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5c52e-62f1-4668-acc7-947a5d026e1e service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:50.612568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5c52e-62f1-4668-acc7-947a5d026e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:50.612864 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5c52e-62f1-4668-acc7-947a5d026e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:50.625221 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5c52e-62f1-4668-acc7-947a5d026e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:50.626744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5c52e-62f1-4668-acc7-947a5d026e1e service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:50.639594 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1111/2214] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:50.711790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636d471-6bde-4de8-b5e2-9b7657c54fc4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:50.712073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636d471-6bde-4de8-b5e2-9b7657c54fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:50.712343 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636d471-6bde-4de8-b5e2-9b7657c54fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:50.769920 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c636d471-6bde-4de8-b5e2-9b7657c54fc4 None None] MFA Rules not processed for user `1fe3fe8a735a4febb306c09ea319293d`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:50.772361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c636d471-6bde-4de8-b5e2-9b7657c54fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:50.860627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1104/2215] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:50.864906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5c52e-62f1-4668-acc7-947a5d026e1e service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:50.866320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1ec5c52e-62f1-4668-acc7-947a5d026e1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:50.879302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5c52e-62f1-4668-acc7-947a5d026e1e service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:50.883888 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87044fc-7162-4366-9b1d-88c9073320a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:50.884506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87044fc-7162-4366-9b1d-88c9073320a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:50.884743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87044fc-7162-4366-9b1d-88c9073320a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:50.885012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87044fc-7162-4366-9b1d-88c9073320a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:50.885669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87044fc-7162-4366-9b1d-88c9073320a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:50.887605 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87044fc-7162-4366-9b1d-88c9073320a2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:51.008512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1112/2216] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:50 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:51.009765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636d471-6bde-4de8-b5e2-9b7657c54fc4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:51.022035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636d471-6bde-4de8-b5e2-9b7657c54fc4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:51.025888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:51.079506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5ae7b-ae0c-42b7-881f-fbf145088e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:51.080183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5ae7b-ae0c-42b7-881f-fbf145088e90 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:51.080462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5ae7b-ae0c-42b7-881f-fbf145088e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:51.080731 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5ae7b-ae0c-42b7-881f-fbf145088e90 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:51.081727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5ae7b-ae0c-42b7-881f-fbf145088e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:51.084142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5ae7b-ae0c-42b7-881f-fbf145088e90 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:51.148448 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87044fc-7162-4366-9b1d-88c9073320a2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:51.150368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a87044fc-7162-4366-9b1d-88c9073320a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:51.167233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87044fc-7162-4366-9b1d-88c9073320a2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:51.172896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:51.173598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:51.173949 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:51.174115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] PATH_INFO: `/v3/projects/6174a58a471e40249b07e8d7db5cd3af` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:51.175273 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6174a58a471e40249b07e8d7db5cd3af)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:51.177196 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:51.197838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1105/2217] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:51 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:31:51.200063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5ae7b-ae0c-42b7-881f-fbf145088e90 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:51.211711 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5ae7b-ae0c-42b7-881f-fbf145088e90 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:51.217991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b62d2-587d-49ad-8a2a-07da13d69b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:51.219259 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b62d2-587d-49ad-8a2a-07da13d69b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:51.219647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b62d2-587d-49ad-8a2a-07da13d69b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:51.220045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b62d2-587d-49ad-8a2a-07da13d69b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:51.220930 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b62d2-587d-49ad-8a2a-07da13d69b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:51.223092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b62d2-587d-49ad-8a2a-07da13d69b32 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:51.234558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1106/2218] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:51.238737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b62d2-587d-49ad-8a2a-07da13d69b32 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:51.248950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b62d2-587d-49ad-8a2a-07da13d69b32 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:51.254239 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057ba20-c4b9-40bc-9f15-077b7224a827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:51.254891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057ba20-c4b9-40bc-9f15-077b7224a827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:51.255171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057ba20-c4b9-40bc-9f15-077b7224a827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:51.255444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057ba20-c4b9-40bc-9f15-077b7224a827 admin admin] PATH_INFO: `/v3/projects/c85ffb5bbda345c3997c583eca28bf19/users/235511f3535d4dccb5b6539d69344cc3/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:51.271942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057ba20-c4b9-40bc-9f15-077b7224a827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85ffb5bbda345c3997c583eca28bf19, user_id=235511f3535d4dccb5b6539d69344cc3, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:51.274718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057ba20-c4b9-40bc-9f15-077b7224a827 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:51.283676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:51.290843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6174a58a471e40249b07e8d7db5cd3af', 'request_id': 'req-50a52642-3058-4193-a9be-f204f12f426d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:51.297739 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6174a58a471e40249b07e8d7db5cd3af', 'request_id': 'req-50a52642-3058-4193-a9be-f204f12f426d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:51.347191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1107/2219] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:51 2022] PUT /identity/v3/projects/c85ffb5bbda345c3997c583eca28bf19/users/235511f3535d4dccb5b6539d69344cc3/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:51.350903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057ba20-c4b9-40bc-9f15-077b7224a827 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:51.368540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6174a58a471e40249b07e8d7db5cd3af', 'request_id': 'req-50a52642-3058-4193-a9be-f204f12f426d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:51.385598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] The token cache is being invalidate because project 6174a58a471e40249b07e8d7db5cd3af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:51.385812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:51.386918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:51.392016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1113/2220] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:51 2022] DELETE /identity/v3/projects/6174a58a471e40249b07e8d7db5cd3af => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:51.396418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:51.396418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:51.420619 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057ba20-c4b9-40bc-9f15-077b7224a827 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:51.429196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd4c65-96d2-4613-9899-c4b5cbf8e18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:51.429845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd4c65-96d2-4613-9899-c4b5cbf8e18f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:51.430132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd4c65-96d2-4613-9899-c4b5cbf8e18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:51.430375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd4c65-96d2-4613-9899-c4b5cbf8e18f admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:51.431011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd4c65-96d2-4613-9899-c4b5cbf8e18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:51.432967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd4c65-96d2-4613-9899-c4b5cbf8e18f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:51.446765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1108/2221] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:51.447807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd4c65-96d2-4613-9899-c4b5cbf8e18f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:51.449864 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-decd4c65-96d2-4613-9899-c4b5cbf8e18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:51.462529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd4c65-96d2-4613-9899-c4b5cbf8e18f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:51.467858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa0399-3ebf-4e43-aedc-534e0966f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:51.468847 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa0399-3ebf-4e43-aedc-534e0966f40a admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:51.469070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa0399-3ebf-4e43-aedc-534e0966f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:51.469367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa0399-3ebf-4e43-aedc-534e0966f40a admin admin] PATH_INFO: `/v3/projects/c85ffb5bbda345c3997c583eca28bf19/users/235511f3535d4dccb5b6539d69344cc3/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:51.471366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa0399-3ebf-4e43-aedc-534e0966f40a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85ffb5bbda345c3997c583eca28bf19, user_id=235511f3535d4dccb5b6539d69344cc3, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:51.473560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a52642-3058-4193-a9be-f204f12f426d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:51.474050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa0399-3ebf-4e43-aedc-534e0966f40a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:51.478920 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8b43c-c8fd-4d91-b838-a085465d3d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:51.479551 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b43c-c8fd-4d91-b838-a085465d3d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:51.479994 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b43c-c8fd-4d91-b838-a085465d3d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:51.480260 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b43c-c8fd-4d91-b838-a085465d3d66 admin admin] PATH_INFO: `/v3/users/867d0ea7a6b94f52835d37e974d9d5f1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:51.481893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8b43c-c8fd-4d91-b838-a085465d3d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=867d0ea7a6b94f52835d37e974d9d5f1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:51.484867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8b43c-c8fd-4d91-b838-a085465d3d66 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:51.486276 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1109/2222] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:51 2022] PUT /identity/v3/projects/c85ffb5bbda345c3997c583eca28bf19/users/235511f3535d4dccb5b6539d69344cc3/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:51.721187 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8bc8b43c-c8fd-4d91-b838-a085465d3d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867d0ea7a6b94f52835d37e974d9d5f1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:51.817625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8bc8b43c-c8fd-4d91-b838-a085465d3d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867d0ea7a6b94f52835d37e974d9d5f1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:51.818588 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8bc8b43c-c8fd-4d91-b838-a085465d3d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867d0ea7a6b94f52835d37e974d9d5f1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:51.819232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8bc8b43c-c8fd-4d91-b838-a085465d3d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867d0ea7a6b94f52835d37e974d9d5f1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:51.827135 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8bc8b43c-c8fd-4d91-b838-a085465d3d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867d0ea7a6b94f52835d37e974d9d5f1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:51.845678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1114/2223] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:51 2022] DELETE /identity/v3/users/867d0ea7a6b94f52835d37e974d9d5f1 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:52.311721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa0399-3ebf-4e43-aedc-534e0966f40a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:52.313531 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2baa0399-3ebf-4e43-aedc-534e0966f40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:52.367607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:52.386679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa0399-3ebf-4e43-aedc-534e0966f40a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:52.444426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d3972-c94a-44e7-8165-2557663adea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:52.445059 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d3972-c94a-44e7-8165-2557663adea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:52.445371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d3972-c94a-44e7-8165-2557663adea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:52.445646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d3972-c94a-44e7-8165-2557663adea8 admin admin] PATH_INFO: `/v3/projects/415013fb208c4697b6921c7071121838` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:52.446755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d3972-c94a-44e7-8165-2557663adea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=415013fb208c4697b6921c7071121838)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:52.448735 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d3972-c94a-44e7-8165-2557663adea8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:52.571856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7b6d3972-c94a-44e7-8165-2557663adea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415013fb208c4697b6921c7071121838', 'request_id': 'req-7b6d3972-c94a-44e7-8165-2557663adea8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:52.578346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7b6d3972-c94a-44e7-8165-2557663adea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415013fb208c4697b6921c7071121838', 'request_id': 'req-7b6d3972-c94a-44e7-8165-2557663adea8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:52.823488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7b6d3972-c94a-44e7-8165-2557663adea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415013fb208c4697b6921c7071121838', 'request_id': 'req-7b6d3972-c94a-44e7-8165-2557663adea8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:52.836043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7b6d3972-c94a-44e7-8165-2557663adea8 admin admin] The token cache is being invalidate because project 415013fb208c4697b6921c7071121838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:31:52.836355 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7b6d3972-c94a-44e7-8165-2557663adea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:52.841603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7b6d3972-c94a-44e7-8165-2557663adea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:52.841603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1110/2224] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:52 2022] DELETE /identity/v3/projects/415013fb208c4697b6921c7071121838 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:52.844880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fdb03-3517-460a-8177-4da520222ba5 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:52.845371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fdb03-3517-460a-8177-4da520222ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:52.845495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fdb03-3517-460a-8177-4da520222ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:52.867221 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3a6fdb03-3517-460a-8177-4da520222ba5 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:52.868425 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3a6fdb03-3517-460a-8177-4da520222ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:52.913081 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:52.930760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1115/2225] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:52.938558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71137c0a-115c-47bf-a970-5bc44cd1721f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:52.938842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71137c0a-115c-47bf-a970-5bc44cd1721f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:52.939113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71137c0a-115c-47bf-a970-5bc44cd1721f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:52.959654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-71137c0a-115c-47bf-a970-5bc44cd1721f None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:52.960865 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-71137c0a-115c-47bf-a970-5bc44cd1721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:52.969676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1111/2226] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:52.974054 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fdb03-3517-460a-8177-4da520222ba5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:52.984973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fdb03-3517-460a-8177-4da520222ba5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:52.989727 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99248c85-b4b3-48b0-b805-613b59c809bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:52.992548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99248c85-b4b3-48b0-b805-613b59c809bc admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:52.992548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99248c85-b4b3-48b0-b805-613b59c809bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:52.992548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99248c85-b4b3-48b0-b805-613b59c809bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:52.992548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99248c85-b4b3-48b0-b805-613b59c809bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:31:52.992548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99248c85-b4b3-48b0-b805-613b59c809bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:52.993433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99248c85-b4b3-48b0-b805-613b59c809bc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:53.004813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1116/2227] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:31:53.009361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71137c0a-115c-47bf-a970-5bc44cd1721f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:53.019325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71137c0a-115c-47bf-a970-5bc44cd1721f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:53.024335 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845917b-a8fd-4b5d-8c80-9b3ec225770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:53.024927 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845917b-a8fd-4b5d-8c80-9b3ec225770a admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:53.025201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845917b-a8fd-4b5d-8c80-9b3ec225770a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:53.025499 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845917b-a8fd-4b5d-8c80-9b3ec225770a admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:53.026126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845917b-a8fd-4b5d-8c80-9b3ec225770a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:53.028014 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845917b-a8fd-4b5d-8c80-9b3ec225770a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:53.138255 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7429bcd-ba4e-4416-bb41-5548c756fb19 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:53.139009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7429bcd-ba4e-4416-bb41-5548c756fb19 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:53.139723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7429bcd-ba4e-4416-bb41-5548c756fb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:53.182879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f7429bcd-ba4e-4416-bb41-5548c756fb19 None None] MFA Rules not processed for user `235511f3535d4dccb5b6539d69344cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:53.184396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f7429bcd-ba4e-4416-bb41-5548c756fb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:53.184886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1112/2228] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:53 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:53.189171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845917b-a8fd-4b5d-8c80-9b3ec225770a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:53.283744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1117/2229] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:53.295216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:53.297047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4f1b5-3ccc-4986-b294-21fe6e020da8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:53.297437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4f1b5-3ccc-4986-b294-21fe6e020da8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:53.297721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4f1b5-3ccc-4986-b294-21fe6e020da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:53.309737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845917b-a8fd-4b5d-8c80-9b3ec225770a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:53.317540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ecb9f-20ee-4fec-9c21-a0ccf9cf4873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:53.318208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ecb9f-20ee-4fec-9c21-a0ccf9cf4873 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:53.318646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ecb9f-20ee-4fec-9c21-a0ccf9cf4873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:53.318837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ecb9f-20ee-4fec-9c21-a0ccf9cf4873 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:53.322253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ecb9f-20ee-4fec-9c21-a0ccf9cf4873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:53.324161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ecb9f-20ee-4fec-9c21-a0ccf9cf4873 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:53.333149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-67f4f1b5-3ccc-4986-b294-21fe6e020da8 None None] MFA Rules not processed for user `1fe3fe8a735a4febb306c09ea319293d`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:53.334358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-67f4f1b5-3ccc-4986-b294-21fe6e020da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:53.391678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1118/2230] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:53.402960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4f1b5-3ccc-4986-b294-21fe6e020da8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:53.404438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-67f4f1b5-3ccc-4986-b294-21fe6e020da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:53.464575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1113/2231] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:53 2022] POST /identity/v3/users => generated 283 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:53.466017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ecb9f-20ee-4fec-9c21-a0ccf9cf4873 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:53.477599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ecb9f-20ee-4fec-9c21-a0ccf9cf4873 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:53.482829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfcdd4-4f59-4c47-bd55-467500e68b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:53.483623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfcdd4-4f59-4c47-bd55-467500e68b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:53.484064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfcdd4-4f59-4c47-bd55-467500e68b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:53.484333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfcdd4-4f59-4c47-bd55-467500e68b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:53.485124 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfcdd4-4f59-4c47-bd55-467500e68b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:53.487257 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4f1b5-3ccc-4986-b294-21fe6e020da8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:53.488328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfcdd4-4f59-4c47-bd55-467500e68b1b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:53.493217 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce0b83-ce25-44a1-81f9-90875e8e7e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:53.493860 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce0b83-ce25-44a1-81f9-90875e8e7e82 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:53.494143 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce0b83-ce25-44a1-81f9-90875e8e7e82 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:53.494481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce0b83-ce25-44a1-81f9-90875e8e7e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:53.496300 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f6ce0b83-ce25-44a1-81f9-90875e8e7e82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:53.500161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1114/2232] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:53.508794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfcdd4-4f59-4c47-bd55-467500e68b1b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:53.517747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce0b83-ce25-44a1-81f9-90875e8e7e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:53.517747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce0b83-ce25-44a1-81f9-90875e8e7e82 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:53.520346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfcdd4-4f59-4c47-bd55-467500e68b1b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:53.523064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1119/2233] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:31:53.525301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08e3b4-1271-41c9-9686-e62b913510ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:53.525908 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08e3b4-1271-41c9-9686-e62b913510ce admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:53.526188 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08e3b4-1271-41c9-9686-e62b913510ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:53.526462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08e3b4-1271-41c9-9686-e62b913510ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:53.527103 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08e3b4-1271-41c9-9686-e62b913510ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:53.529041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08e3b4-1271-41c9-9686-e62b913510ce admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:53.543114 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1115/2234] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:31:53.544214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce0b83-ce25-44a1-81f9-90875e8e7e82 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:53.556484 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce0b83-ce25-44a1-81f9-90875e8e7e82 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:53.561515 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f27b1b-4f26-48f1-a135-8a8328064a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:53.562101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f27b1b-4f26-48f1-a135-8a8328064a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:53.562391 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f27b1b-4f26-48f1-a135-8a8328064a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:53.562747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f27b1b-4f26-48f1-a135-8a8328064a2d admin admin] PATH_INFO: `/v3/projects/87d5207146a84efeb824332b290306ab/users/a4100709d6644a2aa56f2c793078ef1a/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:53.589474 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f27b1b-4f26-48f1-a135-8a8328064a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d5207146a84efeb824332b290306ab, user_id=a4100709d6644a2aa56f2c793078ef1a, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:53.592343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f27b1b-4f26-48f1-a135-8a8328064a2d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:53.684138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1120/2235] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:53 2022] PUT /identity/v3/projects/87d5207146a84efeb824332b290306ab/users/a4100709d6644a2aa56f2c793078ef1a/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:53.695969 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8cb8b-f658-4b52-91c9-4269b9411e59 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:53.696257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8cb8b-f658-4b52-91c9-4269b9411e59 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:53.696534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8cb8b-f658-4b52-91c9-4269b9411e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:53.727852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e1b8cb8b-f658-4b52-91c9-4269b9411e59 None None] MFA Rules not processed for user `a4100709d6644a2aa56f2c793078ef1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:53.729140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e1b8cb8b-f658-4b52-91c9-4269b9411e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:53.805048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1116/2236] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:53.816412 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f27b1b-4f26-48f1-a135-8a8328064a2d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:53.895513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f27b1b-4f26-48f1-a135-8a8328064a2d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:53.900632 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee152e58-4859-4c25-a745-5950242b986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:53.901379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee152e58-4859-4c25-a745-5950242b986c admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:53.901726 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee152e58-4859-4c25-a745-5950242b986c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:53.902067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee152e58-4859-4c25-a745-5950242b986c admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:53.902760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee152e58-4859-4c25-a745-5950242b986c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:53.904753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee152e58-4859-4c25-a745-5950242b986c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:53.998553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1121/2237] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:31:53 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:31:53.999733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8cb8b-f658-4b52-91c9-4269b9411e59 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:54.010643 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8cb8b-f658-4b52-91c9-4269b9411e59 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:54.069578 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0671d5-36c6-4bfb-8003-2108c5fa05d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:54.070193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0671d5-36c6-4bfb-8003-2108c5fa05d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:54.070683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0671d5-36c6-4bfb-8003-2108c5fa05d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:54.070896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0671d5-36c6-4bfb-8003-2108c5fa05d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:54.071565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0671d5-36c6-4bfb-8003-2108c5fa05d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:54.073500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0671d5-36c6-4bfb-8003-2108c5fa05d5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:54.115023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:54.178406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1117/2238] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:31:53 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:31:54.186806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee152e58-4859-4c25-a745-5950242b986c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:54.192730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee152e58-4859-4c25-a745-5950242b986c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:54.197539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901144f3-55e4-4374-bda5-cdf9f88af9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:54.198132 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901144f3-55e4-4374-bda5-cdf9f88af9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:54.198455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901144f3-55e4-4374-bda5-cdf9f88af9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:54.198724 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901144f3-55e4-4374-bda5-cdf9f88af9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:54.199354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901144f3-55e4-4374-bda5-cdf9f88af9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:54.200934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901144f3-55e4-4374-bda5-cdf9f88af9a7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:54.212453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1122/2239] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:54.217032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0671d5-36c6-4bfb-8003-2108c5fa05d5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:54.230198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0671d5-36c6-4bfb-8003-2108c5fa05d5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:54.236655 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4933b18-6426-4839-a334-039ed3b9b906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:54.237343 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4933b18-6426-4839-a334-039ed3b9b906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:54.237659 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4933b18-6426-4839-a334-039ed3b9b906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:54.237937 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4933b18-6426-4839-a334-039ed3b9b906 admin admin] PATH_INFO: `/v3/projects/cafaeac686d748d4a31f9c4d41ba62c7/users/df4c0031c17847de8b6bca1664176288/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:54.253867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4933b18-6426-4839-a334-039ed3b9b906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafaeac686d748d4a31f9c4d41ba62c7, user_id=df4c0031c17847de8b6bca1664176288, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:54.256573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4933b18-6426-4839-a334-039ed3b9b906 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:54.376959 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1118/2240] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:54 2022] PUT /identity/v3/projects/cafaeac686d748d4a31f9c4d41ba62c7/users/df4c0031c17847de8b6bca1664176288/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:31:54.377504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901144f3-55e4-4374-bda5-cdf9f88af9a7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:54.392597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901144f3-55e4-4374-bda5-cdf9f88af9a7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:54.479570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81914bc3-47eb-4ff0-b4a3-101cc5452566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:54.480659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81914bc3-47eb-4ff0-b4a3-101cc5452566 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:54.481286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81914bc3-47eb-4ff0-b4a3-101cc5452566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:54.481717 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81914bc3-47eb-4ff0-b4a3-101cc5452566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:54.482807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81914bc3-47eb-4ff0-b4a3-101cc5452566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:54.484489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81914bc3-47eb-4ff0-b4a3-101cc5452566 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:54.497326 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1123/2241] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:31:54.500453 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4933b18-6426-4839-a334-039ed3b9b906 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:54.513129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4933b18-6426-4839-a334-039ed3b9b906 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:54.519129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3653ac-367c-4c73-8832-094b4ee92243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:54.519951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3653ac-367c-4c73-8832-094b4ee92243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:54.520359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3653ac-367c-4c73-8832-094b4ee92243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:54.520736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3653ac-367c-4c73-8832-094b4ee92243 admin admin] PATH_INFO: `/v3/projects/cafaeac686d748d4a31f9c4d41ba62c7/users/df4c0031c17847de8b6bca1664176288/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:54.523391 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3653ac-367c-4c73-8832-094b4ee92243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafaeac686d748d4a31f9c4d41ba62c7, user_id=df4c0031c17847de8b6bca1664176288, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:54.526554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3653ac-367c-4c73-8832-094b4ee92243 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:54.545434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1119/2242] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:31:54 2022] PUT /identity/v3/projects/cafaeac686d748d4a31f9c4d41ba62c7/users/df4c0031c17847de8b6bca1664176288/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:54.553558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b49957-68a3-4d7b-b834-620b313e28ae None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:54.554142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b49957-68a3-4d7b-b834-620b313e28ae None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:54.554580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b49957-68a3-4d7b-b834-620b313e28ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:54.588767 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-22b49957-68a3-4d7b-b834-620b313e28ae None None] MFA Rules not processed for user `df4c0031c17847de8b6bca1664176288`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:54.590198 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-22b49957-68a3-4d7b-b834-620b313e28ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:54.614496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:54.665421 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1124/2243] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:31:54.678510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3653ac-367c-4c73-8832-094b4ee92243 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:54.680257 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cf3653ac-367c-4c73-8832-094b4ee92243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:54.686535 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:54.742980 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3653ac-367c-4c73-8832-094b4ee92243 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:54.746814 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf2eb5-ee5a-41c0-a4c3-6c0996b7a1ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:54.747576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf2eb5-ee5a-41c0-a4c3-6c0996b7a1ab service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:54.747851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf2eb5-ee5a-41c0-a4c3-6c0996b7a1ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:54.748406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf2eb5-ee5a-41c0-a4c3-6c0996b7a1ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:54.759710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf2eb5-ee5a-41c0-a4c3-6c0996b7a1ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:54.761179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf2eb5-ee5a-41c0-a4c3-6c0996b7a1ab service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:54.773064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1120/2244] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:54.986339 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b49957-68a3-4d7b-b834-620b313e28ae None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:54.987717 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-22b49957-68a3-4d7b-b834-620b313e28ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:55.001863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b49957-68a3-4d7b-b834-620b313e28ae None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:55.004124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932d9b7-1d97-472e-b1e4-406f49446cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:55.004796 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932d9b7-1d97-472e-b1e4-406f49446cea service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:55.005075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932d9b7-1d97-472e-b1e4-406f49446cea service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:55.005379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932d9b7-1d97-472e-b1e4-406f49446cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:55.061711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932d9b7-1d97-472e-b1e4-406f49446cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:55.063144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932d9b7-1d97-472e-b1e4-406f49446cea service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:55.072456 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1125/2245] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:58.822204 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf2eb5-ee5a-41c0-a4c3-6c0996b7a1ab service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:58.827229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e3cf2eb5-ee5a-41c0-a4c3-6c0996b7a1ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:58.916170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf2eb5-ee5a-41c0-a4c3-6c0996b7a1ab service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:58.920817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:58.921464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:58.921741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:58.922007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] PATH_INFO: `/v3/users/aefeccc4c44e4c739b7c4933c0d61065` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:58.923104 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aefeccc4c44e4c739b7c4933c0d61065)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:58.925829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:59.111991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aefeccc4c44e4c739b7c4933c0d61065'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:59.112723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aefeccc4c44e4c739b7c4933c0d61065'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:59.113371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aefeccc4c44e4c739b7c4933c0d61065'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:59.123284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aefeccc4c44e4c739b7c4933c0d61065'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:59.142952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aefeccc4c44e4c739b7c4933c0d61065'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:31:59.215563 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1121/2246] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:31:58 2022] DELETE /identity/v3/users/aefeccc4c44e4c739b7c4933c0d61065 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:31:59.217866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133df0dc-31f6-4bfd-a4f2-baf1f0b4d537 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:59.218346 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133df0dc-31f6-4bfd-a4f2-baf1f0b4d537 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:59.218491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133df0dc-31f6-4bfd-a4f2-baf1f0b4d537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:59.239824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-133df0dc-31f6-4bfd-a4f2-baf1f0b4d537 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:31:59.240751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-133df0dc-31f6-4bfd-a4f2-baf1f0b4d537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:59.316076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1126/2247] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:31:59.325800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:59.331435 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:59.356512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:31:59.386310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24c6fb-7c59-45df-9d5c-dc3b646c8b78 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:59.390174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a4cac-002e-4ac5-8092-963aa050bdca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:59.390819 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a4cac-002e-4ac5-8092-963aa050bdca service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:59.391096 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a4cac-002e-4ac5-8092-963aa050bdca service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:59.391369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a4cac-002e-4ac5-8092-963aa050bdca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:59.401974 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a4cac-002e-4ac5-8092-963aa050bdca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:59.403537 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a4cac-002e-4ac5-8092-963aa050bdca service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:31:59.413843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1122/2248] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:31:59.904914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133df0dc-31f6-4bfd-a4f2-baf1f0b4d537 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:31:59.907905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-133df0dc-31f6-4bfd-a4f2-baf1f0b4d537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:31:59.942139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133df0dc-31f6-4bfd-a4f2-baf1f0b4d537 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:31:59.954117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71069ba-c43b-42d9-bcac-5eee45a86e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:31:59.956188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71069ba-c43b-42d9-bcac-5eee45a86e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:31:59.960732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71069ba-c43b-42d9-bcac-5eee45a86e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:31:59.960732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71069ba-c43b-42d9-bcac-5eee45a86e2e admin admin] PATH_INFO: `/v3/projects/ddb12dabcbb947dd8aa51b7c89a78938` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:31:59.960732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71069ba-c43b-42d9-bcac-5eee45a86e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb12dabcbb947dd8aa51b7c89a78938)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:31:59.961156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71069ba-c43b-42d9-bcac-5eee45a86e2e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:00.094320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b71069ba-c43b-42d9-bcac-5eee45a86e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb12dabcbb947dd8aa51b7c89a78938', 'request_id': 'req-b71069ba-c43b-42d9-bcac-5eee45a86e2e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:00.105584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b71069ba-c43b-42d9-bcac-5eee45a86e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb12dabcbb947dd8aa51b7c89a78938', 'request_id': 'req-b71069ba-c43b-42d9-bcac-5eee45a86e2e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:00.105584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:00.179680 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b71069ba-c43b-42d9-bcac-5eee45a86e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb12dabcbb947dd8aa51b7c89a78938', 'request_id': 'req-b71069ba-c43b-42d9-bcac-5eee45a86e2e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:00.195372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b71069ba-c43b-42d9-bcac-5eee45a86e2e admin admin] The token cache is being invalidate because project ddb12dabcbb947dd8aa51b7c89a78938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:32:00.195907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b71069ba-c43b-42d9-bcac-5eee45a86e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:00.196781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b71069ba-c43b-42d9-bcac-5eee45a86e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:00.198804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1127/2249] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:31:59 2022] DELETE /identity/v3/projects/ddb12dabcbb947dd8aa51b7c89a78938 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:00.203562 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4036-d03e-4f60-adb3-ca1a5b86bd90 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:00.204068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4036-d03e-4f60-adb3-ca1a5b86bd90 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:00.204165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4036-d03e-4f60-adb3-ca1a5b86bd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:00.266666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-42fc4036-d03e-4f60-adb3-ca1a5b86bd90 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:00.268517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-42fc4036-d03e-4f60-adb3-ca1a5b86bd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:00.369585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1123/2250] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:00.379193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e850b-1c89-4c62-b31a-4dbfdbe221eb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:00.379719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e850b-1c89-4c62-b31a-4dbfdbe221eb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:00.379980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e850b-1c89-4c62-b31a-4dbfdbe221eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:00.402882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-184e850b-1c89-4c62-b31a-4dbfdbe221eb None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:00.404512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-184e850b-1c89-4c62-b31a-4dbfdbe221eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:00.420122 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1128/2251] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:00.421077 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4036-d03e-4f60-adb3-ca1a5b86bd90 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:00.434636 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4036-d03e-4f60-adb3-ca1a5b86bd90 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:00.440586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f7736-6cd1-4e8d-b920-6166be687956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:00.441294 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f7736-6cd1-4e8d-b920-6166be687956 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:00.441617 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f7736-6cd1-4e8d-b920-6166be687956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:00.441895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f7736-6cd1-4e8d-b920-6166be687956 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:00.442588 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f7736-6cd1-4e8d-b920-6166be687956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:32:00.442900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f7736-6cd1-4e8d-b920-6166be687956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:00.444540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f7736-6cd1-4e8d-b920-6166be687956 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:00.459165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1124/2252] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:32:00.462226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e850b-1c89-4c62-b31a-4dbfdbe221eb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:00.476146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e850b-1c89-4c62-b31a-4dbfdbe221eb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:00.483107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95424b1-b37f-4007-bff0-9d5c077fcaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:00.483935 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95424b1-b37f-4007-bff0-9d5c077fcaef admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:00.492668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95424b1-b37f-4007-bff0-9d5c077fcaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:00.492668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95424b1-b37f-4007-bff0-9d5c077fcaef admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:00.492668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95424b1-b37f-4007-bff0-9d5c077fcaef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:00.492668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95424b1-b37f-4007-bff0-9d5c077fcaef admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:00.591718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1129/2253] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:32:00 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:00.592572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f7736-6cd1-4e8d-b920-6166be687956 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:00.604409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f7736-6cd1-4e8d-b920-6166be687956 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:00.671842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215aa3c6-c98d-437c-b986-3a708e391122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:00.672719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215aa3c6-c98d-437c-b986-3a708e391122 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:00.672997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215aa3c6-c98d-437c-b986-3a708e391122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:00.673291 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215aa3c6-c98d-437c-b986-3a708e391122 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:00.673978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215aa3c6-c98d-437c-b986-3a708e391122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:00.676398 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215aa3c6-c98d-437c-b986-3a708e391122 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:00.777284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1125/2254] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:32:00 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:32:00.781276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95424b1-b37f-4007-bff0-9d5c077fcaef admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:00.794631 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95424b1-b37f-4007-bff0-9d5c077fcaef admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:00.800146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbf2f2-7b8f-4152-a21d-52652513c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:00.800836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbf2f2-7b8f-4152-a21d-52652513c429 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:00.803120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbf2f2-7b8f-4152-a21d-52652513c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:00.803415 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbf2f2-7b8f-4152-a21d-52652513c429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:00.804138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbf2f2-7b8f-4152-a21d-52652513c429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:00.805825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbf2f2-7b8f-4152-a21d-52652513c429 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:00.816762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1130/2255] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:32:00.822702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215aa3c6-c98d-437c-b986-3a708e391122 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:00.831549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215aa3c6-c98d-437c-b986-3a708e391122 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:00.836565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d358d-953d-4357-818d-58f56d38ce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:00.837669 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d358d-953d-4357-818d-58f56d38ce56 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:00.837669 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d358d-953d-4357-818d-58f56d38ce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:00.837897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d358d-953d-4357-818d-58f56d38ce56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:00.838729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d358d-953d-4357-818d-58f56d38ce56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:00.840343 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d358d-953d-4357-818d-58f56d38ce56 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:00.854359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1126/2256] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:32:00.857574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbf2f2-7b8f-4152-a21d-52652513c429 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:00.870614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbf2f2-7b8f-4152-a21d-52652513c429 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:00.891157 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff949-864b-4db5-ac63-d66a775a6ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:00.892109 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff949-864b-4db5-ac63-d66a775a6ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:00.892386 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff949-864b-4db5-ac63-d66a775a6ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:00.892695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff949-864b-4db5-ac63-d66a775a6ad5 admin admin] PATH_INFO: `/v3/projects/6d903a99e2b24f28aa42e34d83c155c7/users/09e15a09ac5d48d0b9a9ae5fc75f7073/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:00.926136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabff949-864b-4db5-ac63-d66a775a6ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d903a99e2b24f28aa42e34d83c155c7, user_id=09e15a09ac5d48d0b9a9ae5fc75f7073, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:00.928753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabff949-864b-4db5-ac63-d66a775a6ad5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:01.032606 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1131/2257] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:32:00 2022] PUT /identity/v3/projects/6d903a99e2b24f28aa42e34d83c155c7/users/09e15a09ac5d48d0b9a9ae5fc75f7073/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:01.046752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575574e-b922-41cb-9502-71fbd9627de5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:01.047059 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575574e-b922-41cb-9502-71fbd9627de5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:01.047371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575574e-b922-41cb-9502-71fbd9627de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:01.082405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9575574e-b922-41cb-9502-71fbd9627de5 None None] MFA Rules not processed for user `09e15a09ac5d48d0b9a9ae5fc75f7073`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:01.083638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9575574e-b922-41cb-9502-71fbd9627de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:01.105590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:01.154095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1127/2258] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:01.166597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff949-864b-4db5-ac63-d66a775a6ad5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:01.168598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cabff949-864b-4db5-ac63-d66a775a6ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:01.237150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff949-864b-4db5-ac63-d66a775a6ad5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:01.241367 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15198edd-b5e1-4385-b019-08fa825ba29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:01.247070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198edd-b5e1-4385-b019-08fa825ba29d service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:01.247070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198edd-b5e1-4385-b019-08fa825ba29d service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:01.247070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198edd-b5e1-4385-b019-08fa825ba29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:01.252495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15198edd-b5e1-4385-b019-08fa825ba29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:01.254184 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15198edd-b5e1-4385-b019-08fa825ba29d service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:01.273018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1132/2259] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:32:02.516065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575574e-b922-41cb-9502-71fbd9627de5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:02.518080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9575574e-b922-41cb-9502-71fbd9627de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:02.587286 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575574e-b922-41cb-9502-71fbd9627de5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:02.592063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:02.592997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:02.592997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:02.593318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] PATH_INFO: `/v3/users/a4100709d6644a2aa56f2c793078ef1a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:02.594416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4100709d6644a2aa56f2c793078ef1a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:02.596903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:02.789955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4100709d6644a2aa56f2c793078ef1a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:02.790611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4100709d6644a2aa56f2c793078ef1a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:02.792006 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4100709d6644a2aa56f2c793078ef1a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:02.799368 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4100709d6644a2aa56f2c793078ef1a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:02.814326 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4100709d6644a2aa56f2c793078ef1a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:02.930950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1128/2260] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:32:02 2022] DELETE /identity/v3/users/a4100709d6644a2aa56f2c793078ef1a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:02.939068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909f967-47d2-4c75-80bd-33f5ecb4caf7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:02.940101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909f967-47d2-4c75-80bd-33f5ecb4caf7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:02.940225 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909f967-47d2-4c75-80bd-33f5ecb4caf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:02.959634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3909f967-47d2-4c75-80bd-33f5ecb4caf7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:02.960856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3909f967-47d2-4c75-80bd-33f5ecb4caf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:03.021846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1133/2261] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:03.031801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:03.033391 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:03.080779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:03.092868 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ee6d1-2f7f-4a0a-bd07-e2501841ecd0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:03.096554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad471bb8-7a6f-4886-a1cd-a3d8beb33b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:03.097160 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad471bb8-7a6f-4886-a1cd-a3d8beb33b22 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:03.097488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad471bb8-7a6f-4886-a1cd-a3d8beb33b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:03.097761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad471bb8-7a6f-4886-a1cd-a3d8beb33b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:03.107016 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad471bb8-7a6f-4886-a1cd-a3d8beb33b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:03.108452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad471bb8-7a6f-4886-a1cd-a3d8beb33b22 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:03.118001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1129/2262] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:32:03.525474 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909f967-47d2-4c75-80bd-33f5ecb4caf7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:03.527156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3909f967-47d2-4c75-80bd-33f5ecb4caf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:03.545654 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909f967-47d2-4c75-80bd-33f5ecb4caf7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:03.552825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:03.553540 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:03.553996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:03.554291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] PATH_INFO: `/v3/projects/87d5207146a84efeb824332b290306ab` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:03.555653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d5207146a84efeb824332b290306ab)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:03.557618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:03.579183 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:03.665485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d5207146a84efeb824332b290306ab', 'request_id': 'req-24d264b6-536c-4013-920b-c7c8f2436222'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:03.671584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d5207146a84efeb824332b290306ab', 'request_id': 'req-24d264b6-536c-4013-920b-c7c8f2436222'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:03.745721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d5207146a84efeb824332b290306ab', 'request_id': 'req-24d264b6-536c-4013-920b-c7c8f2436222'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:03.757960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] The token cache is being invalidate because project 87d5207146a84efeb824332b290306ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:32:03.758248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:03.758901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:03.760378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1134/2263] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:32:03 2022] DELETE /identity/v3/projects/87d5207146a84efeb824332b290306ab => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:03.764364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad471bb8-7a6f-4886-a1cd-a3d8beb33b22 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:03.774364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad471bb8-7a6f-4886-a1cd-a3d8beb33b22 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:03.832930 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db4923-1e5b-4e11-b748-6e146a5b0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:03.833596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db4923-1e5b-4e11-b748-6e146a5b0776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:03.833871 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db4923-1e5b-4e11-b748-6e146a5b0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:03.834140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db4923-1e5b-4e11-b748-6e146a5b0776 admin admin] PATH_INFO: `/v3/users/df4c0031c17847de8b6bca1664176288` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:03.835273 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db4923-1e5b-4e11-b748-6e146a5b0776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4c0031c17847de8b6bca1664176288)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:03.837182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db4923-1e5b-4e11-b748-6e146a5b0776 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:04.037872 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-88db4923-1e5b-4e11-b748-6e146a5b0776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4c0031c17847de8b6bca1664176288'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:04.038706 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-88db4923-1e5b-4e11-b748-6e146a5b0776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4c0031c17847de8b6bca1664176288'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:04.039242 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-88db4923-1e5b-4e11-b748-6e146a5b0776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4c0031c17847de8b6bca1664176288'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:04.047443 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-88db4923-1e5b-4e11-b748-6e146a5b0776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4c0031c17847de8b6bca1664176288'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:04.062829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-88db4923-1e5b-4e11-b748-6e146a5b0776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4c0031c17847de8b6bca1664176288'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:04.143777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1130/2264] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:32:03 2022] DELETE /identity/v3/users/df4c0031c17847de8b6bca1664176288 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:04.586026 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:04.587663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:04.605220 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d264b6-536c-4013-920b-c7c8f2436222 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:04.691074 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814a5bf-ec96-434f-8a7d-29d2a111ea94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:04.691727 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814a5bf-ec96-434f-8a7d-29d2a111ea94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:04.692006 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814a5bf-ec96-434f-8a7d-29d2a111ea94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:04.692278 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814a5bf-ec96-434f-8a7d-29d2a111ea94 admin admin] PATH_INFO: `/v3/projects/cafaeac686d748d4a31f9c4d41ba62c7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:04.693458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814a5bf-ec96-434f-8a7d-29d2a111ea94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cafaeac686d748d4a31f9c4d41ba62c7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:04.696664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814a5bf-ec96-434f-8a7d-29d2a111ea94 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:04.802323 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6814a5bf-ec96-434f-8a7d-29d2a111ea94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cafaeac686d748d4a31f9c4d41ba62c7', 'request_id': 'req-6814a5bf-ec96-434f-8a7d-29d2a111ea94'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:04.808696 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6814a5bf-ec96-434f-8a7d-29d2a111ea94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cafaeac686d748d4a31f9c4d41ba62c7', 'request_id': 'req-6814a5bf-ec96-434f-8a7d-29d2a111ea94'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:04.884911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6814a5bf-ec96-434f-8a7d-29d2a111ea94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cafaeac686d748d4a31f9c4d41ba62c7', 'request_id': 'req-6814a5bf-ec96-434f-8a7d-29d2a111ea94'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:04.896236 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6814a5bf-ec96-434f-8a7d-29d2a111ea94 admin admin] The token cache is being invalidate because project cafaeac686d748d4a31f9c4d41ba62c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:32:04.896548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6814a5bf-ec96-434f-8a7d-29d2a111ea94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:04.897183 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6814a5bf-ec96-434f-8a7d-29d2a111ea94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:04.898699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1135/2265] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:32:04 2022] DELETE /identity/v3/projects/cafaeac686d748d4a31f9c4d41ba62c7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:04.903871 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cca83e-47d3-4caa-a359-8843f484be5c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:04.904290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cca83e-47d3-4caa-a359-8843f484be5c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:04.908100 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cca83e-47d3-4caa-a359-8843f484be5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:04.925491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e8cca83e-47d3-4caa-a359-8843f484be5c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:04.926746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e8cca83e-47d3-4caa-a359-8843f484be5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:05.004215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1131/2266] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:05.012138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294420c1-8e8c-41ca-8faa-61b3f2c7c395 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:05.012472 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294420c1-8e8c-41ca-8faa-61b3f2c7c395 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:05.012752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294420c1-8e8c-41ca-8faa-61b3f2c7c395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:05.033539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-294420c1-8e8c-41ca-8faa-61b3f2c7c395 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:05.035075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-294420c1-8e8c-41ca-8faa-61b3f2c7c395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:05.043774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1136/2267] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:05.048120 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cca83e-47d3-4caa-a359-8843f484be5c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:05.055319 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:05.059194 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cca83e-47d3-4caa-a359-8843f484be5c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:05.065664 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fd30a-9932-4efc-b1f5-8c8f369d3fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:05.065664 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fd30a-9932-4efc-b1f5-8c8f369d3fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:05.065881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fd30a-9932-4efc-b1f5-8c8f369d3fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:05.066053 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fd30a-9932-4efc-b1f5-8c8f369d3fc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:05.066708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fd30a-9932-4efc-b1f5-8c8f369d3fc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:32:05.067017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fd30a-9932-4efc-b1f5-8c8f369d3fc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:05.068622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fd30a-9932-4efc-b1f5-8c8f369d3fc5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:05.094476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1132/2268] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:32:05.095656 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294420c1-8e8c-41ca-8faa-61b3f2c7c395 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:05.105746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294420c1-8e8c-41ca-8faa-61b3f2c7c395 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:05.122816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ffbf-87d3-4b85-afe7-399a798db3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:05.125290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ffbf-87d3-4b85-afe7-399a798db3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:05.126466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ffbf-87d3-4b85-afe7-399a798db3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:05.128156 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ffbf-87d3-4b85-afe7-399a798db3b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:05.129788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15ffbf-87d3-4b85-afe7-399a798db3b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:05.139395 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15ffbf-87d3-4b85-afe7-399a798db3b2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:05.234883 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1137/2269] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:32:05 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:05.239750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fd30a-9932-4efc-b1f5-8c8f369d3fc5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:05.250221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fd30a-9932-4efc-b1f5-8c8f369d3fc5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:05.317314 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1d13c-768e-4e3b-a969-fbb5081ee415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:05.318058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1d13c-768e-4e3b-a969-fbb5081ee415 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:05.318706 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1d13c-768e-4e3b-a969-fbb5081ee415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:05.319050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1d13c-768e-4e3b-a969-fbb5081ee415 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:05.319748 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1d13c-768e-4e3b-a969-fbb5081ee415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:05.321797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1d13c-768e-4e3b-a969-fbb5081ee415 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:05.432313 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1133/2270] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:32:05 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:05.433536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ffbf-87d3-4b85-afe7-399a798db3b2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:05.444029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ffbf-87d3-4b85-afe7-399a798db3b2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:05.449770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03717ea6-9319-4cee-9799-65d2b17501f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:05.456148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03717ea6-9319-4cee-9799-65d2b17501f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:05.456460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03717ea6-9319-4cee-9799-65d2b17501f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:05.456705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03717ea6-9319-4cee-9799-65d2b17501f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:05.457422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03717ea6-9319-4cee-9799-65d2b17501f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:05.459049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03717ea6-9319-4cee-9799-65d2b17501f9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:05.460763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:05.471343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1138/2271] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:05.475402 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1d13c-768e-4e3b-a969-fbb5081ee415 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:05.485695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1d13c-768e-4e3b-a969-fbb5081ee415 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:05.491083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83f9b2-2b01-411f-9473-b6b75db15bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:05.491681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83f9b2-2b01-411f-9473-b6b75db15bab admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:05.491961 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83f9b2-2b01-411f-9473-b6b75db15bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:05.492233 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83f9b2-2b01-411f-9473-b6b75db15bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:05.492876 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83f9b2-2b01-411f-9473-b6b75db15bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:05.494526 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83f9b2-2b01-411f-9473-b6b75db15bab admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:05.506353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1134/2272] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:05.510571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03717ea6-9319-4cee-9799-65d2b17501f9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:05.521869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03717ea6-9319-4cee-9799-65d2b17501f9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:05.526751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6c047-56b1-4c38-8e10-b90760e2dd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:05.527474 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6c047-56b1-4c38-8e10-b90760e2dd95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:05.527749 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6c047-56b1-4c38-8e10-b90760e2dd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:05.528020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6c047-56b1-4c38-8e10-b90760e2dd95 admin admin] PATH_INFO: `/v3/projects/c7839722282f471c9b8d0c3cdc37a4cf/users/50233c488a0b46ff9fc366acdec98628/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:05.542565 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6c047-56b1-4c38-8e10-b90760e2dd95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7839722282f471c9b8d0c3cdc37a4cf, user_id=50233c488a0b46ff9fc366acdec98628, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:05.545322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6c047-56b1-4c38-8e10-b90760e2dd95 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:05.671228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1139/2273] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:32:05 2022] PUT /identity/v3/projects/c7839722282f471c9b8d0c3cdc37a4cf/users/50233c488a0b46ff9fc366acdec98628/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:05.682233 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3b1c1-afa9-430d-8a9e-3afc25c721e4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:05.682696 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3b1c1-afa9-430d-8a9e-3afc25c721e4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:05.683130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3b1c1-afa9-430d-8a9e-3afc25c721e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:05.734585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-89f3b1c1-afa9-430d-8a9e-3afc25c721e4 None None] MFA Rules not processed for user `50233c488a0b46ff9fc366acdec98628`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:05.737111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-89f3b1c1-afa9-430d-8a9e-3afc25c721e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:05.817449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1135/2274] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:32:05.821639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6c047-56b1-4c38-8e10-b90760e2dd95 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:05.903392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6c047-56b1-4c38-8e10-b90760e2dd95 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:05.914808 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483648cd-b638-4462-a4df-0705616f5419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:05.922235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483648cd-b638-4462-a4df-0705616f5419 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:05.922235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483648cd-b638-4462-a4df-0705616f5419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:05.922235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483648cd-b638-4462-a4df-0705616f5419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:05.922235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483648cd-b638-4462-a4df-0705616f5419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:05.922875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483648cd-b638-4462-a4df-0705616f5419 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:06.031179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1140/2275] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:32:05 2022] POST /identity/v3/projects => generated 381 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:06.032287 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3b1c1-afa9-430d-8a9e-3afc25c721e4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:06.043724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3b1c1-afa9-430d-8a9e-3afc25c721e4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:06.100690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061756c9-dd60-420d-875b-5424100483cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:06.101532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061756c9-dd60-420d-875b-5424100483cf admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:06.101763 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061756c9-dd60-420d-875b-5424100483cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:06.102037 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061756c9-dd60-420d-875b-5424100483cf admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:06.102676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061756c9-dd60-420d-875b-5424100483cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:06.104612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061756c9-dd60-420d-875b-5424100483cf admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:06.113321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:06.250756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1136/2276] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:32:06 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:06.253593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483648cd-b638-4462-a4df-0705616f5419 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:06.266580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483648cd-b638-4462-a4df-0705616f5419 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:06.273643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300bb38-3bd0-476f-8c0e-fe5bbf430885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:06.274347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300bb38-3bd0-476f-8c0e-fe5bbf430885 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:06.274610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300bb38-3bd0-476f-8c0e-fe5bbf430885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:06.274875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300bb38-3bd0-476f-8c0e-fe5bbf430885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:06.276120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300bb38-3bd0-476f-8c0e-fe5bbf430885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:06.277329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300bb38-3bd0-476f-8c0e-fe5bbf430885 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:06.293023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1141/2277] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:06.294157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061756c9-dd60-420d-875b-5424100483cf admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:06.305609 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061756c9-dd60-420d-875b-5424100483cf admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:06.310343 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b5ca-d42f-49f1-ac3d-ae3d5cebe257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:06.310997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b5ca-d42f-49f1-ac3d-ae3d5cebe257 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:06.311271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b5ca-d42f-49f1-ac3d-ae3d5cebe257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:06.311615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b5ca-d42f-49f1-ac3d-ae3d5cebe257 admin admin] PATH_INFO: `/v3/projects/1631bc1ede2545b28480c2164ce36619/users/90170522f9714f8aa84b1a0ce619edf3/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:06.327905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60b5ca-d42f-49f1-ac3d-ae3d5cebe257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1631bc1ede2545b28480c2164ce36619, user_id=90170522f9714f8aa84b1a0ce619edf3, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:06.331557 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60b5ca-d42f-49f1-ac3d-ae3d5cebe257 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:06.426516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1137/2278] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:32:06 2022] PUT /identity/v3/projects/1631bc1ede2545b28480c2164ce36619/users/90170522f9714f8aa84b1a0ce619edf3/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:32:06.430552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300bb38-3bd0-476f-8c0e-fe5bbf430885 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:06.442438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300bb38-3bd0-476f-8c0e-fe5bbf430885 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:06.514987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4dd6c-841c-45ef-8226-7f92c7c34298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:06.515598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4dd6c-841c-45ef-8226-7f92c7c34298 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:06.516959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4dd6c-841c-45ef-8226-7f92c7c34298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:06.516959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4dd6c-841c-45ef-8226-7f92c7c34298 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:06.516959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4dd6c-841c-45ef-8226-7f92c7c34298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:06.518979 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4dd6c-841c-45ef-8226-7f92c7c34298 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:06.528745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1142/2279] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:06.533507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b5ca-d42f-49f1-ac3d-ae3d5cebe257 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:06.544063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b5ca-d42f-49f1-ac3d-ae3d5cebe257 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:06.548778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a291-af44-40f9-98bc-c35785b4413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:06.549474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a291-af44-40f9-98bc-c35785b4413c admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:06.549751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a291-af44-40f9-98bc-c35785b4413c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:06.550021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a291-af44-40f9-98bc-c35785b4413c admin admin] PATH_INFO: `/v3/projects/1631bc1ede2545b28480c2164ce36619/users/90170522f9714f8aa84b1a0ce619edf3/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:06.551904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88a291-af44-40f9-98bc-c35785b4413c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1631bc1ede2545b28480c2164ce36619, user_id=90170522f9714f8aa84b1a0ce619edf3, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:06.554584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88a291-af44-40f9-98bc-c35785b4413c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:06.566020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1138/2280] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:32:06 2022] PUT /identity/v3/projects/1631bc1ede2545b28480c2164ce36619/users/90170522f9714f8aa84b1a0ce619edf3/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:06.599993 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69140c46-9a0d-4f7a-bd9b-334569d17cb9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:06.600286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69140c46-9a0d-4f7a-bd9b-334569d17cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:06.600629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69140c46-9a0d-4f7a-bd9b-334569d17cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:06.630341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-69140c46-9a0d-4f7a-bd9b-334569d17cb9 None None] MFA Rules not processed for user `90170522f9714f8aa84b1a0ce619edf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:06.631637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-69140c46-9a0d-4f7a-bd9b-334569d17cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:06.664389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:06.703469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1143/2281] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:32:06.721549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a291-af44-40f9-98bc-c35785b4413c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:06.721549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fc88a291-af44-40f9-98bc-c35785b4413c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:06.778331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a291-af44-40f9-98bc-c35785b4413c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:06.782162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bf456-af60-4f95-96e7-cda4629b2393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:06.782770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bf456-af60-4f95-96e7-cda4629b2393 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:06.783047 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bf456-af60-4f95-96e7-cda4629b2393 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:06.783316 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bf456-af60-4f95-96e7-cda4629b2393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:06.793465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bf456-af60-4f95-96e7-cda4629b2393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:06.794968 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bf456-af60-4f95-96e7-cda4629b2393 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:06.804923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1139/2282] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:07.799602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69140c46-9a0d-4f7a-bd9b-334569d17cb9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:07.877607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69140c46-9a0d-4f7a-bd9b-334569d17cb9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:07.882705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:07.883417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:07.883750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:07.884220 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] PATH_INFO: `/v3/users/50233c488a0b46ff9fc366acdec98628` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:07.885496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50233c488a0b46ff9fc366acdec98628)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:07.887933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:08.114581 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50233c488a0b46ff9fc366acdec98628'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:08.214236 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50233c488a0b46ff9fc366acdec98628'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:08.214887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50233c488a0b46ff9fc366acdec98628'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:08.216991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50233c488a0b46ff9fc366acdec98628'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:08.228561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50233c488a0b46ff9fc366acdec98628'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:08.265449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1144/2283] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:32:07 2022] DELETE /identity/v3/users/50233c488a0b46ff9fc366acdec98628 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:08.266169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060de10-f7ce-46f4-94bc-ca64f03ce65b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:08.266683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060de10-f7ce-46f4-94bc-ca64f03ce65b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:08.266789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060de10-f7ce-46f4-94bc-ca64f03ce65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:08.294627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a060de10-f7ce-46f4-94bc-ca64f03ce65b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:08.297213 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a060de10-f7ce-46f4-94bc-ca64f03ce65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:08.386715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1140/2284] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:08.398823 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:08.402569 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:08.479723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:08.484451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788842b-02ba-400f-b22e-dcbe3f81382c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:08.488879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ce685-dbab-4ef6-962a-49cdfe5139e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:08.489545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ce685-dbab-4ef6-962a-49cdfe5139e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:08.489826 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ce685-dbab-4ef6-962a-49cdfe5139e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:08.490101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ce685-dbab-4ef6-962a-49cdfe5139e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:08.500932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ce685-dbab-4ef6-962a-49cdfe5139e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:08.502514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ce685-dbab-4ef6-962a-49cdfe5139e1 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:08.520607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1145/2285] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:08.662809 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060de10-f7ce-46f4-94bc-ca64f03ce65b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:08.662809 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a060de10-f7ce-46f4-94bc-ca64f03ce65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:08.685021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060de10-f7ce-46f4-94bc-ca64f03ce65b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:08.699715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:08.700464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:08.700822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:08.701196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] PATH_INFO: `/v3/users/e8d6f3d467b747b0acc15894a1091b7c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:08.702627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d6f3d467b747b0acc15894a1091b7c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:08.714514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:08.991717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d6f3d467b747b0acc15894a1091b7c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:08.993821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d6f3d467b747b0acc15894a1091b7c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:08.995957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d6f3d467b747b0acc15894a1091b7c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:08.998785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:09.009998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d6f3d467b747b0acc15894a1091b7c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:09.037850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d6f3d467b747b0acc15894a1091b7c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:09.116113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1141/2286] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:32:08 2022] DELETE /identity/v3/users/e8d6f3d467b747b0acc15894a1091b7c => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:09.120757 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989ce76-5c85-4dd8-b73e-2a2b1500fcbd None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:09.121741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989ce76-5c85-4dd8-b73e-2a2b1500fcbd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:09.122214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989ce76-5c85-4dd8-b73e-2a2b1500fcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:09.163102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8989ce76-5c85-4dd8-b73e-2a2b1500fcbd None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:09.164402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8989ce76-5c85-4dd8-b73e-2a2b1500fcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:09.246819 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1146/2287] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:09.257901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:09.259189 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:09.288554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989ce76-5c85-4dd8-b73e-2a2b1500fcbd None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:09.290120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8989ce76-5c85-4dd8-b73e-2a2b1500fcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:09.312329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989ce76-5c85-4dd8-b73e-2a2b1500fcbd None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:09.329031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:09.330056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:09.330489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:09.330932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] PATH_INFO: `/v3/projects/c7839722282f471c9b8d0c3cdc37a4cf` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:09.332392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7839722282f471c9b8d0c3cdc37a4cf)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:09.335497 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:09.381313 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e2de-106e-48a0-b61e-93158ef51efc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:09.395073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ea545-1283-4dab-a63d-8e3bf00cb488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:09.395718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ea545-1283-4dab-a63d-8e3bf00cb488 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:09.395998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ea545-1283-4dab-a63d-8e3bf00cb488 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:09.396273 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ea545-1283-4dab-a63d-8e3bf00cb488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:09.413418 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ea545-1283-4dab-a63d-8e3bf00cb488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:09.415326 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ea545-1283-4dab-a63d-8e3bf00cb488 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:09.427519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1142/2288] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:09.535231 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7839722282f471c9b8d0c3cdc37a4cf', 'request_id': 'req-9cd172a2-6eee-4b09-a672-aceab51ef68e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:09.543709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7839722282f471c9b8d0c3cdc37a4cf', 'request_id': 'req-9cd172a2-6eee-4b09-a672-aceab51ef68e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:09.625723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7839722282f471c9b8d0c3cdc37a4cf', 'request_id': 'req-9cd172a2-6eee-4b09-a672-aceab51ef68e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:09.643730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] The token cache is being invalidate because project c7839722282f471c9b8d0c3cdc37a4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:32:09.644243 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:09.645080 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:09.647364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1147/2289] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:32:09 2022] DELETE /identity/v3/projects/c7839722282f471c9b8d0c3cdc37a4cf => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:32:09.660186 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ea545-1283-4dab-a63d-8e3bf00cb488 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:09.665239 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ea545-1283-4dab-a63d-8e3bf00cb488 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:09.731293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79915ee0-0508-48b5-84a2-3083adcd20a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:09.732266 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79915ee0-0508-48b5-84a2-3083adcd20a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:09.732550 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79915ee0-0508-48b5-84a2-3083adcd20a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:09.732988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79915ee0-0508-48b5-84a2-3083adcd20a1 admin admin] PATH_INFO: `/v3/users/90170522f9714f8aa84b1a0ce619edf3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:09.734173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79915ee0-0508-48b5-84a2-3083adcd20a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90170522f9714f8aa84b1a0ce619edf3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:09.739502 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79915ee0-0508-48b5-84a2-3083adcd20a1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:09.972608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-79915ee0-0508-48b5-84a2-3083adcd20a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90170522f9714f8aa84b1a0ce619edf3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:09.973587 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-79915ee0-0508-48b5-84a2-3083adcd20a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90170522f9714f8aa84b1a0ce619edf3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:09.974159 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-79915ee0-0508-48b5-84a2-3083adcd20a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90170522f9714f8aa84b1a0ce619edf3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:09.986848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-79915ee0-0508-48b5-84a2-3083adcd20a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90170522f9714f8aa84b1a0ce619edf3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:10.001835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-79915ee0-0508-48b5-84a2-3083adcd20a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90170522f9714f8aa84b1a0ce619edf3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:10.098994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1143/2290] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:32:09 2022] DELETE /identity/v3/users/90170522f9714f8aa84b1a0ce619edf3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:10.371810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:10.373398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:10.389150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd172a2-6eee-4b09-a672-aceab51ef68e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:10.478709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60ac83-e908-4d4d-8a71-59b478b47d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:10.480015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60ac83-e908-4d4d-8a71-59b478b47d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:10.480439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60ac83-e908-4d4d-8a71-59b478b47d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:10.480720 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60ac83-e908-4d4d-8a71-59b478b47d1e admin admin] PATH_INFO: `/v3/projects/90c2cb84cd66427080adb0bf149de721` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:10.481890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60ac83-e908-4d4d-8a71-59b478b47d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c2cb84cd66427080adb0bf149de721)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:10.484037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60ac83-e908-4d4d-8a71-59b478b47d1e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:10.485859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:10.502433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:10.648470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2a60ac83-e908-4d4d-8a71-59b478b47d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c2cb84cd66427080adb0bf149de721', 'request_id': 'req-2a60ac83-e908-4d4d-8a71-59b478b47d1e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:10.655666 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2a60ac83-e908-4d4d-8a71-59b478b47d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c2cb84cd66427080adb0bf149de721', 'request_id': 'req-2a60ac83-e908-4d4d-8a71-59b478b47d1e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:10.746541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2a60ac83-e908-4d4d-8a71-59b478b47d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c2cb84cd66427080adb0bf149de721', 'request_id': 'req-2a60ac83-e908-4d4d-8a71-59b478b47d1e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:10.761672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2a60ac83-e908-4d4d-8a71-59b478b47d1e admin admin] The token cache is being invalidate because project 90c2cb84cd66427080adb0bf149de721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:32:10.761962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2a60ac83-e908-4d4d-8a71-59b478b47d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:10.762840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2a60ac83-e908-4d4d-8a71-59b478b47d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:10.770062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1148/2291] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:32:10 2022] DELETE /identity/v3/projects/90c2cb84cd66427080adb0bf149de721 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:10.770725 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3285e1-cc2f-4854-bf18-210d92d35258 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:10.771014 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3285e1-cc2f-4854-bf18-210d92d35258 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:10.771290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3285e1-cc2f-4854-bf18-210d92d35258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:10.801079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2a3285e1-cc2f-4854-bf18-210d92d35258 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:10.802388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2a3285e1-cc2f-4854-bf18-210d92d35258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:10.865216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1144/2292] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:10.873835 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f779f79-9916-4eea-83b1-610d6f3269ff None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:10.874381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f779f79-9916-4eea-83b1-610d6f3269ff None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:10.874897 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f779f79-9916-4eea-83b1-610d6f3269ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:10.896568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8f779f79-9916-4eea-83b1-610d6f3269ff None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:10.898438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8f779f79-9916-4eea-83b1-610d6f3269ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:10.909503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1149/2293] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:10.912761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3285e1-cc2f-4854-bf18-210d92d35258 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:10.929825 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3285e1-cc2f-4854-bf18-210d92d35258 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:10.940317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be22e4-55b1-49de-b168-cf1bbbd27431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:10.941078 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be22e4-55b1-49de-b168-cf1bbbd27431 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:10.942050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be22e4-55b1-49de-b168-cf1bbbd27431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:10.942585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be22e4-55b1-49de-b168-cf1bbbd27431 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:10.943505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be22e4-55b1-49de-b168-cf1bbbd27431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:32:10.944010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be22e4-55b1-49de-b168-cf1bbbd27431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:10.946500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be22e4-55b1-49de-b168-cf1bbbd27431 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:10.974572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1145/2294] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:32:10.978871 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f779f79-9916-4eea-83b1-610d6f3269ff None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:10.989086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f779f79-9916-4eea-83b1-610d6f3269ff None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:10.993891 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ebdae-c09e-4d27-859d-70500c4f4fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:10.994491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ebdae-c09e-4d27-859d-70500c4f4fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:10.994773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ebdae-c09e-4d27-859d-70500c4f4fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:10.995148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ebdae-c09e-4d27-859d-70500c4f4fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:10.995690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ebdae-c09e-4d27-859d-70500c4f4fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:10.997798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ebdae-c09e-4d27-859d-70500c4f4fb7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:11.052184 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5c5ad-fe17-4622-8d5b-957504d7ae5c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:11.052466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5c5ad-fe17-4622-8d5b-957504d7ae5c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:11.052738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5c5ad-fe17-4622-8d5b-957504d7ae5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:11.079130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b1e5c5ad-fe17-4622-8d5b-957504d7ae5c None None] MFA Rules not processed for user `1398646888214f8a9ed7be5648a9a231`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:11.080544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b1e5c5ad-fe17-4622-8d5b-957504d7ae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:11.118751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1150/2295] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:32:10 2022] POST /identity/v3/projects => generated 397 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:11.119755 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ebdae-c09e-4d27-859d-70500c4f4fb7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:11.121916 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-647ebdae-c09e-4d27-859d-70500c4f4fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:11.179008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1146/2296] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:32:11.179008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d14aeb-b016-4d73-922b-8069ff49e807 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:11.179008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d14aeb-b016-4d73-922b-8069ff49e807 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:11.179008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d14aeb-b016-4d73-922b-8069ff49e807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:11.195672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c8d14aeb-b016-4d73-922b-8069ff49e807 None None] MFA Rules not processed for user `9f181af31fb245bba4158e89e58704d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:11.197051 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c8d14aeb-b016-4d73-922b-8069ff49e807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:11.201410 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ebdae-c09e-4d27-859d-70500c4f4fb7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:11.207340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd918c-fd5f-4a4b-b9fc-9574b343a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:11.208504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd918c-fd5f-4a4b-b9fc-9574b343a939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:11.210212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd918c-fd5f-4a4b-b9fc-9574b343a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:11.210570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd918c-fd5f-4a4b-b9fc-9574b343a939 admin admin] PATH_INFO: `/v3/projects/1631bc1ede2545b28480c2164ce36619` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:11.211867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd918c-fd5f-4a4b-b9fc-9574b343a939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1631bc1ede2545b28480c2164ce36619)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:11.214240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd918c-fd5f-4a4b-b9fc-9574b343a939 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:11.261113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1147/2297] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:11.262121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d14aeb-b016-4d73-922b-8069ff49e807 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:11.277850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d14aeb-b016-4d73-922b-8069ff49e807 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:11.285650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3ade7-d931-41d2-b128-7df685699aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:11.286555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3ade7-d931-41d2-b128-7df685699aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:11.287269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3ade7-d931-41d2-b128-7df685699aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:11.288037 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3ade7-d931-41d2-b128-7df685699aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:11.288873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3ade7-d931-41d2-b128-7df685699aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:11.292357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3ade7-d931-41d2-b128-7df685699aa9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:11.365734 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3acd918c-fd5f-4a4b-b9fc-9574b343a939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1631bc1ede2545b28480c2164ce36619', 'request_id': 'req-3acd918c-fd5f-4a4b-b9fc-9574b343a939'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:11.379308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3acd918c-fd5f-4a4b-b9fc-9574b343a939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1631bc1ede2545b28480c2164ce36619', 'request_id': 'req-3acd918c-fd5f-4a4b-b9fc-9574b343a939'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:11.425310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1148/2298] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:32:11 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:11.429336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3ade7-d931-41d2-b128-7df685699aa9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:11.445507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3acd918c-fd5f-4a4b-b9fc-9574b343a939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1631bc1ede2545b28480c2164ce36619', 'request_id': 'req-3acd918c-fd5f-4a4b-b9fc-9574b343a939'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:11.450810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3ade7-d931-41d2-b128-7df685699aa9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:11.465662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3acd918c-fd5f-4a4b-b9fc-9574b343a939 admin admin] The token cache is being invalidate because project 1631bc1ede2545b28480c2164ce36619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:32:11.465963 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3acd918c-fd5f-4a4b-b9fc-9574b343a939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:11.466668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3acd918c-fd5f-4a4b-b9fc-9574b343a939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:11.476183 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1151/2299] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:32:11 2022] DELETE /identity/v3/projects/1631bc1ede2545b28480c2164ce36619 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:11.484590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e00d12-2ffc-4243-a532-da3cca40c24e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:11.485314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e00d12-2ffc-4243-a532-da3cca40c24e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:11.485475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e00d12-2ffc-4243-a532-da3cca40c24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:11.551978 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a7e00d12-2ffc-4243-a532-da3cca40c24e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:11.555717 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a7e00d12-2ffc-4243-a532-da3cca40c24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:11.614075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f17b62-0e8a-44ef-9ed6-0da38818102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:11.615580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f17b62-0e8a-44ef-9ed6-0da38818102a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:11.626278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f17b62-0e8a-44ef-9ed6-0da38818102a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:11.626590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f17b62-0e8a-44ef-9ed6-0da38818102a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:11.627306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f17b62-0e8a-44ef-9ed6-0da38818102a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:11.630737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f17b62-0e8a-44ef-9ed6-0da38818102a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:11.645573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1152/2300] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:11.654460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1d184-e064-42b7-ba90-1e2f5d414fd7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:11.654805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1d184-e064-42b7-ba90-1e2f5d414fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:11.655252 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1d184-e064-42b7-ba90-1e2f5d414fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:11.656130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1149/2301] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:11.661251 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f17b62-0e8a-44ef-9ed6-0da38818102a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:11.663249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-21f17b62-0e8a-44ef-9ed6-0da38818102a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:11.678458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4ac1d184-e064-42b7-ba90-1e2f5d414fd7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:11.679569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f17b62-0e8a-44ef-9ed6-0da38818102a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:11.679698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4ac1d184-e064-42b7-ba90-1e2f5d414fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:11.685302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba356b5a-817e-4187-b3c5-18a5bdef4289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:11.691848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba356b5a-817e-4187-b3c5-18a5bdef4289 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:11.691848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba356b5a-817e-4187-b3c5-18a5bdef4289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:11.691848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba356b5a-817e-4187-b3c5-18a5bdef4289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:11.691848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba356b5a-817e-4187-b3c5-18a5bdef4289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:11.692316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1153/2302] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:11.692409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba356b5a-817e-4187-b3c5-18a5bdef4289 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:11.695010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1d184-e064-42b7-ba90-1e2f5d414fd7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:11.705766 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1d184-e064-42b7-ba90-1e2f5d414fd7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:11.707509 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1150/2303] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:11.708472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba356b5a-817e-4187-b3c5-18a5bdef4289 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:11.711536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845f336-0b11-4385-9396-e3586ac5d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:11.712141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845f336-0b11-4385-9396-e3586ac5d3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:11.712729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845f336-0b11-4385-9396-e3586ac5d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:11.713004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845f336-0b11-4385-9396-e3586ac5d3c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:11.713725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845f336-0b11-4385-9396-e3586ac5d3c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:32:11.714030 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845f336-0b11-4385-9396-e3586ac5d3c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:11.716221 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845f336-0b11-4385-9396-e3586ac5d3c4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:11.722476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba356b5a-817e-4187-b3c5-18a5bdef4289 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:11.728409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bd66a-e80a-4726-99ed-ce8be15bffbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:11.729810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bd66a-e80a-4726-99ed-ce8be15bffbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:11.730353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bd66a-e80a-4726-99ed-ce8be15bffbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:11.730860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bd66a-e80a-4726-99ed-ce8be15bffbd admin admin] PATH_INFO: `/v3/projects/111b186a0c5a41fe8c54212a1e670888/users/cb95068fb1be440197e1643fe41d20b6/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:11.732507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1154/2304] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:32:11.736813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845f336-0b11-4385-9396-e3586ac5d3c4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:11.751342 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845f336-0b11-4385-9396-e3586ac5d3c4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:11.753753 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bd66a-e80a-4726-99ed-ce8be15bffbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=111b186a0c5a41fe8c54212a1e670888, user_id=cb95068fb1be440197e1643fe41d20b6, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:11.756798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bd66a-e80a-4726-99ed-ce8be15bffbd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:11.764339 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181affc-a941-4357-9308-57696e5358f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:11.764967 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181affc-a941-4357-9308-57696e5358f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:11.766278 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181affc-a941-4357-9308-57696e5358f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:11.766278 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181affc-a941-4357-9308-57696e5358f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:11.766278 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181affc-a941-4357-9308-57696e5358f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:11.768568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181affc-a941-4357-9308-57696e5358f0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:11.864076 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1151/2305] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:32:11 2022] PUT /identity/v3/projects/111b186a0c5a41fe8c54212a1e670888/users/cb95068fb1be440197e1643fe41d20b6/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:11.865723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1155/2306] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:32:11 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:11.875744 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bd66a-e80a-4726-99ed-ce8be15bffbd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:11.944588 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860be8c-5567-43a2-9451-cc5d7fa09c7b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:11.944829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860be8c-5567-43a2-9451-cc5d7fa09c7b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:11.945101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860be8c-5567-43a2-9451-cc5d7fa09c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:11.951769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:11.979238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bd66a-e80a-4726-99ed-ce8be15bffbd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:11.983245 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b860be8c-5567-43a2-9451-cc5d7fa09c7b None None] MFA Rules not processed for user `cb95068fb1be440197e1643fe41d20b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:11.983245 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b860be8c-5567-43a2-9451-cc5d7fa09c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:12.030910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:12.044015 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2598a-e14d-4876-910e-36cc7f2e179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:12.044628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2598a-e14d-4876-910e-36cc7f2e179d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:12.044913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2598a-e14d-4876-910e-36cc7f2e179d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:12.045186 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2598a-e14d-4876-910e-36cc7f2e179d admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:12.045861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2598a-e14d-4876-910e-36cc7f2e179d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:12.047999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2598a-e14d-4876-910e-36cc7f2e179d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:12.065421 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1156/2307] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:32:12.077833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860be8c-5567-43a2-9451-cc5d7fa09c7b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:12.079910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b860be8c-5567-43a2-9451-cc5d7fa09c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:12.147296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1152/2308] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:32:11 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:12.151423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2598a-e14d-4876-910e-36cc7f2e179d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:12.164290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860be8c-5567-43a2-9451-cc5d7fa09c7b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:12.174083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d0011-e047-4036-a73e-56314caf0b3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:12.174882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2598a-e14d-4876-910e-36cc7f2e179d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:12.175266 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d0011-e047-4036-a73e-56314caf0b3f service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:12.175928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d0011-e047-4036-a73e-56314caf0b3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:12.176485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d0011-e047-4036-a73e-56314caf0b3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:12.190946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d58e65-15a9-41f8-8aa5-204a83884be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:12.191773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d58e65-15a9-41f8-8aa5-204a83884be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:12.192055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d58e65-15a9-41f8-8aa5-204a83884be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:12.192373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d0011-e047-4036-a73e-56314caf0b3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:12.194827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d58e65-15a9-41f8-8aa5-204a83884be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:12.194827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d58e65-15a9-41f8-8aa5-204a83884be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:12.195014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d0011-e047-4036-a73e-56314caf0b3f service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:12.195467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d58e65-15a9-41f8-8aa5-204a83884be1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:12.207727 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1157/2309] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:32:12.221568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d0011-e047-4036-a73e-56314caf0b3f service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:12.228313 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1153/2310] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:12.255191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d0011-e047-4036-a73e-56314caf0b3f service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:12.262928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb043fa5-1293-4588-92ff-543655a1a399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:12.262928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb043fa5-1293-4588-92ff-543655a1a399 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:12.262928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb043fa5-1293-4588-92ff-543655a1a399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:12.262928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb043fa5-1293-4588-92ff-543655a1a399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:12.263238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb043fa5-1293-4588-92ff-543655a1a399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:12.263672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb043fa5-1293-4588-92ff-543655a1a399 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:12.295848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d58e65-15a9-41f8-8aa5-204a83884be1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:12.301956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1158/2311] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:12.307556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d58e65-15a9-41f8-8aa5-204a83884be1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:12.325909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fe34b-6b16-4322-b425-813a6c32fea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:12.326586 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe34b-6b16-4322-b425-813a6c32fea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:12.326863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe34b-6b16-4322-b425-813a6c32fea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:12.327134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fe34b-6b16-4322-b425-813a6c32fea1 admin admin] PATH_INFO: `/v3/projects/9183e02163c24f178879bc9835cf057f/users/9ad2a2b0959d4a2789d1cf11f4756dd2/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:12.361680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fe34b-6b16-4322-b425-813a6c32fea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9183e02163c24f178879bc9835cf057f, user_id=9ad2a2b0959d4a2789d1cf11f4756dd2, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:12.364790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fe34b-6b16-4322-b425-813a6c32fea1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:12.477034 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1154/2312] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:32:12 2022] PUT /identity/v3/projects/9183e02163c24f178879bc9835cf057f/users/9ad2a2b0959d4a2789d1cf11f4756dd2/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:12.491376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52d9b-32f8-4900-80e2-294ac7bdd324 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:12.492600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52d9b-32f8-4900-80e2-294ac7bdd324 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:12.499092 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52d9b-32f8-4900-80e2-294ac7bdd324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:12.554596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0ed52d9b-32f8-4900-80e2-294ac7bdd324 None None] MFA Rules not processed for user `9ad2a2b0959d4a2789d1cf11f4756dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:12.555973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0ed52d9b-32f8-4900-80e2-294ac7bdd324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:12.674021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1159/2313] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:13.175723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fe34b-6b16-4322-b425-813a6c32fea1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:13.240351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fe34b-6b16-4322-b425-813a6c32fea1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:13.244282 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affe721-89a0-43a3-96d9-0dc0154d4615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:13.244885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affe721-89a0-43a3-96d9-0dc0154d4615 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:13.245175 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affe721-89a0-43a3-96d9-0dc0154d4615 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:13.245473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affe721-89a0-43a3-96d9-0dc0154d4615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:13.263242 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affe721-89a0-43a3-96d9-0dc0154d4615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:13.264775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affe721-89a0-43a3-96d9-0dc0154d4615 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:13.277017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1155/2314] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:13.953911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:14.105680 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:14.918730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed52d9b-32f8-4900-80e2-294ac7bdd324 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:14.920206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0ed52d9b-32f8-4900-80e2-294ac7bdd324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:15.073418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed52d9b-32f8-4900-80e2-294ac7bdd324 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:15.081397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:15.082460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:15.083191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:15.083700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] PATH_INFO: `/v3/users/09e15a09ac5d48d0b9a9ae5fc75f7073` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:15.084870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e15a09ac5d48d0b9a9ae5fc75f7073)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:15.086998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:15.116783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affe721-89a0-43a3-96d9-0dc0154d4615 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:15.134494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affe721-89a0-43a3-96d9-0dc0154d4615 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:15.149195 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599c20a-8dc0-4584-af60-45599853006c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:15.149853 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599c20a-8dc0-4584-af60-45599853006c service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:15.150118 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599c20a-8dc0-4584-af60-45599853006c service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:15.153470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599c20a-8dc0-4584-af60-45599853006c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:15.162751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f599c20a-8dc0-4584-af60-45599853006c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:15.274216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599c20a-8dc0-4584-af60-45599853006c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:15.280157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599c20a-8dc0-4584-af60-45599853006c service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:15.287663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1156/2315] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:32:15.449400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e15a09ac5d48d0b9a9ae5fc75f7073'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:15.545151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e15a09ac5d48d0b9a9ae5fc75f7073'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:15.545481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e15a09ac5d48d0b9a9ae5fc75f7073'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:15.546213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e15a09ac5d48d0b9a9ae5fc75f7073'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:15.564392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e15a09ac5d48d0b9a9ae5fc75f7073'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:15.591923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1160/2316] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:32:14 2022] DELETE /identity/v3/users/09e15a09ac5d48d0b9a9ae5fc75f7073 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:15.595912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5204c-de89-416c-8d6e-afcdce057993 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:15.596487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5204c-de89-416c-8d6e-afcdce057993 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:15.596765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5204c-de89-416c-8d6e-afcdce057993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:15.622335 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0bd5204c-de89-416c-8d6e-afcdce057993 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:15.623606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0bd5204c-de89-416c-8d6e-afcdce057993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:15.683946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1157/2317] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:15.693761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:15.695173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:15.754481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:15.768500 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48af2d3-e297-4f0d-97fb-3d80bb767bb4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:15.772402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f2288-449c-4008-b13e-c372bed958c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:15.773008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f2288-449c-4008-b13e-c372bed958c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:15.773344 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f2288-449c-4008-b13e-c372bed958c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:15.773591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f2288-449c-4008-b13e-c372bed958c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:15.784781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f2288-449c-4008-b13e-c372bed958c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:15.786347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f2288-449c-4008-b13e-c372bed958c9 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:15.815840 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1161/2318] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:16.618022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5204c-de89-416c-8d6e-afcdce057993 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:16.620096 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0bd5204c-de89-416c-8d6e-afcdce057993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:16.635262 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5204c-de89-416c-8d6e-afcdce057993 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:16.646686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:16.647500 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:16.647851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:16.648242 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8 admin admin] PATH_INFO: `/v3/projects/6d903a99e2b24f28aa42e34d83c155c7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:16.656146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d903a99e2b24f28aa42e34d83c155c7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:16.664723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:16.668286 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:16.678937 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f2288-449c-4008-b13e-c372bed958c9 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:16.680989 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-638f2288-449c-4008-b13e-c372bed958c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:16.702793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f2288-449c-4008-b13e-c372bed958c9 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:16.714870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acb8eb-2c26-41fb-9ca9-cde4d8a7a01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:16.715644 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb8eb-2c26-41fb-9ca9-cde4d8a7a01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:16.715932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb8eb-2c26-41fb-9ca9-cde4d8a7a01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:16.716208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb8eb-2c26-41fb-9ca9-cde4d8a7a01b admin admin] PATH_INFO: `/v3/users/9ad2a2b0959d4a2789d1cf11f4756dd2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:16.717429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acb8eb-2c26-41fb-9ca9-cde4d8a7a01b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad2a2b0959d4a2789d1cf11f4756dd2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:16.719341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acb8eb-2c26-41fb-9ca9-cde4d8a7a01b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:16.834558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d903a99e2b24f28aa42e34d83c155c7', 'request_id': 'req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:16.850444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d903a99e2b24f28aa42e34d83c155c7', 'request_id': 'req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:16.947191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d903a99e2b24f28aa42e34d83c155c7', 'request_id': 'req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:16.960085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8 admin admin] The token cache is being invalidate because project 6d903a99e2b24f28aa42e34d83c155c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:32:16.960641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:16.961531 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-940ed2f4-cd81-4e94-bf9f-282d4e2ec1b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:16.965584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-45acb8eb-2c26-41fb-9ca9-cde4d8a7a01b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad2a2b0959d4a2789d1cf11f4756dd2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:16.967236 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1158/2319] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:32:16 2022] DELETE /identity/v3/projects/6d903a99e2b24f28aa42e34d83c155c7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:16.969119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16662ee1-6d5f-496e-9852-30fa6ba96a7d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:16.969447 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16662ee1-6d5f-496e-9852-30fa6ba96a7d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:16.969888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16662ee1-6d5f-496e-9852-30fa6ba96a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:16.990575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-16662ee1-6d5f-496e-9852-30fa6ba96a7d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:16.991787 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-16662ee1-6d5f-496e-9852-30fa6ba96a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:17.030226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-45acb8eb-2c26-41fb-9ca9-cde4d8a7a01b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad2a2b0959d4a2789d1cf11f4756dd2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:17.031203 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-45acb8eb-2c26-41fb-9ca9-cde4d8a7a01b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad2a2b0959d4a2789d1cf11f4756dd2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:17.031992 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-45acb8eb-2c26-41fb-9ca9-cde4d8a7a01b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad2a2b0959d4a2789d1cf11f4756dd2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:17.040679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-45acb8eb-2c26-41fb-9ca9-cde4d8a7a01b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad2a2b0959d4a2789d1cf11f4756dd2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:17.053642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1159/2320] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:17.063904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34b0df-805d-4a3f-ba51-38c99f18a1b4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:17.064197 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34b0df-805d-4a3f-ba51-38c99f18a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:17.064522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34b0df-805d-4a3f-ba51-38c99f18a1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:17.070830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1162/2321] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:32:16 2022] DELETE /identity/v3/users/9ad2a2b0959d4a2789d1cf11f4756dd2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:17.075263 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abb9fb-09be-47c4-8741-eb405aef1ed1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:17.075809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abb9fb-09be-47c4-8741-eb405aef1ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:17.076268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abb9fb-09be-47c4-8741-eb405aef1ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:17.085674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ca34b0df-805d-4a3f-ba51-38c99f18a1b4 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:17.086983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ca34b0df-805d-4a3f-ba51-38c99f18a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:17.096256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a4abb9fb-09be-47c4-8741-eb405aef1ed1 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:17.097853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a4abb9fb-09be-47c4-8741-eb405aef1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:17.162374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1160/2322] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:32:17.164084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34b0df-805d-4a3f-ba51-38c99f18a1b4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:17.174371 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34b0df-805d-4a3f-ba51-38c99f18a1b4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:17.179261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39676f-d5e0-4435-9f06-6ba1572741d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:17.179875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39676f-d5e0-4435-9f06-6ba1572741d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:17.180159 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39676f-d5e0-4435-9f06-6ba1572741d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:17.180433 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39676f-d5e0-4435-9f06-6ba1572741d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:17.181085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39676f-d5e0-4435-9f06-6ba1572741d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:32:17.181427 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39676f-d5e0-4435-9f06-6ba1572741d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:17.183042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39676f-d5e0-4435-9f06-6ba1572741d9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:17.184760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1163/2323] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:32:17.195389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abb9fb-09be-47c4-8741-eb405aef1ed1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:17.196088 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1161/2324] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:32:17.196817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a4abb9fb-09be-47c4-8741-eb405aef1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:17.200139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39676f-d5e0-4435-9f06-6ba1572741d9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:17.210276 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39676f-d5e0-4435-9f06-6ba1572741d9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:17.217309 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee3fe6-023a-4602-88ba-11b86cb291b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:17.217884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee3fe6-023a-4602-88ba-11b86cb291b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:17.218162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee3fe6-023a-4602-88ba-11b86cb291b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:17.218434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee3fe6-023a-4602-88ba-11b86cb291b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:17.235980 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee3fe6-023a-4602-88ba-11b86cb291b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:17.239269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee3fe6-023a-4602-88ba-11b86cb291b3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:17.264692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abb9fb-09be-47c4-8741-eb405aef1ed1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:17.268744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d8309-f342-47f9-b456-c2916d96706a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:17.269409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d8309-f342-47f9-b456-c2916d96706a service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:17.269684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d8309-f342-47f9-b456-c2916d96706a service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:17.270014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d8309-f342-47f9-b456-c2916d96706a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:17.279181 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d8309-f342-47f9-b456-c2916d96706a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:17.280677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d8309-f342-47f9-b456-c2916d96706a service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:17.290862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1164/2325] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:17.347147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1162/2326] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:32:17 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:32:17.351665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d8309-f342-47f9-b456-c2916d96706a service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:17.363965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d8309-f342-47f9-b456-c2916d96706a service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:17.447664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56886ee9-7ff7-4b1d-843b-344e443986d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:17.448359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56886ee9-7ff7-4b1d-843b-344e443986d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:17.448728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56886ee9-7ff7-4b1d-843b-344e443986d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:17.449098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56886ee9-7ff7-4b1d-843b-344e443986d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:17.449836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56886ee9-7ff7-4b1d-843b-344e443986d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:17.451958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56886ee9-7ff7-4b1d-843b-344e443986d6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:17.579768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1165/2327] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:32:17 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:17.583778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee3fe6-023a-4602-88ba-11b86cb291b3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:17.626789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee3fe6-023a-4602-88ba-11b86cb291b3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:17.644675 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d401b-0511-492a-9e29-b5db5f9783c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:17.646953 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d401b-0511-492a-9e29-b5db5f9783c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:17.647383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d401b-0511-492a-9e29-b5db5f9783c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:17.647821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d401b-0511-492a-9e29-b5db5f9783c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:17.649076 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d401b-0511-492a-9e29-b5db5f9783c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:17.651803 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d401b-0511-492a-9e29-b5db5f9783c4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:17.669570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1163/2328] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:17.673991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56886ee9-7ff7-4b1d-843b-344e443986d6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:17.693473 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56886ee9-7ff7-4b1d-843b-344e443986d6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:17.705536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de49a0-5e62-49b8-9d4b-af77c27983d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:17.706166 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de49a0-5e62-49b8-9d4b-af77c27983d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:17.706446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de49a0-5e62-49b8-9d4b-af77c27983d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:17.706722 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de49a0-5e62-49b8-9d4b-af77c27983d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:17.707388 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de49a0-5e62-49b8-9d4b-af77c27983d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:17.713627 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de49a0-5e62-49b8-9d4b-af77c27983d9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:17.743426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1166/2329] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:17.745024 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d401b-0511-492a-9e29-b5db5f9783c4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:17.762890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:17.765155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d401b-0511-492a-9e29-b5db5f9783c4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:17.772267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a619e69-8fad-4529-87d1-5db6cde26a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:17.772660 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619e69-8fad-4529-87d1-5db6cde26a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:17.773099 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619e69-8fad-4529-87d1-5db6cde26a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:17.773546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619e69-8fad-4529-87d1-5db6cde26a61 admin admin] PATH_INFO: `/v3/projects/de16ff851c63404597f8b1fda1591eb3/users/681bf5823ae64521a679b8041a977cf1/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:17.796078 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a619e69-8fad-4529-87d1-5db6cde26a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de16ff851c63404597f8b1fda1591eb3, user_id=681bf5823ae64521a679b8041a977cf1, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:17.799081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a619e69-8fad-4529-87d1-5db6cde26a61 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:17.817788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de49a0-5e62-49b8-9d4b-af77c27983d9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:17.819961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-39de49a0-5e62-49b8-9d4b-af77c27983d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:17.842258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de49a0-5e62-49b8-9d4b-af77c27983d9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:17.848072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:17.848975 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:17.849252 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:17.849841 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] PATH_INFO: `/v3/projects/9183e02163c24f178879bc9835cf057f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:17.851646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9183e02163c24f178879bc9835cf057f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:17.853901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:17.905914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1164/2330] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:32:17 2022] PUT /identity/v3/projects/de16ff851c63404597f8b1fda1591eb3/users/681bf5823ae64521a679b8041a977cf1/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:17.911766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e3748-d329-48e7-83c2-aa58e6ffa0ef None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:17.912239 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e3748-d329-48e7-83c2-aa58e6ffa0ef None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:17.913933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e3748-d329-48e7-83c2-aa58e6ffa0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:17.952183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-263e3748-d329-48e7-83c2-aa58e6ffa0ef None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:17.953522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-263e3748-d329-48e7-83c2-aa58e6ffa0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:18.022484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1165/2331] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:18.035183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e3748-d329-48e7-83c2-aa58e6ffa0ef None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:18.038780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-263e3748-d329-48e7-83c2-aa58e6ffa0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:18.054898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9183e02163c24f178879bc9835cf057f', 'request_id': 'req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:18.066195 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9183e02163c24f178879bc9835cf057f', 'request_id': 'req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:18.123827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e3748-d329-48e7-83c2-aa58e6ffa0ef None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:18.139971 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9183e02163c24f178879bc9835cf057f', 'request_id': 'req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:18.171418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] The token cache is being invalidate because project 9183e02163c24f178879bc9835cf057f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:32:18.171709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:18.176736 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:18.176736 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1167/2332] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:32:17 2022] DELETE /identity/v3/projects/9183e02163c24f178879bc9835cf057f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:32:18.215092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65814430-5901-46c7-9226-3da33d86879b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:18.216068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65814430-5901-46c7-9226-3da33d86879b service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:18.216487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65814430-5901-46c7-9226-3da33d86879b service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:18.216995 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65814430-5901-46c7-9226-3da33d86879b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:18.219584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-65814430-5901-46c7-9226-3da33d86879b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:18.319642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65814430-5901-46c7-9226-3da33d86879b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:18.322607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65814430-5901-46c7-9226-3da33d86879b service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:18.341686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:18.370677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1166/2333] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:18.781580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:18.785145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:18.800476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c969f1-68cd-43cd-ac9a-a0c5c4673769 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:18.806202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:18.807118 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:18.807403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:18.807821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] PATH_INFO: `/v3/users/cb95068fb1be440197e1643fe41d20b6` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:18.809183 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb95068fb1be440197e1643fe41d20b6)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:18.811232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:19.038462 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb95068fb1be440197e1643fe41d20b6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:19.093974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb95068fb1be440197e1643fe41d20b6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:19.095437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb95068fb1be440197e1643fe41d20b6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:19.096342 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb95068fb1be440197e1643fe41d20b6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:19.120863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb95068fb1be440197e1643fe41d20b6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:19.183213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1168/2334] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:32:18 2022] DELETE /identity/v3/users/cb95068fb1be440197e1643fe41d20b6 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:32:19.187774 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8536db3-ab1a-4296-967c-f00d08ea0d2a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:19.188336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8536db3-ab1a-4296-967c-f00d08ea0d2a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:19.190156 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8536db3-ab1a-4296-967c-f00d08ea0d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:19.219169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e8536db3-ab1a-4296-967c-f00d08ea0d2a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:19.219169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e8536db3-ab1a-4296-967c-f00d08ea0d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:19.307351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1167/2335] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:19.317838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:19.319958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:19.410628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d12246-2334-4dda-89b6-e71c985db7a6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:19.414385 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1633c03-2085-41ab-86e1-532154ef93a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:19.415074 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1633c03-2085-41ab-86e1-532154ef93a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:19.415421 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1633c03-2085-41ab-86e1-532154ef93a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:19.415758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1633c03-2085-41ab-86e1-532154ef93a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:19.425623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1633c03-2085-41ab-86e1-532154ef93a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:19.427091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1633c03-2085-41ab-86e1-532154ef93a1 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:19.437514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1169/2336] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:19.753460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:20.019254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:20.428022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8536db3-ab1a-4296-967c-f00d08ea0d2a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:20.429752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e8536db3-ab1a-4296-967c-f00d08ea0d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:20.446721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8536db3-ab1a-4296-967c-f00d08ea0d2a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:20.462718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:20.463598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:20.464062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:20.464551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] PATH_INFO: `/v3/projects/111b186a0c5a41fe8c54212a1e670888` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:20.465959 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=111b186a0c5a41fe8c54212a1e670888)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:20.468694 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:20.576732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111b186a0c5a41fe8c54212a1e670888', 'request_id': 'req-95728aa7-9958-4459-9b19-cce386287ac9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:20.583487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111b186a0c5a41fe8c54212a1e670888', 'request_id': 'req-95728aa7-9958-4459-9b19-cce386287ac9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:20.688771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111b186a0c5a41fe8c54212a1e670888', 'request_id': 'req-95728aa7-9958-4459-9b19-cce386287ac9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:20.702141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] The token cache is being invalidate because project 111b186a0c5a41fe8c54212a1e670888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:32:20.702426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:20.703320 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:20.705610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1168/2337] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:32:20 2022] DELETE /identity/v3/projects/111b186a0c5a41fe8c54212a1e670888 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:20.791589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b596f5b-1efd-4372-ba0c-ab39d377441a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:20.792159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b596f5b-1efd-4372-ba0c-ab39d377441a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:20.792502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b596f5b-1efd-4372-ba0c-ab39d377441a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:20.841721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1b596f5b-1efd-4372-ba0c-ab39d377441a None None] MFA Rules not processed for user `681bf5823ae64521a679b8041a977cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:20.844186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1b596f5b-1efd-4372-ba0c-ab39d377441a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:20.927929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1170/2338] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:20.941673 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:20.942345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:21.009684 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95728aa7-9958-4459-9b19-cce386287ac9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:21.013863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbc720-4655-4323-b532-b5843e03815d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:21.014476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbc720-4655-4323-b532-b5843e03815d service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:21.014750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbc720-4655-4323-b532-b5843e03815d service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:21.015019 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbc720-4655-4323-b532-b5843e03815d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:21.024772 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbc720-4655-4323-b532-b5843e03815d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:21.026244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbc720-4655-4323-b532-b5843e03815d service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:21.036679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1169/2339] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:21.065416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:22.941223 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77711b8-4948-4b54-9909-4ebe47fb7973 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:22.941749 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77711b8-4948-4b54-9909-4ebe47fb7973 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:22.941844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77711b8-4948-4b54-9909-4ebe47fb7973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:22.960845 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a77711b8-4948-4b54-9909-4ebe47fb7973 None None] MFA Rules not processed for user `681bf5823ae64521a679b8041a977cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:22.962315 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a77711b8-4948-4b54-9909-4ebe47fb7973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:22.969133 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1171/2340] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:32.889658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:32.955492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:41.178801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbc720-4655-4323-b532-b5843e03815d service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:41.180349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-87dbc720-4655-4323-b532-b5843e03815d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:41.248833 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbc720-4655-4323-b532-b5843e03815d service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:41.253939 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:41.254587 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:41.254839 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:41.255112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] PATH_INFO: `/v3/users/1fe3fe8a735a4febb306c09ea319293d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:41.256221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe3fe8a735a4febb306c09ea319293d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:41.258207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:41.444392 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe3fe8a735a4febb306c09ea319293d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:41.445066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe3fe8a735a4febb306c09ea319293d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:41.445690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe3fe8a735a4febb306c09ea319293d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:41.452727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe3fe8a735a4febb306c09ea319293d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:41.465001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe3fe8a735a4febb306c09ea319293d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:41.526190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1170/2341] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:32:41 2022] DELETE /identity/v3/users/1fe3fe8a735a4febb306c09ea319293d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:41.764774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77711b8-4948-4b54-9909-4ebe47fb7973 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:41.790785 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77711b8-4948-4b54-9909-4ebe47fb7973 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:41.850019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:41.850689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:41.850964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:41.851234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] PATH_INFO: `/v3/projects/930e53b525124324b6b86a3a884704fb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:41.852372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=930e53b525124324b6b86a3a884704fb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:41.854311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:41.953565 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930e53b525124324b6b86a3a884704fb', 'request_id': 'req-ba828413-47f1-4869-96e2-7093eb81ce45'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:41.960331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930e53b525124324b6b86a3a884704fb', 'request_id': 'req-ba828413-47f1-4869-96e2-7093eb81ce45'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.020150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930e53b525124324b6b86a3a884704fb', 'request_id': 'req-ba828413-47f1-4869-96e2-7093eb81ce45'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.031897 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] The token cache is being invalidate because project 930e53b525124324b6b86a3a884704fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:32:42.032117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.032738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.034251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1172/2342] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:32:41 2022] DELETE /identity/v3/projects/930e53b525124324b6b86a3a884704fb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:42.038318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:42.039761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:42.054507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f5282-c43f-4f13-a70f-b8a61002917f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:42.112375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c2012-5d0d-4318-a0e6-11c49c1921af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:42.113006 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c2012-5d0d-4318-a0e6-11c49c1921af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:42.113319 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c2012-5d0d-4318-a0e6-11c49c1921af admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:42.113595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c2012-5d0d-4318-a0e6-11c49c1921af admin admin] PATH_INFO: `/v3/users/235511f3535d4dccb5b6539d69344cc3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:42.114741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c2012-5d0d-4318-a0e6-11c49c1921af admin admin] RBAC: Authorizing `identity:delete_user(user_id=235511f3535d4dccb5b6539d69344cc3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:42.116711 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c2012-5d0d-4318-a0e6-11c49c1921af admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:42.137742 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:42.315144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-121c2012-5d0d-4318-a0e6-11c49c1921af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235511f3535d4dccb5b6539d69344cc3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.315845 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-121c2012-5d0d-4318-a0e6-11c49c1921af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235511f3535d4dccb5b6539d69344cc3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.316462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-121c2012-5d0d-4318-a0e6-11c49c1921af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235511f3535d4dccb5b6539d69344cc3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.323792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-121c2012-5d0d-4318-a0e6-11c49c1921af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235511f3535d4dccb5b6539d69344cc3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.336595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-121c2012-5d0d-4318-a0e6-11c49c1921af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235511f3535d4dccb5b6539d69344cc3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.403867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1171/2343] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:32:42 2022] DELETE /identity/v3/users/235511f3535d4dccb5b6539d69344cc3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:32:42.673317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:42.674830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:42.688692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba828413-47f1-4869-96e2-7093eb81ce45 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:42.751864 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e2b32-d337-48cb-94bc-4c8d7f6045bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:42.752465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e2b32-d337-48cb-94bc-4c8d7f6045bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:42.752775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e2b32-d337-48cb-94bc-4c8d7f6045bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:42.753069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e2b32-d337-48cb-94bc-4c8d7f6045bc admin admin] PATH_INFO: `/v3/projects/c85ffb5bbda345c3997c583eca28bf19` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:42.754337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e2b32-d337-48cb-94bc-4c8d7f6045bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c85ffb5bbda345c3997c583eca28bf19)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:42.756298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e2b32-d337-48cb-94bc-4c8d7f6045bc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:42.871518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:42.883914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-540e2b32-d337-48cb-94bc-4c8d7f6045bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c85ffb5bbda345c3997c583eca28bf19', 'request_id': 'req-540e2b32-d337-48cb-94bc-4c8d7f6045bc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.890177 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-540e2b32-d337-48cb-94bc-4c8d7f6045bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c85ffb5bbda345c3997c583eca28bf19', 'request_id': 'req-540e2b32-d337-48cb-94bc-4c8d7f6045bc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.939905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-540e2b32-d337-48cb-94bc-4c8d7f6045bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c85ffb5bbda345c3997c583eca28bf19', 'request_id': 'req-540e2b32-d337-48cb-94bc-4c8d7f6045bc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.950870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-540e2b32-d337-48cb-94bc-4c8d7f6045bc admin admin] The token cache is being invalidate because project c85ffb5bbda345c3997c583eca28bf19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:32:42.951496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-540e2b32-d337-48cb-94bc-4c8d7f6045bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.952639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-540e2b32-d337-48cb-94bc-4c8d7f6045bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:42.954213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1173/2344] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:32:42 2022] DELETE /identity/v3/projects/c85ffb5bbda345c3997c583eca28bf19 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:42.958992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127b2d3-1f1b-424d-a096-5a011b451b49 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:42.959268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127b2d3-1f1b-424d-a096-5a011b451b49 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:42.959535 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127b2d3-1f1b-424d-a096-5a011b451b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:42.980658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0127b2d3-1f1b-424d-a096-5a011b451b49 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:42.982102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0127b2d3-1f1b-424d-a096-5a011b451b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:43.043429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1172/2345] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:43.051980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a9406-b215-45ee-b6a7-e45dff75da8d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:43.052266 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a9406-b215-45ee-b6a7-e45dff75da8d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:43.052538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a9406-b215-45ee-b6a7-e45dff75da8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:43.072537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ba0a9406-b215-45ee-b6a7-e45dff75da8d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:43.073782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ba0a9406-b215-45ee-b6a7-e45dff75da8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:43.081698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1174/2346] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:43.086185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127b2d3-1f1b-424d-a096-5a011b451b49 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:43.096293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127b2d3-1f1b-424d-a096-5a011b451b49 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:43.100758 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f7f17-4834-4800-b511-ee140aeac72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:43.101382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f7f17-4834-4800-b511-ee140aeac72c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:43.101656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f7f17-4834-4800-b511-ee140aeac72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:43.101921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f7f17-4834-4800-b511-ee140aeac72c admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:43.102554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f7f17-4834-4800-b511-ee140aeac72c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:32:43.102849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f7f17-4834-4800-b511-ee140aeac72c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:43.104416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f7f17-4834-4800-b511-ee140aeac72c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:43.119369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1173/2347] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:32:43.123152 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a9406-b215-45ee-b6a7-e45dff75da8d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:43.132679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a9406-b215-45ee-b6a7-e45dff75da8d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:43.137431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8a162-dcb3-45e4-b158-eecaebe325d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:43.138032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8a162-dcb3-45e4-b158-eecaebe325d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:43.138313 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8a162-dcb3-45e4-b158-eecaebe325d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:43.140802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8a162-dcb3-45e4-b158-eecaebe325d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:43.140802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8a162-dcb3-45e4-b158-eecaebe325d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:43.141223 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8a162-dcb3-45e4-b158-eecaebe325d0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:43.305584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1175/2348] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:32:43 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:43.309717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f7f17-4834-4800-b511-ee140aeac72c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:43.320044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f7f17-4834-4800-b511-ee140aeac72c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:43.377444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e277d9-d955-4e72-9191-238dabea06ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:43.378059 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e277d9-d955-4e72-9191-238dabea06ab admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:43.378338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e277d9-d955-4e72-9191-238dabea06ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:43.378612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e277d9-d955-4e72-9191-238dabea06ab admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:43.379236 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e277d9-d955-4e72-9191-238dabea06ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:43.381165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e277d9-d955-4e72-9191-238dabea06ab admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:43.477676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1174/2349] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:32:43 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:43.485853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8a162-dcb3-45e4-b158-eecaebe325d0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:43.492161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8a162-dcb3-45e4-b158-eecaebe325d0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:43.496804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c34cbe-222e-4b6f-9060-bd581a87961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:43.497469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34cbe-222e-4b6f-9060-bd581a87961e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:43.497739 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34cbe-222e-4b6f-9060-bd581a87961e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:43.498004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34cbe-222e-4b6f-9060-bd581a87961e admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:43.498631 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c34cbe-222e-4b6f-9060-bd581a87961e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:43.500219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c34cbe-222e-4b6f-9060-bd581a87961e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:43.510558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1176/2350] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:43.514575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e277d9-d955-4e72-9191-238dabea06ab admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:43.525325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e277d9-d955-4e72-9191-238dabea06ab admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:43.530064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af89b6e-530c-4960-a1b8-fde8b39c48cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:43.531305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89b6e-530c-4960-a1b8-fde8b39c48cc admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:43.531589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89b6e-530c-4960-a1b8-fde8b39c48cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:43.531864 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af89b6e-530c-4960-a1b8-fde8b39c48cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:43.532510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af89b6e-530c-4960-a1b8-fde8b39c48cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:43.534228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af89b6e-530c-4960-a1b8-fde8b39c48cc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:43.544938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1175/2351] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:43.549044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c34cbe-222e-4b6f-9060-bd581a87961e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:43.559251 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c34cbe-222e-4b6f-9060-bd581a87961e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:43.564164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4033f-b624-413e-9fc4-9ec323a9d926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:43.564817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4033f-b624-413e-9fc4-9ec323a9d926 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:43.565097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4033f-b624-413e-9fc4-9ec323a9d926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:43.565407 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4033f-b624-413e-9fc4-9ec323a9d926 admin admin] PATH_INFO: `/v3/projects/a7389dce9c5f479e96c900f8735e3976/users/0d32aa176c244d068da4e22fce49b79b/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:43.580772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4033f-b624-413e-9fc4-9ec323a9d926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7389dce9c5f479e96c900f8735e3976, user_id=0d32aa176c244d068da4e22fce49b79b, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:43.583741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4033f-b624-413e-9fc4-9ec323a9d926 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:43.683317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1177/2352] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:32:43 2022] PUT /identity/v3/projects/a7389dce9c5f479e96c900f8735e3976/users/0d32aa176c244d068da4e22fce49b79b/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:43.694611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556cebe-d0a0-4d5a-9f16-f2384abcc8ac None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:43.695010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556cebe-d0a0-4d5a-9f16-f2384abcc8ac None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:43.695352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556cebe-d0a0-4d5a-9f16-f2384abcc8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:43.704117 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:43.724099 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9556cebe-d0a0-4d5a-9f16-f2384abcc8ac None None] MFA Rules not processed for user `0d32aa176c244d068da4e22fce49b79b`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:43.725328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9556cebe-d0a0-4d5a-9f16-f2384abcc8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:43.791852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1176/2353] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:43.802931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4033f-b624-413e-9fc4-9ec323a9d926 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:43.804614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7ee4033f-b624-413e-9fc4-9ec323a9d926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:43.863824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4033f-b624-413e-9fc4-9ec323a9d926 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:43.867759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2a41e-b510-4d60-94f1-5349813b280c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:43.868370 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2a41e-b510-4d60-94f1-5349813b280c service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:43.868652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2a41e-b510-4d60-94f1-5349813b280c service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:43.868924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2a41e-b510-4d60-94f1-5349813b280c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:43.878477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2a41e-b510-4d60-94f1-5349813b280c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:43.880057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2a41e-b510-4d60-94f1-5349813b280c service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:43.891714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1178/2354] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:47.867902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556cebe-d0a0-4d5a-9f16-f2384abcc8ac None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:47.932713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556cebe-d0a0-4d5a-9f16-f2384abcc8ac None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:47.937342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:47.937967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:47.938245 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:47.938513 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] PATH_INFO: `/v3/users/0d32aa176c244d068da4e22fce49b79b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:47.939630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d32aa176c244d068da4e22fce49b79b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:47.941698 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:48.119144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d32aa176c244d068da4e22fce49b79b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:48.119922 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d32aa176c244d068da4e22fce49b79b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:48.120531 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d32aa176c244d068da4e22fce49b79b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:48.127447 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d32aa176c244d068da4e22fce49b79b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:48.146235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d32aa176c244d068da4e22fce49b79b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:48.248595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1177/2355] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:32:47 2022] DELETE /identity/v3/users/0d32aa176c244d068da4e22fce49b79b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:48.253982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbd61f-1895-45c3-b8b0-007f38871b7d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:48.254487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbd61f-1895-45c3-b8b0-007f38871b7d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:48.254581 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbd61f-1895-45c3-b8b0-007f38871b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:48.273998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-aebbd61f-1895-45c3-b8b0-007f38871b7d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:48.275260 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aebbd61f-1895-45c3-b8b0-007f38871b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:48.326648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:48.335776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1179/2356] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:48.345843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:48.347341 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:48.362215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:48.409436 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3b351-a4a5-4296-9c9c-3b95f2d64fd4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:48.413067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa90c6-73db-45d1-a1be-76bcca82e440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:48.413713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa90c6-73db-45d1-a1be-76bcca82e440 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:48.413987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa90c6-73db-45d1-a1be-76bcca82e440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:48.414258 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa90c6-73db-45d1-a1be-76bcca82e440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:48.423358 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa90c6-73db-45d1-a1be-76bcca82e440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:48.424914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa90c6-73db-45d1-a1be-76bcca82e440 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:48.436377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1178/2357] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:48.879224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbd61f-1895-45c3-b8b0-007f38871b7d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:48.881038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aebbd61f-1895-45c3-b8b0-007f38871b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:48.893761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbd61f-1895-45c3-b8b0-007f38871b7d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:48.898723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339e55b-1255-4f12-9237-9c3ad344c91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:48.899357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339e55b-1255-4f12-9237-9c3ad344c91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:48.899633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339e55b-1255-4f12-9237-9c3ad344c91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:48.899900 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339e55b-1255-4f12-9237-9c3ad344c91e admin admin] PATH_INFO: `/v3/projects/a7389dce9c5f479e96c900f8735e3976` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:48.901004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339e55b-1255-4f12-9237-9c3ad344c91e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7389dce9c5f479e96c900f8735e3976)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:48.903635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339e55b-1255-4f12-9237-9c3ad344c91e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:49.003934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0339e55b-1255-4f12-9237-9c3ad344c91e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7389dce9c5f479e96c900f8735e3976', 'request_id': 'req-0339e55b-1255-4f12-9237-9c3ad344c91e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:49.010378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0339e55b-1255-4f12-9237-9c3ad344c91e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7389dce9c5f479e96c900f8735e3976', 'request_id': 'req-0339e55b-1255-4f12-9237-9c3ad344c91e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:49.077095 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0339e55b-1255-4f12-9237-9c3ad344c91e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7389dce9c5f479e96c900f8735e3976', 'request_id': 'req-0339e55b-1255-4f12-9237-9c3ad344c91e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:49.089195 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0339e55b-1255-4f12-9237-9c3ad344c91e admin admin] The token cache is being invalidate because project a7389dce9c5f479e96c900f8735e3976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:32:49.089510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0339e55b-1255-4f12-9237-9c3ad344c91e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:49.090291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0339e55b-1255-4f12-9237-9c3ad344c91e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:49.091781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1180/2358] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:32:48 2022] DELETE /identity/v3/projects/a7389dce9c5f479e96c900f8735e3976 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:49.097941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae064a-571d-4bf5-9c68-25acf3a15723 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:49.099823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae064a-571d-4bf5-9c68-25acf3a15723 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:49.099823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae064a-571d-4bf5-9c68-25acf3a15723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:49.118986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f3ae064a-571d-4bf5-9c68-25acf3a15723 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:49.120305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f3ae064a-571d-4bf5-9c68-25acf3a15723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:49.188550 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1179/2359] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:49.196437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f33c84-d2b0-43d3-9c40-6b98117c3356 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:49.196724 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f33c84-d2b0-43d3-9c40-6b98117c3356 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:49.197001 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f33c84-d2b0-43d3-9c40-6b98117c3356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:49.217754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-16f33c84-d2b0-43d3-9c40-6b98117c3356 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:49.218969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-16f33c84-d2b0-43d3-9c40-6b98117c3356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:49.227681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1181/2360] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:32:49.231912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae064a-571d-4bf5-9c68-25acf3a15723 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:49.243081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae064a-571d-4bf5-9c68-25acf3a15723 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:49.247631 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954ba21-7cbc-4aae-bcf0-342b910a9bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:49.248227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954ba21-7cbc-4aae-bcf0-342b910a9bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:49.248507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954ba21-7cbc-4aae-bcf0-342b910a9bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:49.248782 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954ba21-7cbc-4aae-bcf0-342b910a9bd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:49.249463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954ba21-7cbc-4aae-bcf0-342b910a9bd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:32:49.249771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954ba21-7cbc-4aae-bcf0-342b910a9bd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:49.251363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954ba21-7cbc-4aae-bcf0-342b910a9bd0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:49.263185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1180/2361] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:32:49.267587 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f33c84-d2b0-43d3-9c40-6b98117c3356 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:49.277052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f33c84-d2b0-43d3-9c40-6b98117c3356 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:49.281800 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea989c3b-aa35-46d9-a17a-72af2cc79dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:49.282392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea989c3b-aa35-46d9-a17a-72af2cc79dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:49.282675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea989c3b-aa35-46d9-a17a-72af2cc79dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:49.282980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea989c3b-aa35-46d9-a17a-72af2cc79dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:49.283619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea989c3b-aa35-46d9-a17a-72af2cc79dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:49.286050 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea989c3b-aa35-46d9-a17a-72af2cc79dc4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:49.364630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1182/2362] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:32:49 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:49.368618 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954ba21-7cbc-4aae-bcf0-342b910a9bd0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:49.378888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954ba21-7cbc-4aae-bcf0-342b910a9bd0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:49.436691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42953703-3e0c-4354-a9be-5cdfccb88cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:49.437316 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42953703-3e0c-4354-a9be-5cdfccb88cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:49.437599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42953703-3e0c-4354-a9be-5cdfccb88cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:49.437872 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42953703-3e0c-4354-a9be-5cdfccb88cd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:49.438514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42953703-3e0c-4354-a9be-5cdfccb88cd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:49.440517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42953703-3e0c-4354-a9be-5cdfccb88cd2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:49.514828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1181/2363] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:32:49 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:49.519522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea989c3b-aa35-46d9-a17a-72af2cc79dc4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:49.529981 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea989c3b-aa35-46d9-a17a-72af2cc79dc4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:49.535580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384346c-7ff6-4e1f-911d-90ab8da11e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:49.536187 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384346c-7ff6-4e1f-911d-90ab8da11e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:49.536481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384346c-7ff6-4e1f-911d-90ab8da11e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:49.536752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384346c-7ff6-4e1f-911d-90ab8da11e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:49.537465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384346c-7ff6-4e1f-911d-90ab8da11e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:49.539107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384346c-7ff6-4e1f-911d-90ab8da11e92 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:49.550541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1183/2364] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:49.555226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42953703-3e0c-4354-a9be-5cdfccb88cd2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:49.565383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42953703-3e0c-4354-a9be-5cdfccb88cd2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:49.570564 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf76e2-6035-4e77-b65e-216c93c36007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:49.571314 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf76e2-6035-4e77-b65e-216c93c36007 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:49.571615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf76e2-6035-4e77-b65e-216c93c36007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:49.571895 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf76e2-6035-4e77-b65e-216c93c36007 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:49.572810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf76e2-6035-4e77-b65e-216c93c36007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:49.575230 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf76e2-6035-4e77-b65e-216c93c36007 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:49.588804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1182/2365] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:49.593017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384346c-7ff6-4e1f-911d-90ab8da11e92 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:49.604343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384346c-7ff6-4e1f-911d-90ab8da11e92 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:49.608965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baca74-d573-4567-82a4-cc912c3b7610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:49.609648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baca74-d573-4567-82a4-cc912c3b7610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:49.609930 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baca74-d573-4567-82a4-cc912c3b7610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:49.610202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baca74-d573-4567-82a4-cc912c3b7610 admin admin] PATH_INFO: `/v3/projects/f14327c8a72940a7bd8ddfcac0036407/users/64f4eb6d90eb4226b3debb1f5963682e/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:49.624524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5baca74-d573-4567-82a4-cc912c3b7610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14327c8a72940a7bd8ddfcac0036407, user_id=64f4eb6d90eb4226b3debb1f5963682e, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:49.627214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5baca74-d573-4567-82a4-cc912c3b7610 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:49.720425 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1184/2366] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:32:49 2022] PUT /identity/v3/projects/f14327c8a72940a7bd8ddfcac0036407/users/64f4eb6d90eb4226b3debb1f5963682e/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:49.731717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bd70a-80ca-42f8-8b58-3a7029ecf556 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:49.731998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bd70a-80ca-42f8-8b58-3a7029ecf556 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:49.732272 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bd70a-80ca-42f8-8b58-3a7029ecf556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:49.762261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-272bd70a-80ca-42f8-8b58-3a7029ecf556 None None] MFA Rules not processed for user `64f4eb6d90eb4226b3debb1f5963682e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:49.763484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-272bd70a-80ca-42f8-8b58-3a7029ecf556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:49.773145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:49.828935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1183/2367] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:49.842097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baca74-d573-4567-82a4-cc912c3b7610 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:49.843862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d5baca74-d573-4567-82a4-cc912c3b7610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:49.902300 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baca74-d573-4567-82a4-cc912c3b7610 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:49.905942 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f4eea-1a1e-46ee-a806-3f4c52e90f7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:49.906541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4eea-1a1e-46ee-a806-3f4c52e90f7a service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:49.906850 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4eea-1a1e-46ee-a806-3f4c52e90f7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:49.907120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4eea-1a1e-46ee-a806-3f4c52e90f7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:49.915621 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f4eea-1a1e-46ee-a806-3f4c52e90f7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:49.917144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f4eea-1a1e-46ee-a806-3f4c52e90f7a service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:49.926641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1185/2368] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:49.950783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bd70a-80ca-42f8-8b58-3a7029ecf556 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:50.012827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bd70a-80ca-42f8-8b58-3a7029ecf556 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:50.017349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:50.017975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:50.018249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:50.019061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] PATH_INFO: `/v3/users/64f4eb6d90eb4226b3debb1f5963682e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:50.020181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f4eb6d90eb4226b3debb1f5963682e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:50.022126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:50.205791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f4eb6d90eb4226b3debb1f5963682e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:50.206810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f4eb6d90eb4226b3debb1f5963682e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:50.207489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f4eb6d90eb4226b3debb1f5963682e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:50.217002 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f4eb6d90eb4226b3debb1f5963682e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:50.229023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f4eb6d90eb4226b3debb1f5963682e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:50.325737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1184/2369] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:32:49 2022] DELETE /identity/v3/users/64f4eb6d90eb4226b3debb1f5963682e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:32:50.330253 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b3297-dd51-4bae-917d-8ae2221fcaee None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:50.330764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b3297-dd51-4bae-917d-8ae2221fcaee None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:50.330910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b3297-dd51-4bae-917d-8ae2221fcaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:50.350544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a50b3297-dd51-4bae-917d-8ae2221fcaee None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:50.351762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a50b3297-dd51-4bae-917d-8ae2221fcaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:50.368340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:50.412276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1186/2370] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:50.422112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:50.423529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:50.459151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:50.482475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84756ea-9ef3-40cf-b6d1-005b5fe8d756 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:50.486144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3c7f6-7ed4-43bc-aeac-bcc61f4fc8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:50.486748 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3c7f6-7ed4-43bc-aeac-bcc61f4fc8ff service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:50.487025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3c7f6-7ed4-43bc-aeac-bcc61f4fc8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:50.487920 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3c7f6-7ed4-43bc-aeac-bcc61f4fc8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:50.498352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3c7f6-7ed4-43bc-aeac-bcc61f4fc8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:50.500743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3c7f6-7ed4-43bc-aeac-bcc61f4fc8ff service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:50.509677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1185/2371] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:50.910779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b3297-dd51-4bae-917d-8ae2221fcaee None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:50.912341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a50b3297-dd51-4bae-917d-8ae2221fcaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:50.928584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b3297-dd51-4bae-917d-8ae2221fcaee None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:50.933945 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d283cc1-bc39-4e9d-9a94-7162fab0020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:50.934682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d283cc1-bc39-4e9d-9a94-7162fab0020a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:50.935076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d283cc1-bc39-4e9d-9a94-7162fab0020a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:50.935230 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d283cc1-bc39-4e9d-9a94-7162fab0020a admin admin] PATH_INFO: `/v3/projects/f14327c8a72940a7bd8ddfcac0036407` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:50.936404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d283cc1-bc39-4e9d-9a94-7162fab0020a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14327c8a72940a7bd8ddfcac0036407)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:50.938446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d283cc1-bc39-4e9d-9a94-7162fab0020a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:51.087813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7d283cc1-bc39-4e9d-9a94-7162fab0020a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14327c8a72940a7bd8ddfcac0036407', 'request_id': 'req-7d283cc1-bc39-4e9d-9a94-7162fab0020a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:51.094039 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7d283cc1-bc39-4e9d-9a94-7162fab0020a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14327c8a72940a7bd8ddfcac0036407', 'request_id': 'req-7d283cc1-bc39-4e9d-9a94-7162fab0020a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:51.185223 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7d283cc1-bc39-4e9d-9a94-7162fab0020a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14327c8a72940a7bd8ddfcac0036407', 'request_id': 'req-7d283cc1-bc39-4e9d-9a94-7162fab0020a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:51.197739 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7d283cc1-bc39-4e9d-9a94-7162fab0020a admin admin] The token cache is being invalidate because project f14327c8a72940a7bd8ddfcac0036407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:32:51.198031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7d283cc1-bc39-4e9d-9a94-7162fab0020a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:51.198721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7d283cc1-bc39-4e9d-9a94-7162fab0020a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:32:51.200238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1187/2372] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:32:50 2022] DELETE /identity/v3/projects/f14327c8a72940a7bd8ddfcac0036407 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:32:51.205096 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697f445-328d-4127-8895-3f23a66df0ef None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:51.205416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697f445-328d-4127-8895-3f23a66df0ef None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:51.205726 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697f445-328d-4127-8895-3f23a66df0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:51.225864 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1697f445-328d-4127-8895-3f23a66df0ef None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:51.227045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1697f445-328d-4127-8895-3f23a66df0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:51.293787 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1186/2373] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:51.301516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6f005-067e-43cd-8f24-f9cbc3e119fd None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:51.301833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6f005-067e-43cd-8f24-f9cbc3e119fd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:51.302106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6f005-067e-43cd-8f24-f9cbc3e119fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:51.322106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0cd6f005-067e-43cd-8f24-f9cbc3e119fd None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:51.323323 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0cd6f005-067e-43cd-8f24-f9cbc3e119fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:51.331891 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1188/2374] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:51.336501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697f445-328d-4127-8895-3f23a66df0ef None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:51.346337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697f445-328d-4127-8895-3f23a66df0ef None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:51.350974 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fd09c-77aa-42da-9990-c097e7db4246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:51.351565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fd09c-77aa-42da-9990-c097e7db4246 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:51.351840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fd09c-77aa-42da-9990-c097e7db4246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:51.352124 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fd09c-77aa-42da-9990-c097e7db4246 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:51.352748 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fd09c-77aa-42da-9990-c097e7db4246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:32:51.353046 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fd09c-77aa-42da-9990-c097e7db4246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:51.354672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fd09c-77aa-42da-9990-c097e7db4246 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:51.366665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1187/2375] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:32:51.371062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6f005-067e-43cd-8f24-f9cbc3e119fd None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:51.380845 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6f005-067e-43cd-8f24-f9cbc3e119fd None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:51.385659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f971f6-e922-4265-8f24-3ae9bbc6f600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:51.386250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f971f6-e922-4265-8f24-3ae9bbc6f600 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:51.386528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f971f6-e922-4265-8f24-3ae9bbc6f600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:51.386799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f971f6-e922-4265-8f24-3ae9bbc6f600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:51.387420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f971f6-e922-4265-8f24-3ae9bbc6f600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:51.389331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f971f6-e922-4265-8f24-3ae9bbc6f600 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:51.476415 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1189/2376] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:32:51 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:51.480156 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fd09c-77aa-42da-9990-c097e7db4246 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:51.490558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fd09c-77aa-42da-9990-c097e7db4246 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:51.546599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27912e0b-0184-4907-a904-b2beb5070942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:51.547611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27912e0b-0184-4907-a904-b2beb5070942 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:51.547611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27912e0b-0184-4907-a904-b2beb5070942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:51.547805 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27912e0b-0184-4907-a904-b2beb5070942 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:51.548339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27912e0b-0184-4907-a904-b2beb5070942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:51.550815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27912e0b-0184-4907-a904-b2beb5070942 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:51.614446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1188/2377] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:32:51 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:32:51.618552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f971f6-e922-4265-8f24-3ae9bbc6f600 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:51.629459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f971f6-e922-4265-8f24-3ae9bbc6f600 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:51.634268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223b571-a072-48b0-b181-f327e45d307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:51.634919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223b571-a072-48b0-b181-f327e45d307e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:51.635309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223b571-a072-48b0-b181-f327e45d307e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:51.635589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223b571-a072-48b0-b181-f327e45d307e admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:51.636224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223b571-a072-48b0-b181-f327e45d307e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:51.638146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223b571-a072-48b0-b181-f327e45d307e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:51.648740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1190/2378] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:51.652749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27912e0b-0184-4907-a904-b2beb5070942 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:51.663103 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27912e0b-0184-4907-a904-b2beb5070942 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:51.667717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2cc9-bc19-4a25-a62c-c51461fb55e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:51.668392 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2cc9-bc19-4a25-a62c-c51461fb55e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:51.668678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2cc9-bc19-4a25-a62c-c51461fb55e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:51.668954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2cc9-bc19-4a25-a62c-c51461fb55e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:51.669634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b2cc9-bc19-4a25-a62c-c51461fb55e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:51.671488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b2cc9-bc19-4a25-a62c-c51461fb55e8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:51.682842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1189/2379] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:32:51.686783 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223b571-a072-48b0-b181-f327e45d307e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:51.697692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223b571-a072-48b0-b181-f327e45d307e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:51.702280 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a7741-08c6-4fdf-b12b-66c235f3d445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:51.702921 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a7741-08c6-4fdf-b12b-66c235f3d445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:51.703201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a7741-08c6-4fdf-b12b-66c235f3d445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:51.703475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a7741-08c6-4fdf-b12b-66c235f3d445 admin admin] PATH_INFO: `/v3/projects/c3546d059d4e45439adf3ba0e40512ce/users/4abeb30d77044a279b0f34149cfee3ed/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:51.718122 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a7741-08c6-4fdf-b12b-66c235f3d445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3546d059d4e45439adf3ba0e40512ce, user_id=4abeb30d77044a279b0f34149cfee3ed, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:51.720786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a7741-08c6-4fdf-b12b-66c235f3d445 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:51.779911 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1191/2380] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:32:51 2022] PUT /identity/v3/projects/c3546d059d4e45439adf3ba0e40512ce/users/4abeb30d77044a279b0f34149cfee3ed/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:32:51.790305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf867a-6f31-4558-9e94-3214f8794db7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:51.790592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf867a-6f31-4558-9e94-3214f8794db7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:51.790870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf867a-6f31-4558-9e94-3214f8794db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:51.819222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a3bf867a-6f31-4558-9e94-3214f8794db7 None None] MFA Rules not processed for user `4abeb30d77044a279b0f34149cfee3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:51.820474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a3bf867a-6f31-4558-9e94-3214f8794db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:51.848681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:51.883384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1190/2381] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:32:51.894019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a7741-08c6-4fdf-b12b-66c235f3d445 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:32:51.895668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d64a7741-08c6-4fdf-b12b-66c235f3d445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:51.940513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:32:51.952064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a7741-08c6-4fdf-b12b-66c235f3d445 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:32:51.955993 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fb053-7877-4e1d-aed2-d2e52d431d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:32:51.956762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fb053-7877-4e1d-aed2-d2e52d431d87 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:51.957164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fb053-7877-4e1d-aed2-d2e52d431d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:51.957539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fb053-7877-4e1d-aed2-d2e52d431d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:51.968752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fb053-7877-4e1d-aed2-d2e52d431d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:32:51.970335 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fb053-7877-4e1d-aed2-d2e52d431d87 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:32:51.981438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1192/2382] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:32:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:32:53.696796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc51b77-8384-4b6f-a181-5ce78c9c390f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:32:53.697295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc51b77-8384-4b6f-a181-5ce78c9c390f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:32:53.697413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc51b77-8384-4b6f-a181-5ce78c9c390f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:32:53.717197 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bfc51b77-8384-4b6f-a181-5ce78c9c390f None None] MFA Rules not processed for user `4abeb30d77044a279b0f34149cfee3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:32:53.718423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bfc51b77-8384-4b6f-a181-5ce78c9c390f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:32:53.725719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1191/2383] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:32:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:33:00.711614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cdd73-8fc4-4860-94a8-492e4322eacd None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:00.712246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cdd73-8fc4-4860-94a8-492e4322eacd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:00.712246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cdd73-8fc4-4860-94a8-492e4322eacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:00.732256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-810cdd73-8fc4-4860-94a8-492e4322eacd None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:00.733781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-810cdd73-8fc4-4860-94a8-492e4322eacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:00.791288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1193/2384] 10.222.0.55 () {58 vars in 1016 bytes} [Tue Sep 13 03:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:33:00.806643 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc51b77-8384-4b6f-a181-5ce78c9c390f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:00.808075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bfc51b77-8384-4b6f-a181-5ce78c9c390f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:00.880514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc51b77-8384-4b6f-a181-5ce78c9c390f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:00.886270 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b787ae-d2c0-48c2-9202-343d2aa15c97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:00.886899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b787ae-d2c0-48c2-9202-343d2aa15c97 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:00.887157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b787ae-d2c0-48c2-9202-343d2aa15c97 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:00.887427 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b787ae-d2c0-48c2-9202-343d2aa15c97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:00.895369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b787ae-d2c0-48c2-9202-343d2aa15c97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:00.896949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b787ae-d2c0-48c2-9202-343d2aa15c97 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:00.906264 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1192/2385] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:33:05.025373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cadd3c-e1d7-4106-a268-b7ab0f8c4a32 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:05.025775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cadd3c-e1d7-4106-a268-b7ab0f8c4a32 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:05.026094 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cadd3c-e1d7-4106-a268-b7ab0f8c4a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:05.046022 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e1cadd3c-e1d7-4106-a268-b7ab0f8c4a32 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:05.047217 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e1cadd3c-e1d7-4106-a268-b7ab0f8c4a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:05.055926 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1194/2386] 10.222.0.55 () {58 vars in 1016 bytes} [Tue Sep 13 03:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:33:05.078113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b787ae-d2c0-48c2-9202-343d2aa15c97 service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:05.078113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-82b787ae-d2c0-48c2-9202-343d2aa15c97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:05.088459 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b787ae-d2c0-48c2-9202-343d2aa15c97 service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:05.093940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85bab8-967f-4ec8-8d27-1ea175ba8077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:05.094529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85bab8-967f-4ec8-8d27-1ea175ba8077 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:05.094808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85bab8-967f-4ec8-8d27-1ea175ba8077 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:05.095081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85bab8-967f-4ec8-8d27-1ea175ba8077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:05.103656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85bab8-967f-4ec8-8d27-1ea175ba8077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:05.106178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85bab8-967f-4ec8-8d27-1ea175ba8077 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:05.114754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1193/2387] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:33:08.246884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad80074-e521-4586-95ed-5d6fdf748df2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:08.247401 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad80074-e521-4586-95ed-5d6fdf748df2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:08.247497 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad80074-e521-4586-95ed-5d6fdf748df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:08.267852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5ad80074-e521-4586-95ed-5d6fdf748df2 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:08.269810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5ad80074-e521-4586-95ed-5d6fdf748df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:08.278000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1195/2388] 10.222.0.55 () {58 vars in 1016 bytes} [Tue Sep 13 03:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:33:08.293406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85bab8-967f-4ec8-8d27-1ea175ba8077 service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:08.303590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85bab8-967f-4ec8-8d27-1ea175ba8077 service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:08.309104 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5d9a5-856b-4075-b67a-0976ff13971e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:08.309796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5d9a5-856b-4075-b67a-0976ff13971e service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:08.310147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5d9a5-856b-4075-b67a-0976ff13971e service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:08.310488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5d9a5-856b-4075-b67a-0976ff13971e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:08.318984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5d9a5-856b-4075-b67a-0976ff13971e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:08.320576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5d9a5-856b-4075-b67a-0976ff13971e service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:08.331022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1194/2389] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:33:12.646412 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad80074-e521-4586-95ed-5d6fdf748df2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:12.647870 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5ad80074-e521-4586-95ed-5d6fdf748df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:12.717416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad80074-e521-4586-95ed-5d6fdf748df2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:12.723023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d691c2a-8c9d-4ea4-a596-8847b2f9e4fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261a9485c3b4d2aa657a931e0388389', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:12.723621 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d691c2a-8c9d-4ea4-a596-8847b2f9e4fa service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:12.723917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d691c2a-8c9d-4ea4-a596-8847b2f9e4fa service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:12.724188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d691c2a-8c9d-4ea4-a596-8847b2f9e4fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:12.725940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5d691c2a-8c9d-4ea4-a596-8847b2f9e4fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:12.738858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d691c2a-8c9d-4ea4-a596-8847b2f9e4fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:12.740457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d691c2a-8c9d-4ea4-a596-8847b2f9e4fa service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:12.750677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1196/2390] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:33:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:33:14.362897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3fbe-5654-41b4-bbcc-2890bfba2970 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:14.363428 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3fbe-5654-41b4-bbcc-2890bfba2970 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:14.363428 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3fbe-5654-41b4-bbcc-2890bfba2970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:14.389789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a4ac3fbe-5654-41b4-bbcc-2890bfba2970 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:14.391144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a4ac3fbe-5654-41b4-bbcc-2890bfba2970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:14.404217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1195/2391] 10.222.0.55 () {58 vars in 1016 bytes} [Tue Sep 13 03:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:33:14.418934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d691c2a-8c9d-4ea4-a596-8847b2f9e4fa service placement] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:14.433022 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d691c2a-8c9d-4ea4-a596-8847b2f9e4fa service placement] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:14.440638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797710b-bf61-47af-8ed1-a912a0852566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:14.441327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797710b-bf61-47af-8ed1-a912a0852566 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:14.441614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797710b-bf61-47af-8ed1-a912a0852566 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:14.441889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797710b-bf61-47af-8ed1-a912a0852566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:14.450702 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797710b-bf61-47af-8ed1-a912a0852566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:14.452268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797710b-bf61-47af-8ed1-a912a0852566 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:14.463582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1197/2392] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:33:17.102486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf89a7-8a63-4f8e-bcf0-59d197dfc070 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:17.102977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf89a7-8a63-4f8e-bcf0-59d197dfc070 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:17.103095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf89a7-8a63-4f8e-bcf0-59d197dfc070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:17.121596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c6cf89a7-8a63-4f8e-bcf0-59d197dfc070 None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:17.122774 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c6cf89a7-8a63-4f8e-bcf0-59d197dfc070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:17.178359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1196/2393] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:33:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:33:17.219246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797710b-bf61-47af-8ed1-a912a0852566 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:17.221400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5797710b-bf61-47af-8ed1-a912a0852566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:17.272352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:17.293161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797710b-bf61-47af-8ed1-a912a0852566 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:17.298367 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4390deb-4808-4df5-b2ef-aa003c975810 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:17.299035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4390deb-4808-4df5-b2ef-aa003c975810 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:17.299233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4390deb-4808-4df5-b2ef-aa003c975810 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:17.299508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4390deb-4808-4df5-b2ef-aa003c975810 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:17.308035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4390deb-4808-4df5-b2ef-aa003c975810 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:17.309682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4390deb-4808-4df5-b2ef-aa003c975810 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:17.317955 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1198/2394] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:33:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 03:33:18.237494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811de43f-99fe-4ad1-b083-47c971ebe356 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:18.237951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811de43f-99fe-4ad1-b083-47c971ebe356 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:18.238068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811de43f-99fe-4ad1-b083-47c971ebe356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:18.256850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-811de43f-99fe-4ad1-b083-47c971ebe356 None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:18.258149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-811de43f-99fe-4ad1-b083-47c971ebe356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:18.265350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1197/2395] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 13 03:33:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:33:18.277619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4390deb-4808-4df5-b2ef-aa003c975810 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:18.288718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4390deb-4808-4df5-b2ef-aa003c975810 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:18.293713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f570134-e7d8-4053-a0a9-4286ae96751d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:18.294300 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570134-e7d8-4053-a0a9-4286ae96751d service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:18.294577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570134-e7d8-4053-a0a9-4286ae96751d service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:18.294868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f570134-e7d8-4053-a0a9-4286ae96751d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:18.303355 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f570134-e7d8-4053-a0a9-4286ae96751d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:18.304914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f570134-e7d8-4053-a0a9-4286ae96751d service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:18.312884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1199/2396] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:33:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 03:33:18.681203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355fbe0-cc32-4f1c-86cb-e5b676cd121d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:18.681517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355fbe0-cc32-4f1c-86cb-e5b676cd121d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:18.681827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355fbe0-cc32-4f1c-86cb-e5b676cd121d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:18.701269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a355fbe0-cc32-4f1c-86cb-e5b676cd121d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:18.702526 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a355fbe0-cc32-4f1c-86cb-e5b676cd121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:18.711120 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1198/2397] 10.222.0.55 () {58 vars in 1016 bytes} [Tue Sep 13 03:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:33:18.726369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f570134-e7d8-4053-a0a9-4286ae96751d service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:18.740390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f570134-e7d8-4053-a0a9-4286ae96751d service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:18.746041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e403e-717e-44d4-8aec-bad2f7666922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:18.746639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e403e-717e-44d4-8aec-bad2f7666922 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:18.746935 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e403e-717e-44d4-8aec-bad2f7666922 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:18.747211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e403e-717e-44d4-8aec-bad2f7666922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:18.755780 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e403e-717e-44d4-8aec-bad2f7666922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:18.757371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e403e-717e-44d4-8aec-bad2f7666922 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:18.767191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1200/2398] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:33:18.979432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c2b0a-3e91-4904-91ca-2123545e1f68 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:18.979735 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c2b0a-3e91-4904-91ca-2123545e1f68 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:18.980032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c2b0a-3e91-4904-91ca-2123545e1f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:18.993355 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:19.000476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-420c2b0a-3e91-4904-91ca-2123545e1f68 None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:19.002215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-420c2b0a-3e91-4904-91ca-2123545e1f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:19.009292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1199/2399] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:33:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:33:19.021593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e403e-717e-44d4-8aec-bad2f7666922 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:19.032681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e403e-717e-44d4-8aec-bad2f7666922 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:19.037676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa0bad-048f-45c8-b58c-a0cdc5f0b72c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:19.038257 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0bad-048f-45c8-b58c-a0cdc5f0b72c service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:19.038533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0bad-048f-45c8-b58c-a0cdc5f0b72c service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:19.038802 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa0bad-048f-45c8-b58c-a0cdc5f0b72c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:19.046637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa0bad-048f-45c8-b58c-a0cdc5f0b72c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:19.048225 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa0bad-048f-45c8-b58c-a0cdc5f0b72c service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:19.056241 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1201/2400] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:33:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 03:33:19.637433 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13d57f-480c-404a-bff0-e07762dc2060 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:19.637898 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13d57f-480c-404a-bff0-e07762dc2060 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:19.638002 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13d57f-480c-404a-bff0-e07762dc2060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:19.660602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6e13d57f-480c-404a-bff0-e07762dc2060 None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:19.660602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6e13d57f-480c-404a-bff0-e07762dc2060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:19.666819 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1200/2401] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 13 03:33:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:33:19.685507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa0bad-048f-45c8-b58c-a0cdc5f0b72c service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:19.697292 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa0bad-048f-45c8-b58c-a0cdc5f0b72c service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:19.702364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af7eb2-e0a2-47b1-95e3-87cd0d072556 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:19.702956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7eb2-e0a2-47b1-95e3-87cd0d072556 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:19.703232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7eb2-e0a2-47b1-95e3-87cd0d072556 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:19.703502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7eb2-e0a2-47b1-95e3-87cd0d072556 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:19.712138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af7eb2-e0a2-47b1-95e3-87cd0d072556 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:19.713778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af7eb2-e0a2-47b1-95e3-87cd0d072556 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:19.722405 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1202/2402] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:33:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 03:33:22.468324 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13d57f-480c-404a-bff0-e07762dc2060 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:22.481532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13d57f-480c-404a-bff0-e07762dc2060 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:22.489961 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:22.490719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:22.491125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:22.491472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] PATH_INFO: `/v3/users/4abeb30d77044a279b0f34149cfee3ed` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:22.492744 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abeb30d77044a279b0f34149cfee3ed)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:22.494873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:22.741200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abeb30d77044a279b0f34149cfee3ed'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:33:22.741996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abeb30d77044a279b0f34149cfee3ed'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:33:22.743093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abeb30d77044a279b0f34149cfee3ed'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:33:22.751050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abeb30d77044a279b0f34149cfee3ed'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:33:22.766224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abeb30d77044a279b0f34149cfee3ed'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:33:22.858583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1201/2403] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:33:22 2022] DELETE /identity/v3/users/4abeb30d77044a279b0f34149cfee3ed => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:33:22.863837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f165a-906a-4581-bd8e-a72ae3b16a6d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:22.864320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f165a-906a-4581-bd8e-a72ae3b16a6d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:22.864446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f165a-906a-4581-bd8e-a72ae3b16a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:22.893654 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fc6f165a-906a-4581-bd8e-a72ae3b16a6d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:22.895380 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fc6f165a-906a-4581-bd8e-a72ae3b16a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:23.006079 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1203/2404] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:33:23.018837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:23.020611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:23.031139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcce74-e6f4-4a11-ac38-d07d83b05847 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:23.031430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcce74-e6f4-4a11-ac38-d07d83b05847 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:23.032250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcce74-e6f4-4a11-ac38-d07d83b05847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:23.061996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-96fcce74-e6f4-4a11-ac38-d07d83b05847 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:23.063404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-96fcce74-e6f4-4a11-ac38-d07d83b05847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:23.074786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1204/2405] 10.222.0.55 () {58 vars in 1016 bytes} [Tue Sep 13 03:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:33:23.103233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcce74-e6f4-4a11-ac38-d07d83b05847 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:23.104626 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-96fcce74-e6f4-4a11-ac38-d07d83b05847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:23.130351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb69bff-7c15-492c-82f6-1b0fbf765f8a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:23.134505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3a51f-f868-4eca-93fa-14739d8db223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:23.135504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3a51f-f868-4eca-93fa-14739d8db223 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:23.136082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3a51f-f868-4eca-93fa-14739d8db223 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:23.136512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3a51f-f868-4eca-93fa-14739d8db223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:23.160346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3a51f-f868-4eca-93fa-14739d8db223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:23.162348 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3a51f-f868-4eca-93fa-14739d8db223 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:23.173547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1202/2406] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:33:23.268436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcce74-e6f4-4a11-ac38-d07d83b05847 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:23.290432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90327d37-56f3-4bc8-ab3d-2449174aa870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:23.291117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90327d37-56f3-4bc8-ab3d-2449174aa870 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:23.291400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90327d37-56f3-4bc8-ab3d-2449174aa870 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:23.292060 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90327d37-56f3-4bc8-ab3d-2449174aa870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:23.307492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90327d37-56f3-4bc8-ab3d-2449174aa870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:23.311708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90327d37-56f3-4bc8-ab3d-2449174aa870 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:23.321377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1205/2407] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:33:23.606584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3a51f-f868-4eca-93fa-14739d8db223 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:33:23.606584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e4f3a51f-f868-4eca-93fa-14739d8db223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:23.620429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3a51f-f868-4eca-93fa-14739d8db223 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:33:23.628702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:33:23.632927 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:23.632927 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:23.632927 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665 admin admin] PATH_INFO: `/v3/projects/c3546d059d4e45439adf3ba0e40512ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:23.632927 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3546d059d4e45439adf3ba0e40512ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:33:23.635190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:33:23.792064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3546d059d4e45439adf3ba0e40512ce', 'request_id': 'req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:33:23.799672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3546d059d4e45439adf3ba0e40512ce', 'request_id': 'req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:33:23.868918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3546d059d4e45439adf3ba0e40512ce', 'request_id': 'req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:33:23.871355 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:23.880964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665 admin admin] The token cache is being invalidate because project c3546d059d4e45439adf3ba0e40512ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:33:23.881253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:33:23.881900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8244d4b8-bc2c-49bd-8ff9-e68c0b2a9665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:33:23.883384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1203/2408] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:33:23 2022] DELETE /identity/v3/projects/c3546d059d4e45439adf3ba0e40512ce => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:33:33.316357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:34.051608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:40.653597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50b5f-4b73-4aa6-a9dd-6bb826acb23d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:40.654114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50b5f-4b73-4aa6-a9dd-6bb826acb23d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:40.654226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50b5f-4b73-4aa6-a9dd-6bb826acb23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:40.675031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e8e50b5f-4b73-4aa6-a9dd-6bb826acb23d None None] MFA Rules not processed for user `1398646888214f8a9ed7be5648a9a231`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:40.676325 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e8e50b5f-4b73-4aa6-a9dd-6bb826acb23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:40.696883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05fea8-1141-47fb-8589-35a572cc0b8c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:40.697451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05fea8-1141-47fb-8589-35a572cc0b8c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:40.697451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05fea8-1141-47fb-8589-35a572cc0b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:40.718220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-eb05fea8-1141-47fb-8589-35a572cc0b8c None None] MFA Rules not processed for user `681bf5823ae64521a679b8041a977cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:40.719435 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eb05fea8-1141-47fb-8589-35a572cc0b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:40.737885 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1206/2409] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:33:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:33:40.777641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1204/2410] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:33:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:33:50.730638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=25 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:50.768957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=25 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:33:51.415975 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b8c41-ec1c-4180-a64c-e579c6170df6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:33:51.416288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b8c41-ec1c-4180-a64c-e579c6170df6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:33:51.416559 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b8c41-ec1c-4180-a64c-e579c6170df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:33:51.435616 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b54b8c41-ec1c-4180-a64c-e579c6170df6 None None] MFA Rules not processed for user `9f181af31fb245bba4158e89e58704d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:33:51.436830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b54b8c41-ec1c-4180-a64c-e579c6170df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:33:51.489685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1207/2411] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:33:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:34:01.483140 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=25 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:34:02.175451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bb77f-42f0-499f-a182-a5d5c6300058 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:02.175932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bb77f-42f0-499f-a182-a5d5c6300058 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:02.176035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bb77f-42f0-499f-a182-a5d5c6300058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:02.195302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6b5bb77f-42f0-499f-a182-a5d5c6300058 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:34:02.196572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6b5bb77f-42f0-499f-a182-a5d5c6300058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:34:02.254686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1205/2412] 10.222.0.55 () {58 vars in 1016 bytes} [Tue Sep 13 03:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:34:02.277131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b8c41-ec1c-4180-a64c-e579c6170df6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:34:02.278634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b54b8c41-ec1c-4180-a64c-e579c6170df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:34:02.351699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b8c41-ec1c-4180-a64c-e579c6170df6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:34:02.357164 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbb893-ebde-4338-85b7-82aed5c05a88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:34:02.357794 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb893-ebde-4338-85b7-82aed5c05a88 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:02.358071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb893-ebde-4338-85b7-82aed5c05a88 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:02.358345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb893-ebde-4338-85b7-82aed5c05a88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:02.366357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbb893-ebde-4338-85b7-82aed5c05a88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:34:02.367953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbb893-ebde-4338-85b7-82aed5c05a88 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:34:02.377198 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1208/2413] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:34:05.807534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5a959-4e5d-44c6-8f25-5782e672d3ea None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:05.808050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5a959-4e5d-44c6-8f25-5782e672d3ea None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:05.808050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5a959-4e5d-44c6-8f25-5782e672d3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:05.827659 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-10d5a959-4e5d-44c6-8f25-5782e672d3ea None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:34:05.828789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-10d5a959-4e5d-44c6-8f25-5782e672d3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:34:05.837312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1206/2414] 10.222.0.55 () {58 vars in 1016 bytes} [Tue Sep 13 03:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:34:05.852475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbb893-ebde-4338-85b7-82aed5c05a88 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:34:05.853960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0cfbb893-ebde-4338-85b7-82aed5c05a88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:34:05.868215 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbb893-ebde-4338-85b7-82aed5c05a88 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:34:05.873591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188f59a-0266-4482-8693-51b605701568 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:34:05.874166 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188f59a-0266-4482-8693-51b605701568 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:05.874440 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188f59a-0266-4482-8693-51b605701568 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:05.874708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188f59a-0266-4482-8693-51b605701568 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:05.882637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188f59a-0266-4482-8693-51b605701568 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:34:05.884192 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188f59a-0266-4482-8693-51b605701568 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:34:05.893323 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1209/2415] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:34:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:34:08.559917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29fdec-4b84-4cd7-b061-8db91e7a80ed None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:08.560413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29fdec-4b84-4cd7-b061-8db91e7a80ed None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:08.560517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29fdec-4b84-4cd7-b061-8db91e7a80ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:08.579799 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bf29fdec-4b84-4cd7-b061-8db91e7a80ed None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:34:08.581008 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bf29fdec-4b84-4cd7-b061-8db91e7a80ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:34:08.589655 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1207/2416] 10.222.0.55 () {58 vars in 1016 bytes} [Tue Sep 13 03:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:34:08.606224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188f59a-0266-4482-8693-51b605701568 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:34:08.617623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188f59a-0266-4482-8693-51b605701568 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:34:08.623127 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011a05-a976-4631-b27a-b4997618bac0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:34:08.625741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011a05-a976-4631-b27a-b4997618bac0 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:08.625741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011a05-a976-4631-b27a-b4997618bac0 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:08.625741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011a05-a976-4631-b27a-b4997618bac0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:08.632485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0011a05-a976-4631-b27a-b4997618bac0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:34:08.634087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0011a05-a976-4631-b27a-b4997618bac0 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:34:08.643363 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1210/2417] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:34:11.810554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82aa52-5bf4-4c0d-8587-fe1c3a8812b9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:11.811220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82aa52-5bf4-4c0d-8587-fe1c3a8812b9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:11.811220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82aa52-5bf4-4c0d-8587-fe1c3a8812b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:11.830430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bf82aa52-5bf4-4c0d-8587-fe1c3a8812b9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:34:11.831668 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bf82aa52-5bf4-4c0d-8587-fe1c3a8812b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:34:11.839776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1208/2418] 10.222.0.55 () {58 vars in 1016 bytes} [Tue Sep 13 03:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:34:11.858956 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011a05-a976-4631-b27a-b4997618bac0 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:34:11.870537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011a05-a976-4631-b27a-b4997618bac0 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:34:11.878719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0910b4d-ce60-4176-811c-462fda01b65e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:34:11.879335 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0910b4d-ce60-4176-811c-462fda01b65e service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:11.879615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0910b4d-ce60-4176-811c-462fda01b65e service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:11.879886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0910b4d-ce60-4176-811c-462fda01b65e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:11.889331 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0910b4d-ce60-4176-811c-462fda01b65e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:34:11.890990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0910b4d-ce60-4176-811c-462fda01b65e service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:34:11.901071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1211/2419] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:34:18.145413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe9dfd-d77a-4a55-950f-be0b9ddc7dd2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:18.146293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe9dfd-d77a-4a55-950f-be0b9ddc7dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:18.146756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe9dfd-d77a-4a55-950f-be0b9ddc7dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:18.167544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bebe9dfd-d77a-4a55-950f-be0b9ddc7dd2 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:34:18.168805 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bebe9dfd-d77a-4a55-950f-be0b9ddc7dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:34:18.176878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1209/2420] 10.222.0.55 () {58 vars in 1016 bytes} [Tue Sep 13 03:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:34:18.196623 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0910b4d-ce60-4176-811c-462fda01b65e service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:34:18.208837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0910b4d-ce60-4176-811c-462fda01b65e service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:34:18.214758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7ed7e-6d8b-46a3-808b-3d613354b04c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:34:18.215925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ed7e-6d8b-46a3-808b-3d613354b04c service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:18.216206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ed7e-6d8b-46a3-808b-3d613354b04c service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:18.216487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7ed7e-6d8b-46a3-808b-3d613354b04c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:18.224863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ed7e-6d8b-46a3-808b-3d613354b04c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:34:18.226465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7ed7e-6d8b-46a3-808b-3d613354b04c service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:34:18.235851 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1212/2421] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:34:22.407788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd59d11-7dae-41f7-a1e6-ddae70974f36 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:22.408327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd59d11-7dae-41f7-a1e6-ddae70974f36 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:22.408522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd59d11-7dae-41f7-a1e6-ddae70974f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:22.427797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-afd59d11-7dae-41f7-a1e6-ddae70974f36 None None] MFA Rules not processed for user `a0e6526c76984cc7a6a4c14c840f7c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:34:22.428988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-afd59d11-7dae-41f7-a1e6-ddae70974f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:34:22.482232 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1210/2422] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:34:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:34:28.231674 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=58 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:34:32.475505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=64 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:34:50.355613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7ed7e-6d8b-46a3-808b-3d613354b04c service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:34:50.357228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d1f7ed7e-6d8b-46a3-808b-3d613354b04c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:34:50.371279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7ed7e-6d8b-46a3-808b-3d613354b04c service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:34:50.376003 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0cf07-59dd-48f7-bfd5-a52292109a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:34:50.376648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0cf07-59dd-48f7-bfd5-a52292109a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:50.376929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0cf07-59dd-48f7-bfd5-a52292109a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:50.377204 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0cf07-59dd-48f7-bfd5-a52292109a08 admin admin] PATH_INFO: `/v3/users/681bf5823ae64521a679b8041a977cf1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:50.378382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0cf07-59dd-48f7-bfd5-a52292109a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=681bf5823ae64521a679b8041a977cf1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:34:50.380307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0cf07-59dd-48f7-bfd5-a52292109a08 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:34:50.530313 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-62a0cf07-59dd-48f7-bfd5-a52292109a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '681bf5823ae64521a679b8041a977cf1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:34:50.572959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-62a0cf07-59dd-48f7-bfd5-a52292109a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '681bf5823ae64521a679b8041a977cf1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:34:50.573625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-62a0cf07-59dd-48f7-bfd5-a52292109a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '681bf5823ae64521a679b8041a977cf1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:34:50.574228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-62a0cf07-59dd-48f7-bfd5-a52292109a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '681bf5823ae64521a679b8041a977cf1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:34:50.581664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-62a0cf07-59dd-48f7-bfd5-a52292109a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '681bf5823ae64521a679b8041a977cf1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:34:50.599122 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1213/2423] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:34:50 2022] DELETE /identity/v3/users/681bf5823ae64521a679b8041a977cf1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:34:51.010491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd59d11-7dae-41f7-a1e6-ddae70974f36 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:34:51.022501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd59d11-7dae-41f7-a1e6-ddae70974f36 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:34:51.094784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:34:51.095510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:51.095807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:51.096065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] PATH_INFO: `/v3/projects/de16ff851c63404597f8b1fda1591eb3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:51.097326 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=de16ff851c63404597f8b1fda1591eb3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:34:51.099253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:34:51.220541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de16ff851c63404597f8b1fda1591eb3', 'request_id': 'req-a8b32971-442a-4173-963d-d51e014b8a0d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:34:51.227234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de16ff851c63404597f8b1fda1591eb3', 'request_id': 'req-a8b32971-442a-4173-963d-d51e014b8a0d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:34:51.316118 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de16ff851c63404597f8b1fda1591eb3', 'request_id': 'req-a8b32971-442a-4173-963d-d51e014b8a0d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:34:51.329125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] The token cache is being invalidate because project de16ff851c63404597f8b1fda1591eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:34:51.329356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:34:51.329982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:34:51.331519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1211/2424] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:34:51 2022] DELETE /identity/v3/projects/de16ff851c63404597f8b1fda1591eb3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:34:57.914314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0a174-73b0-4803-8570-02e2169997e1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:34:57.914765 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0a174-73b0-4803-8570-02e2169997e1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:34:57.914965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0a174-73b0-4803-8570-02e2169997e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:34:57.936095 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cce0a174-73b0-4803-8570-02e2169997e1 None None] MFA Rules not processed for user `1398646888214f8a9ed7be5648a9a231`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:34:57.937436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cce0a174-73b0-4803-8570-02e2169997e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:34:57.994010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1214/2425] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:34:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:01.325362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:03.630644 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:03.635962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:03.693188 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b32971-442a-4173-963d-d51e014b8a0d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:03.697434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cc061-0551-4c6e-8193-41cc26cdf254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:03.697974 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cc061-0551-4c6e-8193-41cc26cdf254 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:03.698249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cc061-0551-4c6e-8193-41cc26cdf254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:03.698517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cc061-0551-4c6e-8193-41cc26cdf254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:03.700251 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fe6cc061-0551-4c6e-8193-41cc26cdf254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:03.762375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6cc061-0551-4c6e-8193-41cc26cdf254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:03.763747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6cc061-0551-4c6e-8193-41cc26cdf254 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:03.773253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1212/2426] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:04.346758 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0a174-73b0-4803-8570-02e2169997e1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:04.357458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0a174-73b0-4803-8570-02e2169997e1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:04.361279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e6c2e-c770-4ade-bba3-304eaf9943bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:04.361903 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e6c2e-c770-4ade-bba3-304eaf9943bc service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:04.362181 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e6c2e-c770-4ade-bba3-304eaf9943bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:04.362454 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e6c2e-c770-4ade-bba3-304eaf9943bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:04.364208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fd5e6c2e-c770-4ade-bba3-304eaf9943bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:04.443359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e6c2e-c770-4ade-bba3-304eaf9943bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:04.444901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e6c2e-c770-4ade-bba3-304eaf9943bc service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:04.456945 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1215/2427] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:05.731774 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cc061-0551-4c6e-8193-41cc26cdf254 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:05.733306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fe6cc061-0551-4c6e-8193-41cc26cdf254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:05.744914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cc061-0551-4c6e-8193-41cc26cdf254 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:05.749642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fab17f-e52c-48b2-b60e-e227a4706ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:05.750196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab17f-e52c-48b2-b60e-e227a4706ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:05.750480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab17f-e52c-48b2-b60e-e227a4706ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:05.750749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fab17f-e52c-48b2-b60e-e227a4706ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:05.752642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-48fab17f-e52c-48b2-b60e-e227a4706ec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:05.767993 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fab17f-e52c-48b2-b60e-e227a4706ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:05.769382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fab17f-e52c-48b2-b60e-e227a4706ec9 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:05.781886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1213/2428] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:07.534283 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e6c2e-c770-4ade-bba3-304eaf9943bc service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:07.536383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fd5e6c2e-c770-4ade-bba3-304eaf9943bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:07.545833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:07.552974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e6c2e-c770-4ade-bba3-304eaf9943bc service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:07.560278 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c712a-03bb-40ae-b260-010aceeca5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:07.561948 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c712a-03bb-40ae-b260-010aceeca5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:07.562238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c712a-03bb-40ae-b260-010aceeca5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:07.562513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c712a-03bb-40ae-b260-010aceeca5fd admin admin] PATH_INFO: `/v3/users/9f181af31fb245bba4158e89e58704d3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:07.563680 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c712a-03bb-40ae-b260-010aceeca5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f181af31fb245bba4158e89e58704d3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:07.565647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c712a-03bb-40ae-b260-010aceeca5fd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:07.814052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ec2c712a-03bb-40ae-b260-010aceeca5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f181af31fb245bba4158e89e58704d3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:07.886212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ec2c712a-03bb-40ae-b260-010aceeca5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f181af31fb245bba4158e89e58704d3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:07.886776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ec2c712a-03bb-40ae-b260-010aceeca5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f181af31fb245bba4158e89e58704d3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:07.887393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ec2c712a-03bb-40ae-b260-010aceeca5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f181af31fb245bba4158e89e58704d3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:07.894844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ec2c712a-03bb-40ae-b260-010aceeca5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f181af31fb245bba4158e89e58704d3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:07.912895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1216/2429] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:35:07 2022] DELETE /identity/v3/users/9f181af31fb245bba4158e89e58704d3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:08.145079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fab17f-e52c-48b2-b60e-e227a4706ec9 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:08.166088 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fab17f-e52c-48b2-b60e-e227a4706ec9 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:08.227558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78d681-5bd1-4b7c-b153-1e56188f5c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:08.228321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78d681-5bd1-4b7c-b153-1e56188f5c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:08.228601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78d681-5bd1-4b7c-b153-1e56188f5c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:08.228878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78d681-5bd1-4b7c-b153-1e56188f5c43 admin admin] PATH_INFO: `/v3/projects/f12b3d34c9004770ac32556d0744c0de` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:08.230150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78d681-5bd1-4b7c-b153-1e56188f5c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f12b3d34c9004770ac32556d0744c0de)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:08.232068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78d681-5bd1-4b7c-b153-1e56188f5c43 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:08.328238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:08.335453 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8e78d681-5bd1-4b7c-b153-1e56188f5c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f12b3d34c9004770ac32556d0744c0de', 'request_id': 'req-8e78d681-5bd1-4b7c-b153-1e56188f5c43'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:08.341498 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8e78d681-5bd1-4b7c-b153-1e56188f5c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f12b3d34c9004770ac32556d0744c0de', 'request_id': 'req-8e78d681-5bd1-4b7c-b153-1e56188f5c43'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:08.407787 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8e78d681-5bd1-4b7c-b153-1e56188f5c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f12b3d34c9004770ac32556d0744c0de', 'request_id': 'req-8e78d681-5bd1-4b7c-b153-1e56188f5c43'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:08.419123 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8e78d681-5bd1-4b7c-b153-1e56188f5c43 admin admin] The token cache is being invalidate because project f12b3d34c9004770ac32556d0744c0de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:35:08.419789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8e78d681-5bd1-4b7c-b153-1e56188f5c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:08.420153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8e78d681-5bd1-4b7c-b153-1e56188f5c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:08.421681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1214/2430] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:35:08 2022] DELETE /identity/v3/projects/f12b3d34c9004770ac32556d0744c0de => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:08.426633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c377f3e-10c2-453a-9e0b-c8f2339651d0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:08.426921 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c377f3e-10c2-453a-9e0b-c8f2339651d0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:08.427196 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c377f3e-10c2-453a-9e0b-c8f2339651d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:08.447234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0c377f3e-10c2-453a-9e0b-c8f2339651d0 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:08.448441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0c377f3e-10c2-453a-9e0b-c8f2339651d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:08.507254 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1217/2431] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:08.514634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27d37d-a1f0-4e87-997b-d7132bcdfc02 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:08.514963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27d37d-a1f0-4e87-997b-d7132bcdfc02 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:08.515237 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27d37d-a1f0-4e87-997b-d7132bcdfc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:08.535072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-be27d37d-a1f0-4e87-997b-d7132bcdfc02 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:08.536265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-be27d37d-a1f0-4e87-997b-d7132bcdfc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:08.544931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1215/2432] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:08.548922 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c377f3e-10c2-453a-9e0b-c8f2339651d0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:08.559280 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c377f3e-10c2-453a-9e0b-c8f2339651d0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:08.564114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c3776-0404-477f-ae38-ce3b9e791c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:08.564713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c3776-0404-477f-ae38-ce3b9e791c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:08.565029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c3776-0404-477f-ae38-ce3b9e791c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:08.565424 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c3776-0404-477f-ae38-ce3b9e791c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:08.566101 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c3776-0404-477f-ae38-ce3b9e791c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:35:08.566397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c3776-0404-477f-ae38-ce3b9e791c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:08.568056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c3776-0404-477f-ae38-ce3b9e791c3b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:08.579937 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1218/2433] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:35:08.584191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27d37d-a1f0-4e87-997b-d7132bcdfc02 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:08.594295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27d37d-a1f0-4e87-997b-d7132bcdfc02 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:08.599579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeef0cc-00d8-4d91-9588-345defbea619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:08.599579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeef0cc-00d8-4d91-9588-345defbea619 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:08.600339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeef0cc-00d8-4d91-9588-345defbea619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:08.600604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeef0cc-00d8-4d91-9588-345defbea619 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:08.601227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeef0cc-00d8-4d91-9588-345defbea619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:08.603186 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeef0cc-00d8-4d91-9588-345defbea619 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:08.706752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1216/2434] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:35:08 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:35:08.711746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c3776-0404-477f-ae38-ce3b9e791c3b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:08.721754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c3776-0404-477f-ae38-ce3b9e791c3b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:08.780514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb2c69-1e39-4174-b8e7-1a3ac082c3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:08.781246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb2c69-1e39-4174-b8e7-1a3ac082c3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:08.781570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb2c69-1e39-4174-b8e7-1a3ac082c3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:08.781848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb2c69-1e39-4174-b8e7-1a3ac082c3c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:08.782490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb2c69-1e39-4174-b8e7-1a3ac082c3c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:08.784774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb2c69-1e39-4174-b8e7-1a3ac082c3c0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:08.794583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:08.882940 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1219/2435] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:35:08 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:35:08.887438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeef0cc-00d8-4d91-9588-345defbea619 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:08.898383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeef0cc-00d8-4d91-9588-345defbea619 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:08.902987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d6ec6-5828-43bc-87ea-150dc405e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:08.903578 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d6ec6-5828-43bc-87ea-150dc405e5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:08.903955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d6ec6-5828-43bc-87ea-150dc405e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:08.904161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d6ec6-5828-43bc-87ea-150dc405e5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:08.904921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d6ec6-5828-43bc-87ea-150dc405e5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:08.906547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d6ec6-5828-43bc-87ea-150dc405e5a4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:08.920662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1217/2436] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:08.921979 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb2c69-1e39-4174-b8e7-1a3ac082c3c0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:08.931921 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb2c69-1e39-4174-b8e7-1a3ac082c3c0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:08.936611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eca811-fadd-43d4-bce6-810709aa6121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:08.937201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eca811-fadd-43d4-bce6-810709aa6121 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:08.937508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eca811-fadd-43d4-bce6-810709aa6121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:08.937780 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eca811-fadd-43d4-bce6-810709aa6121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:08.938411 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eca811-fadd-43d4-bce6-810709aa6121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:08.940041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eca811-fadd-43d4-bce6-810709aa6121 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:08.951186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1220/2437] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:08.955599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d6ec6-5828-43bc-87ea-150dc405e5a4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:08.967091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d6ec6-5828-43bc-87ea-150dc405e5a4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:08.972105 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c157bd5-6815-4d11-b6dc-bdd33c46e303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:08.972803 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c157bd5-6815-4d11-b6dc-bdd33c46e303 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:08.978674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c157bd5-6815-4d11-b6dc-bdd33c46e303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:08.978674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c157bd5-6815-4d11-b6dc-bdd33c46e303 admin admin] PATH_INFO: `/v3/projects/9c9267f228cd406e900c81c80a0a610b/users/ec3ab00d1b2c498aa0160a0fa044e7e0/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:08.988760 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c157bd5-6815-4d11-b6dc-bdd33c46e303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9267f228cd406e900c81c80a0a610b, user_id=ec3ab00d1b2c498aa0160a0fa044e7e0, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:08.991451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c157bd5-6815-4d11-b6dc-bdd33c46e303 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:09.092385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1218/2438] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:35:08 2022] PUT /identity/v3/projects/9c9267f228cd406e900c81c80a0a610b/users/ec3ab00d1b2c498aa0160a0fa044e7e0/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:09.097442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d0966-a0fc-402b-b858-25beed44c6e6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:09.097845 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d0966-a0fc-402b-b858-25beed44c6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:09.098211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d0966-a0fc-402b-b858-25beed44c6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:09.118144 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2a2d0966-a0fc-402b-b858-25beed44c6e6 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:09.122017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2a2d0966-a0fc-402b-b858-25beed44c6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:09.181718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1221/2439] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:35:09.191023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c157bd5-6815-4d11-b6dc-bdd33c46e303 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:09.192749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7c157bd5-6815-4d11-b6dc-bdd33c46e303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:09.252464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c157bd5-6815-4d11-b6dc-bdd33c46e303 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:09.256646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107a0bb-93ce-422a-9b6f-57de033990b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:09.257272 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107a0bb-93ce-422a-9b6f-57de033990b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:09.257560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107a0bb-93ce-422a-9b6f-57de033990b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:09.257831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107a0bb-93ce-422a-9b6f-57de033990b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:09.266826 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107a0bb-93ce-422a-9b6f-57de033990b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:09.268269 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107a0bb-93ce-422a-9b6f-57de033990b2 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:09.278423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1219/2440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:15.221755 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c348b0-708b-4a63-be2e-6889e8355ceb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:15.222517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c348b0-708b-4a63-be2e-6889e8355ceb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:15.222517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c348b0-708b-4a63-be2e-6889e8355ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:15.251578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b6c348b0-708b-4a63-be2e-6889e8355ceb None None] MFA Rules not processed for user `ec3ab00d1b2c498aa0160a0fa044e7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:15.252699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b6c348b0-708b-4a63-be2e-6889e8355ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:15.318160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1222/2441] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:15.335064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107a0bb-93ce-422a-9b6f-57de033990b2 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:15.338293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b107a0bb-93ce-422a-9b6f-57de033990b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:15.414773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:15.419675 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107a0bb-93ce-422a-9b6f-57de033990b2 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:15.425159 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5bcf5-e12c-401c-a9ba-bab447ea0be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:15.425801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5bcf5-e12c-401c-a9ba-bab447ea0be7 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:15.426080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5bcf5-e12c-401c-a9ba-bab447ea0be7 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:15.426347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5bcf5-e12c-401c-a9ba-bab447ea0be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:15.434927 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5bcf5-e12c-401c-a9ba-bab447ea0be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:15.436520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5bcf5-e12c-401c-a9ba-bab447ea0be7 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:15.446198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1220/2442] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:17.747785 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f6934-4698-43da-a2a4-5bd5c6c6c0df None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:17.748281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f6934-4698-43da-a2a4-5bd5c6c6c0df None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:17.748383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f6934-4698-43da-a2a4-5bd5c6c6c0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:17.774827 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6a6f6934-4698-43da-a2a4-5bd5c6c6c0df None None] MFA Rules not processed for user `ec3ab00d1b2c498aa0160a0fa044e7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:17.776123 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6a6f6934-4698-43da-a2a4-5bd5c6c6c0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:17.783412 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1223/2443] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:18.123248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5bcf5-e12c-401c-a9ba-bab447ea0be7 service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:18.124779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-19e5bcf5-e12c-401c-a9ba-bab447ea0be7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:18.137683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5bcf5-e12c-401c-a9ba-bab447ea0be7 service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:18.145003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52107e-75d6-48eb-9629-52a0bca72b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:18.145672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52107e-75d6-48eb-9629-52a0bca72b5e service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:18.145956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52107e-75d6-48eb-9629-52a0bca72b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:18.146228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52107e-75d6-48eb-9629-52a0bca72b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:18.148835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bf52107e-75d6-48eb-9629-52a0bca72b5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:18.162887 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52107e-75d6-48eb-9629-52a0bca72b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:18.164350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52107e-75d6-48eb-9629-52a0bca72b5e service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:18.173919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1221/2444] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:18.824921 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f6934-4698-43da-a2a4-5bd5c6c6c0df None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:18.828816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6a6f6934-4698-43da-a2a4-5bd5c6c6c0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:18.910719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f6934-4698-43da-a2a4-5bd5c6c6c0df None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:18.916605 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015074bb-cc28-4c2c-92e6-b6d6609a0b73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261a9485c3b4d2aa657a931e0388389', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:18.917214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015074bb-cc28-4c2c-92e6-b6d6609a0b73 service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:18.917558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015074bb-cc28-4c2c-92e6-b6d6609a0b73 service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:18.917831 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015074bb-cc28-4c2c-92e6-b6d6609a0b73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:18.919559 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-015074bb-cc28-4c2c-92e6-b6d6609a0b73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:18.927809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:18.932076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015074bb-cc28-4c2c-92e6-b6d6609a0b73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:18.933689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015074bb-cc28-4c2c-92e6-b6d6609a0b73 service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:18.943846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1224/2445] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:20.636328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52107e-75d6-48eb-9629-52a0bca72b5e service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:20.637749 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bf52107e-75d6-48eb-9629-52a0bca72b5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:20.693961 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52107e-75d6-48eb-9629-52a0bca72b5e service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:20.697526 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533b6d4-72b9-406b-8b86-83de2a3b362f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:20.698150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533b6d4-72b9-406b-8b86-83de2a3b362f service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:20.698427 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533b6d4-72b9-406b-8b86-83de2a3b362f service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:20.702958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533b6d4-72b9-406b-8b86-83de2a3b362f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:20.702958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c533b6d4-72b9-406b-8b86-83de2a3b362f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:20.759985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533b6d4-72b9-406b-8b86-83de2a3b362f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:20.761465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533b6d4-72b9-406b-8b86-83de2a3b362f service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:20.770597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1222/2446] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:28.985039 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:30.766272 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=58 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:32.391425 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015074bb-cc28-4c2c-92e6-b6d6609a0b73 service placement] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:32.401756 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015074bb-cc28-4c2c-92e6-b6d6609a0b73 service placement] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:32.405789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0594ce-850c-47cc-8ab2-2224924308db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:32.406392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0594ce-850c-47cc-8ab2-2224924308db service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:32.406678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0594ce-850c-47cc-8ab2-2224924308db service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:32.407000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0594ce-850c-47cc-8ab2-2224924308db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:32.408741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9b0594ce-850c-47cc-8ab2-2224924308db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:32.418838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0594ce-850c-47cc-8ab2-2224924308db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:32.420281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0594ce-850c-47cc-8ab2-2224924308db service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:32.428999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1225/2447] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:39.887153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533b6d4-72b9-406b-8b86-83de2a3b362f service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:39.896432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533b6d4-72b9-406b-8b86-83de2a3b362f service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:39.899953 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df3169-43fa-4291-91f1-8292c49025e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:39.900539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df3169-43fa-4291-91f1-8292c49025e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:39.900823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df3169-43fa-4291-91f1-8292c49025e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:39.901095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df3169-43fa-4291-91f1-8292c49025e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:39.902817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e7df3169-43fa-4291-91f1-8292c49025e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:39.914093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df3169-43fa-4291-91f1-8292c49025e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:39.915995 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df3169-43fa-4291-91f1-8292c49025e4 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:39.925426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1223/2448] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:42.425952 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:43.349964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0594ce-850c-47cc-8ab2-2224924308db service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:43.353973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9b0594ce-850c-47cc-8ab2-2224924308db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:43.366611 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0594ce-850c-47cc-8ab2-2224924308db service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:43.371298 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76a48f-6631-4f52-b013-7e242981be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:43.371919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76a48f-6631-4f52-b013-7e242981be83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:43.372201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76a48f-6631-4f52-b013-7e242981be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:43.372469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76a48f-6631-4f52-b013-7e242981be83 admin admin] PATH_INFO: `/v3/users/a0e6526c76984cc7a6a4c14c840f7c8b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:43.373879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76a48f-6631-4f52-b013-7e242981be83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e6526c76984cc7a6a4c14c840f7c8b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:43.375704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76a48f-6631-4f52-b013-7e242981be83 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:43.532406 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ce76a48f-6631-4f52-b013-7e242981be83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e6526c76984cc7a6a4c14c840f7c8b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:43.597285 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ce76a48f-6631-4f52-b013-7e242981be83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e6526c76984cc7a6a4c14c840f7c8b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:43.597913 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ce76a48f-6631-4f52-b013-7e242981be83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e6526c76984cc7a6a4c14c840f7c8b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:43.598524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ce76a48f-6631-4f52-b013-7e242981be83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e6526c76984cc7a6a4c14c840f7c8b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:43.606043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ce76a48f-6631-4f52-b013-7e242981be83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e6526c76984cc7a6a4c14c840f7c8b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:43.623688 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1226/2449] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:35:43 2022] DELETE /identity/v3/users/a0e6526c76984cc7a6a4c14c840f7c8b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:43.873224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df3169-43fa-4291-91f1-8292c49025e4 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:43.883249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df3169-43fa-4291-91f1-8292c49025e4 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:43.940834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:43.941501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:43.941784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:43.942054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7 admin admin] PATH_INFO: `/v3/projects/5f4689ac3ec44a88a740c1016dc4dfe9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:43.943214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f4689ac3ec44a88a740c1016dc4dfe9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:43.945077 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:44.059181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4689ac3ec44a88a740c1016dc4dfe9', 'request_id': 'req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:44.065168 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4689ac3ec44a88a740c1016dc4dfe9', 'request_id': 'req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:44.115222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4689ac3ec44a88a740c1016dc4dfe9', 'request_id': 'req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:44.126640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7 admin admin] The token cache is being invalidate because project 5f4689ac3ec44a88a740c1016dc4dfe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:35:44.126926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:44.127552 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-807eab29-bb56-4adf-a4d8-cb1e5f6d27e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:44.129058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1224/2450] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:35:43 2022] DELETE /identity/v3/projects/5f4689ac3ec44a88a740c1016dc4dfe9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:44.134717 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59761951-2668-4669-8777-456423d58bc4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:44.134999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59761951-2668-4669-8777-456423d58bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:44.135268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59761951-2668-4669-8777-456423d58bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:44.155377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-59761951-2668-4669-8777-456423d58bc4 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:44.156591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-59761951-2668-4669-8777-456423d58bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:44.216625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1227/2451] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:44.224627 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1f485-a494-4d37-b749-09bf0fa98ba7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:44.224913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1f485-a494-4d37-b749-09bf0fa98ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:44.225191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1f485-a494-4d37-b749-09bf0fa98ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:44.245599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-eba1f485-a494-4d37-b749-09bf0fa98ba7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:44.246840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eba1f485-a494-4d37-b749-09bf0fa98ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:44.254657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1225/2452] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:44.258678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59761951-2668-4669-8777-456423d58bc4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:44.268429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59761951-2668-4669-8777-456423d58bc4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:44.272980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b167d6-3cd2-453c-bbd6-66cb1dcb397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:44.273609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b167d6-3cd2-453c-bbd6-66cb1dcb397c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:44.273886 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b167d6-3cd2-453c-bbd6-66cb1dcb397c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:44.274221 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b167d6-3cd2-453c-bbd6-66cb1dcb397c admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:44.275102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b167d6-3cd2-453c-bbd6-66cb1dcb397c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:35:44.275526 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b167d6-3cd2-453c-bbd6-66cb1dcb397c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:44.277967 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b167d6-3cd2-453c-bbd6-66cb1dcb397c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:44.290325 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1228/2453] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:35:44.294685 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1f485-a494-4d37-b749-09bf0fa98ba7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:44.303804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1f485-a494-4d37-b749-09bf0fa98ba7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:44.309180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f751d-edc8-41f8-bd41-e5f3eef503ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:44.309801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f751d-edc8-41f8-bd41-e5f3eef503ad admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:44.310098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f751d-edc8-41f8-bd41-e5f3eef503ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:44.310352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f751d-edc8-41f8-bd41-e5f3eef503ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:44.310973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f751d-edc8-41f8-bd41-e5f3eef503ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:44.312862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f751d-edc8-41f8-bd41-e5f3eef503ad admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:44.391072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1226/2454] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:35:44 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:35:44.395447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b167d6-3cd2-453c-bbd6-66cb1dcb397c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:44.405395 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b167d6-3cd2-453c-bbd6-66cb1dcb397c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:44.461645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7acf4-66fe-4546-a3e0-466a082e3994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:44.462233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7acf4-66fe-4546-a3e0-466a082e3994 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:44.462510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7acf4-66fe-4546-a3e0-466a082e3994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:44.462781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7acf4-66fe-4546-a3e0-466a082e3994 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:44.463388 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7acf4-66fe-4546-a3e0-466a082e3994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:44.465318 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7acf4-66fe-4546-a3e0-466a082e3994 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:44.473178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:44.580014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1229/2455] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:35:44 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:35:44.584054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f751d-edc8-41f8-bd41-e5f3eef503ad admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:44.595372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f751d-edc8-41f8-bd41-e5f3eef503ad admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:44.600138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016850ba-03bd-4b85-a1b7-46965e601fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:44.600790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016850ba-03bd-4b85-a1b7-46965e601fba admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:44.601065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016850ba-03bd-4b85-a1b7-46965e601fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:44.601424 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016850ba-03bd-4b85-a1b7-46965e601fba admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:44.602104 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016850ba-03bd-4b85-a1b7-46965e601fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:44.604350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016850ba-03bd-4b85-a1b7-46965e601fba admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:44.614121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1227/2456] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:44.617978 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7acf4-66fe-4546-a3e0-466a082e3994 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:44.627737 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7acf4-66fe-4546-a3e0-466a082e3994 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:44.632308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44216ec-dafd-458e-8244-807fa0a80b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:44.632890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44216ec-dafd-458e-8244-807fa0a80b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:44.633163 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44216ec-dafd-458e-8244-807fa0a80b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:44.633465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44216ec-dafd-458e-8244-807fa0a80b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:44.634086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44216ec-dafd-458e-8244-807fa0a80b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:44.635661 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44216ec-dafd-458e-8244-807fa0a80b30 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:44.646269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1230/2457] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:44.650745 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016850ba-03bd-4b85-a1b7-46965e601fba admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:44.660702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016850ba-03bd-4b85-a1b7-46965e601fba admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:44.665869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49925750-b395-4ad2-bc48-e1a1838b2bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:44.666506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49925750-b395-4ad2-bc48-e1a1838b2bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:44.666784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49925750-b395-4ad2-bc48-e1a1838b2bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:44.667054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49925750-b395-4ad2-bc48-e1a1838b2bfc admin admin] PATH_INFO: `/v3/projects/03a864b02ace46b9b7432e4b250c78a1/users/9f8ea305c1f5438bb16d51b51a9d3e3a/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:44.681382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49925750-b395-4ad2-bc48-e1a1838b2bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a864b02ace46b9b7432e4b250c78a1, user_id=9f8ea305c1f5438bb16d51b51a9d3e3a, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:44.684052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49925750-b395-4ad2-bc48-e1a1838b2bfc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:44.774982 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1228/2458] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:35:44 2022] PUT /identity/v3/projects/03a864b02ace46b9b7432e4b250c78a1/users/9f8ea305c1f5438bb16d51b51a9d3e3a/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:44.786093 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4e7a8-b66e-4e31-95f7-93a55aa3270a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:44.786376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4e7a8-b66e-4e31-95f7-93a55aa3270a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:44.786646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4e7a8-b66e-4e31-95f7-93a55aa3270a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:44.814567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-53c4e7a8-b66e-4e31-95f7-93a55aa3270a None None] MFA Rules not processed for user `9f8ea305c1f5438bb16d51b51a9d3e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:44.815770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-53c4e7a8-b66e-4e31-95f7-93a55aa3270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:44.878245 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1231/2459] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:44.889359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49925750-b395-4ad2-bc48-e1a1838b2bfc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:44.891115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-49925750-b395-4ad2-bc48-e1a1838b2bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:44.906097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:44.966234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49925750-b395-4ad2-bc48-e1a1838b2bfc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:44.972267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945345fc-70a8-4f2e-a77b-93c31d04ac18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:44.973731 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945345fc-70a8-4f2e-a77b-93c31d04ac18 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:44.973731 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945345fc-70a8-4f2e-a77b-93c31d04ac18 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:44.973731 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945345fc-70a8-4f2e-a77b-93c31d04ac18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:44.981824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945345fc-70a8-4f2e-a77b-93c31d04ac18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:44.983682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945345fc-70a8-4f2e-a77b-93c31d04ac18 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:44.992601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1229/2460] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:45.199664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4e7a8-b66e-4e31-95f7-93a55aa3270a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:45.262125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4e7a8-b66e-4e31-95f7-93a55aa3270a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:45.266848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:45.267460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:45.267732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:45.268001 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] PATH_INFO: `/v3/users/9f8ea305c1f5438bb16d51b51a9d3e3a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:45.269091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8ea305c1f5438bb16d51b51a9d3e3a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:45.271027 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:45.420738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8ea305c1f5438bb16d51b51a9d3e3a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:45.481696 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8ea305c1f5438bb16d51b51a9d3e3a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:45.482316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8ea305c1f5438bb16d51b51a9d3e3a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:45.482930 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8ea305c1f5438bb16d51b51a9d3e3a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:45.490610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8ea305c1f5438bb16d51b51a9d3e3a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:45.496506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:45.509641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1232/2461] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:35:45 2022] DELETE /identity/v3/users/9f8ea305c1f5438bb16d51b51a9d3e3a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:45.514394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0858a-524e-494a-9590-825c7c9951bc None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:45.514649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0858a-524e-494a-9590-825c7c9951bc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:45.514922 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0858a-524e-494a-9590-825c7c9951bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:45.533461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7df0858a-524e-494a-9590-825c7c9951bc None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:45.534692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7df0858a-524e-494a-9590-825c7c9951bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:45.594509 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1230/2462] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:45.604207 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:45.605647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:45.662521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f0c21-6ff4-4b07-b099-cbe0daf9c374 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:45.666124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b48db-0fbf-4e14-9a18-01e4543717ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:45.666719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b48db-0fbf-4e14-9a18-01e4543717ea service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:45.666996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b48db-0fbf-4e14-9a18-01e4543717ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:45.667265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b48db-0fbf-4e14-9a18-01e4543717ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:45.676006 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b48db-0fbf-4e14-9a18-01e4543717ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:45.677457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b48db-0fbf-4e14-9a18-01e4543717ea service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:45.688550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1233/2463] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:46.072796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0858a-524e-494a-9590-825c7c9951bc None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:46.074336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7df0858a-524e-494a-9590-825c7c9951bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:46.090147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0858a-524e-494a-9590-825c7c9951bc None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:46.095955 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6719873-622b-470c-8e00-f0509893f720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:46.096687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6719873-622b-470c-8e00-f0509893f720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:46.096844 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6719873-622b-470c-8e00-f0509893f720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:46.097208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6719873-622b-470c-8e00-f0509893f720 admin admin] PATH_INFO: `/v3/projects/03a864b02ace46b9b7432e4b250c78a1` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:46.098360 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6719873-622b-470c-8e00-f0509893f720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a864b02ace46b9b7432e4b250c78a1)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:46.100389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6719873-622b-470c-8e00-f0509893f720 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:46.185511 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e6719873-622b-470c-8e00-f0509893f720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a864b02ace46b9b7432e4b250c78a1', 'request_id': 'req-e6719873-622b-470c-8e00-f0509893f720'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:46.191604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e6719873-622b-470c-8e00-f0509893f720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a864b02ace46b9b7432e4b250c78a1', 'request_id': 'req-e6719873-622b-470c-8e00-f0509893f720'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:46.235828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e6719873-622b-470c-8e00-f0509893f720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a864b02ace46b9b7432e4b250c78a1', 'request_id': 'req-e6719873-622b-470c-8e00-f0509893f720'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:46.246462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e6719873-622b-470c-8e00-f0509893f720 admin admin] The token cache is being invalidate because project 03a864b02ace46b9b7432e4b250c78a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:35:46.246747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e6719873-622b-470c-8e00-f0509893f720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:46.247362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e6719873-622b-470c-8e00-f0509893f720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:46.248842 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1231/2464] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:35:46 2022] DELETE /identity/v3/projects/03a864b02ace46b9b7432e4b250c78a1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:46.253674 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef543d69-ff8f-4aa5-8416-0e23a72d70f7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:46.253959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef543d69-ff8f-4aa5-8416-0e23a72d70f7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:46.254230 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef543d69-ff8f-4aa5-8416-0e23a72d70f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:46.275278 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ef543d69-ff8f-4aa5-8416-0e23a72d70f7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:46.276516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ef543d69-ff8f-4aa5-8416-0e23a72d70f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:46.332859 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1234/2465] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:46.341366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb8171-338b-4297-8c8c-fc658baac52b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:46.341658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb8171-338b-4297-8c8c-fc658baac52b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:46.341928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb8171-338b-4297-8c8c-fc658baac52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:46.361952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-94cb8171-338b-4297-8c8c-fc658baac52b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:46.363166 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-94cb8171-338b-4297-8c8c-fc658baac52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:46.371071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1232/2466] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:46.375050 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef543d69-ff8f-4aa5-8416-0e23a72d70f7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:46.384533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef543d69-ff8f-4aa5-8416-0e23a72d70f7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:46.389005 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de461f-a9dc-4c7a-9afb-339e3e0a2117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:46.389635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de461f-a9dc-4c7a-9afb-339e3e0a2117 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:46.389893 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de461f-a9dc-4c7a-9afb-339e3e0a2117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:46.390160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de461f-a9dc-4c7a-9afb-339e3e0a2117 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:46.390797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de461f-a9dc-4c7a-9afb-339e3e0a2117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:35:46.391097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de461f-a9dc-4c7a-9afb-339e3e0a2117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:46.392682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de461f-a9dc-4c7a-9afb-339e3e0a2117 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:46.404327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1235/2467] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:35:46.408567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb8171-338b-4297-8c8c-fc658baac52b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:46.418515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb8171-338b-4297-8c8c-fc658baac52b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:46.423246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c9665-5f3d-448a-b19e-ec63d51528a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:46.423869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c9665-5f3d-448a-b19e-ec63d51528a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:46.424146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c9665-5f3d-448a-b19e-ec63d51528a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:46.424446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c9665-5f3d-448a-b19e-ec63d51528a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:46.425066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c9665-5f3d-448a-b19e-ec63d51528a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:46.427009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c9665-5f3d-448a-b19e-ec63d51528a4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:46.441307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:46.506673 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1233/2468] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:35:46 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:35:46.511368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de461f-a9dc-4c7a-9afb-339e3e0a2117 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:46.521196 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de461f-a9dc-4c7a-9afb-339e3e0a2117 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:46.576732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0e9ee-8532-4975-8fad-94b6b0f2ef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:46.577371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0e9ee-8532-4975-8fad-94b6b0f2ef53 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:46.577652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0e9ee-8532-4975-8fad-94b6b0f2ef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:46.577924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0e9ee-8532-4975-8fad-94b6b0f2ef53 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:46.578557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0e9ee-8532-4975-8fad-94b6b0f2ef53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:46.580496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0e9ee-8532-4975-8fad-94b6b0f2ef53 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:46.694695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1236/2469] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:35:46 2022] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:35:46.699375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c9665-5f3d-448a-b19e-ec63d51528a4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:46.709770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c9665-5f3d-448a-b19e-ec63d51528a4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:46.715406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7b587-0fca-4f01-b52c-24741e2bed7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:46.716119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7b587-0fca-4f01-b52c-24741e2bed7e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:46.717812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7b587-0fca-4f01-b52c-24741e2bed7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:46.717812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7b587-0fca-4f01-b52c-24741e2bed7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:46.717812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7b587-0fca-4f01-b52c-24741e2bed7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:46.718858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7b587-0fca-4f01-b52c-24741e2bed7e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:46.728983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1234/2470] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:46.732951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0e9ee-8532-4975-8fad-94b6b0f2ef53 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:46.743213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0e9ee-8532-4975-8fad-94b6b0f2ef53 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:46.747793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2983b-5f49-4dc1-be0b-737970fc601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:46.748373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2983b-5f49-4dc1-be0b-737970fc601b admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:46.748647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2983b-5f49-4dc1-be0b-737970fc601b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:46.748914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2983b-5f49-4dc1-be0b-737970fc601b admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:46.749574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2983b-5f49-4dc1-be0b-737970fc601b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:46.751825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2983b-5f49-4dc1-be0b-737970fc601b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:46.753037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:46.763252 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1237/2471] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:46.767261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7b587-0fca-4f01-b52c-24741e2bed7e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:46.777937 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7b587-0fca-4f01-b52c-24741e2bed7e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:46.782644 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d8fbc-79e4-48e1-b7e3-f630e94a7eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:46.783304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d8fbc-79e4-48e1-b7e3-f630e94a7eab admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:46.786850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d8fbc-79e4-48e1-b7e3-f630e94a7eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:46.786850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d8fbc-79e4-48e1-b7e3-f630e94a7eab admin admin] PATH_INFO: `/v3/projects/98473e888c6341018945cab6aac10e8a/users/64f857d1ca64406b8620009d0cbb08bd/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:46.799183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d8fbc-79e4-48e1-b7e3-f630e94a7eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=98473e888c6341018945cab6aac10e8a, user_id=64f857d1ca64406b8620009d0cbb08bd, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:46.802018 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d8fbc-79e4-48e1-b7e3-f630e94a7eab admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:46.875824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1235/2472] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:35:46 2022] PUT /identity/v3/projects/98473e888c6341018945cab6aac10e8a/users/64f857d1ca64406b8620009d0cbb08bd/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:46.887449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949a5e1-ef7d-45df-b101-8c21825387e8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:46.887742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949a5e1-ef7d-45df-b101-8c21825387e8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:46.888020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949a5e1-ef7d-45df-b101-8c21825387e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:46.915189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9949a5e1-ef7d-45df-b101-8c21825387e8 None None] MFA Rules not processed for user `64f857d1ca64406b8620009d0cbb08bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:46.916394 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9949a5e1-ef7d-45df-b101-8c21825387e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:46.981344 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1238/2473] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:46.986158 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d8fbc-79e4-48e1-b7e3-f630e94a7eab admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:47.046158 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d8fbc-79e4-48e1-b7e3-f630e94a7eab admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:47.050773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46484943-e5f5-435f-8a1e-084de57f7d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:47.051360 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46484943-e5f5-435f-8a1e-084de57f7d1e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:47.051635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46484943-e5f5-435f-8a1e-084de57f7d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:47.051912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46484943-e5f5-435f-8a1e-084de57f7d1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:47.052533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46484943-e5f5-435f-8a1e-084de57f7d1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:47.054469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46484943-e5f5-435f-8a1e-084de57f7d1e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:47.161662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1236/2474] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:35:46 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:35:47.162789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949a5e1-ef7d-45df-b101-8c21825387e8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:47.173584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949a5e1-ef7d-45df-b101-8c21825387e8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:47.229092 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830042d0-8f2a-43ce-bf74-0395b4bbbc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:47.229721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830042d0-8f2a-43ce-bf74-0395b4bbbc5f admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:47.230005 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830042d0-8f2a-43ce-bf74-0395b4bbbc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:47.230275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830042d0-8f2a-43ce-bf74-0395b4bbbc5f admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:47.230930 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830042d0-8f2a-43ce-bf74-0395b4bbbc5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:47.232912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830042d0-8f2a-43ce-bf74-0395b4bbbc5f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:47.306194 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1239/2475] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:35:47 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:35:47.310144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46484943-e5f5-435f-8a1e-084de57f7d1e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:47.320408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46484943-e5f5-435f-8a1e-084de57f7d1e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:47.325082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc46ad0-c906-4e32-9b87-552c773d93d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:47.325703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46ad0-c906-4e32-9b87-552c773d93d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:47.325981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46ad0-c906-4e32-9b87-552c773d93d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:47.326252 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46ad0-c906-4e32-9b87-552c773d93d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:47.326987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc46ad0-c906-4e32-9b87-552c773d93d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:47.328571 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc46ad0-c906-4e32-9b87-552c773d93d9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:47.340310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1237/2476] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:47.344266 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830042d0-8f2a-43ce-bf74-0395b4bbbc5f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:47.354799 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830042d0-8f2a-43ce-bf74-0395b4bbbc5f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:47.359919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3796193-9b2e-4017-80a0-8028b62a15bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:47.360354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3796193-9b2e-4017-80a0-8028b62a15bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:47.360636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3796193-9b2e-4017-80a0-8028b62a15bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:47.360913 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3796193-9b2e-4017-80a0-8028b62a15bf admin admin] PATH_INFO: `/v3/projects/29715d785ccd43d08f3c7e1abb7d70b0/users/f846f5ba85234309bdb3f986aa73e7a8/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:47.376282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3796193-9b2e-4017-80a0-8028b62a15bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=29715d785ccd43d08f3c7e1abb7d70b0, user_id=f846f5ba85234309bdb3f986aa73e7a8, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:47.378973 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3796193-9b2e-4017-80a0-8028b62a15bf admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:47.431595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1240/2477] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:35:47 2022] PUT /identity/v3/projects/29715d785ccd43d08f3c7e1abb7d70b0/users/f846f5ba85234309bdb3f986aa73e7a8/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:35:47.435815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc46ad0-c906-4e32-9b87-552c773d93d9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:47.445766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc46ad0-c906-4e32-9b87-552c773d93d9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:47.501028 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fb288-65b9-4cbd-9e9d-921656f4438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:47.501604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fb288-65b9-4cbd-9e9d-921656f4438f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:47.501882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fb288-65b9-4cbd-9e9d-921656f4438f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:47.502174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fb288-65b9-4cbd-9e9d-921656f4438f admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:47.502791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fb288-65b9-4cbd-9e9d-921656f4438f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:47.504380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fb288-65b9-4cbd-9e9d-921656f4438f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:47.513934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1238/2478] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:47.518139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3796193-9b2e-4017-80a0-8028b62a15bf admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:47.528141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3796193-9b2e-4017-80a0-8028b62a15bf admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:47.532775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21366917-0250-4fa4-a4a1-5642bab7fa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:47.533452 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21366917-0250-4fa4-a4a1-5642bab7fa12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:47.533738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21366917-0250-4fa4-a4a1-5642bab7fa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:47.534011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21366917-0250-4fa4-a4a1-5642bab7fa12 admin admin] PATH_INFO: `/v3/projects/29715d785ccd43d08f3c7e1abb7d70b0/users/f846f5ba85234309bdb3f986aa73e7a8/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:47.535890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21366917-0250-4fa4-a4a1-5642bab7fa12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29715d785ccd43d08f3c7e1abb7d70b0, user_id=f846f5ba85234309bdb3f986aa73e7a8, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:47.538556 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21366917-0250-4fa4-a4a1-5642bab7fa12 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:47.549031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1241/2479] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:35:47 2022] PUT /identity/v3/projects/29715d785ccd43d08f3c7e1abb7d70b0/users/f846f5ba85234309bdb3f986aa73e7a8/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:47.560963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46aad2-efd2-4820-b11c-a443b8e34725 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:47.561278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46aad2-efd2-4820-b11c-a443b8e34725 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:47.561565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46aad2-efd2-4820-b11c-a443b8e34725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:47.589429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fa46aad2-efd2-4820-b11c-a443b8e34725 None None] MFA Rules not processed for user `f846f5ba85234309bdb3f986aa73e7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:47.590619 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fa46aad2-efd2-4820-b11c-a443b8e34725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:47.607266 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:47.658929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1239/2480] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:47.670838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21366917-0250-4fa4-a4a1-5642bab7fa12 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:47.672530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-21366917-0250-4fa4-a4a1-5642bab7fa12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:47.714169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:47.729191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21366917-0250-4fa4-a4a1-5642bab7fa12 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:47.732816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcf6a5-0b60-43a7-a474-0ff8eef35400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:47.733455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcf6a5-0b60-43a7-a474-0ff8eef35400 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:47.733736 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcf6a5-0b60-43a7-a474-0ff8eef35400 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:47.734005 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcf6a5-0b60-43a7-a474-0ff8eef35400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:47.742715 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcf6a5-0b60-43a7-a474-0ff8eef35400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:47.744157 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcf6a5-0b60-43a7-a474-0ff8eef35400 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:47.753735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1242/2481] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:47.858442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46aad2-efd2-4820-b11c-a443b8e34725 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:47.860139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fa46aad2-efd2-4820-b11c-a443b8e34725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:47.872062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46aad2-efd2-4820-b11c-a443b8e34725 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:47.875701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d4519-2337-4329-b7e0-90a7b65fb139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:47.876299 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4519-2337-4329-b7e0-90a7b65fb139 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:47.876572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4519-2337-4329-b7e0-90a7b65fb139 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:47.876865 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d4519-2337-4329-b7e0-90a7b65fb139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:47.934238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d4519-2337-4329-b7e0-90a7b65fb139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:47.935706 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d4519-2337-4329-b7e0-90a7b65fb139 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:47.944708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1240/2482] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:48.275304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcf6a5-0b60-43a7-a474-0ff8eef35400 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:48.276760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-22bcf6a5-0b60-43a7-a474-0ff8eef35400 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:48.351462 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcf6a5-0b60-43a7-a474-0ff8eef35400 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:48.359709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ece8f-1a29-4a88-99da-32aa32aa8c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:48.360356 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ece8f-1a29-4a88-99da-32aa32aa8c12 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:48.360654 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ece8f-1a29-4a88-99da-32aa32aa8c12 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:48.360924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ece8f-1a29-4a88-99da-32aa32aa8c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:48.362690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0a2ece8f-1a29-4a88-99da-32aa32aa8c12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:48.421439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ece8f-1a29-4a88-99da-32aa32aa8c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:48.423343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ece8f-1a29-4a88-99da-32aa32aa8c12 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:48.433279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1243/2483] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:52.862934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d4519-2337-4329-b7e0-90a7b65fb139 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:52.924038 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d4519-2337-4329-b7e0-90a7b65fb139 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:52.928534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:52.929160 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:52.929479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:52.929755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] PATH_INFO: `/v3/users/64f857d1ca64406b8620009d0cbb08bd` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:52.930885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f857d1ca64406b8620009d0cbb08bd)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:52.933337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:53.080558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f857d1ca64406b8620009d0cbb08bd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:53.081225 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f857d1ca64406b8620009d0cbb08bd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:53.081857 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f857d1ca64406b8620009d0cbb08bd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:53.087514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:53.089492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f857d1ca64406b8620009d0cbb08bd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:53.102131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f857d1ca64406b8620009d0cbb08bd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:53.158131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1241/2484] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:35:52 2022] DELETE /identity/v3/users/64f857d1ca64406b8620009d0cbb08bd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:53.162542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e0abb-0007-4589-befb-2938cc999a61 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:53.162947 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e0abb-0007-4589-befb-2938cc999a61 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:53.164510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e0abb-0007-4589-befb-2938cc999a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:53.183755 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-235e0abb-0007-4589-befb-2938cc999a61 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:53.184958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-235e0abb-0007-4589-befb-2938cc999a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:53.246367 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1244/2485] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:53.257767 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:53.259357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:53.318997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73450937-b12d-41d3-8350-3db64b752492 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:53.322727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65155980-25d6-4bdd-97aa-485e2f759a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:53.323330 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65155980-25d6-4bdd-97aa-485e2f759a32 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:53.323605 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65155980-25d6-4bdd-97aa-485e2f759a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:53.323873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65155980-25d6-4bdd-97aa-485e2f759a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:53.333005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65155980-25d6-4bdd-97aa-485e2f759a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:53.334477 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65155980-25d6-4bdd-97aa-485e2f759a32 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:53.344424 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1242/2486] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:53.768992 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e0abb-0007-4589-befb-2938cc999a61 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:53.770718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-235e0abb-0007-4589-befb-2938cc999a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:53.794275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e0abb-0007-4589-befb-2938cc999a61 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:53.794275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:53.794275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:53.794275 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:53.794719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] PATH_INFO: `/v3/projects/98473e888c6341018945cab6aac10e8a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:53.794719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=98473e888c6341018945cab6aac10e8a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:53.794719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:53.807930 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:53.906542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98473e888c6341018945cab6aac10e8a', 'request_id': 'req-5f5f318b-a041-47af-80b1-c94ec6fbadcb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:53.912887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98473e888c6341018945cab6aac10e8a', 'request_id': 'req-5f5f318b-a041-47af-80b1-c94ec6fbadcb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:53.980118 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98473e888c6341018945cab6aac10e8a', 'request_id': 'req-5f5f318b-a041-47af-80b1-c94ec6fbadcb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:53.991382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] The token cache is being invalidate because project 98473e888c6341018945cab6aac10e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:35:53.991665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:53.992311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:53.993829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1245/2487] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:35:53 2022] DELETE /identity/v3/projects/98473e888c6341018945cab6aac10e8a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:53.997914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65155980-25d6-4bdd-97aa-485e2f759a32 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:54.007555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65155980-25d6-4bdd-97aa-485e2f759a32 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:54.064298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cec906-8d7e-47d0-a320-202cb4230c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:54.065084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cec906-8d7e-47d0-a320-202cb4230c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:54.065402 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cec906-8d7e-47d0-a320-202cb4230c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:54.065679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cec906-8d7e-47d0-a320-202cb4230c17 admin admin] PATH_INFO: `/v3/users/f846f5ba85234309bdb3f986aa73e7a8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:54.066804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cec906-8d7e-47d0-a320-202cb4230c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f846f5ba85234309bdb3f986aa73e7a8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:54.068713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cec906-8d7e-47d0-a320-202cb4230c17 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:54.250538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-03cec906-8d7e-47d0-a320-202cb4230c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f846f5ba85234309bdb3f986aa73e7a8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:54.251303 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-03cec906-8d7e-47d0-a320-202cb4230c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f846f5ba85234309bdb3f986aa73e7a8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:54.251929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-03cec906-8d7e-47d0-a320-202cb4230c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f846f5ba85234309bdb3f986aa73e7a8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:54.259692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-03cec906-8d7e-47d0-a320-202cb4230c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f846f5ba85234309bdb3f986aa73e7a8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:54.271963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-03cec906-8d7e-47d0-a320-202cb4230c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f846f5ba85234309bdb3f986aa73e7a8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:54.274604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:54.346081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1243/2488] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:35:53 2022] DELETE /identity/v3/users/f846f5ba85234309bdb3f986aa73e7a8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:54.754199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:54.755670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:54.774660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f318b-a041-47af-80b1-c94ec6fbadcb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:54.833793 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:54.834432 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:54.834687 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:54.834953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd admin admin] PATH_INFO: `/v3/projects/29715d785ccd43d08f3c7e1abb7d70b0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:54.836338 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=29715d785ccd43d08f3c7e1abb7d70b0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:54.838295 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:54.953375 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29715d785ccd43d08f3c7e1abb7d70b0', 'request_id': 'req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:54.959717 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29715d785ccd43d08f3c7e1abb7d70b0', 'request_id': 'req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:55.042281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29715d785ccd43d08f3c7e1abb7d70b0', 'request_id': 'req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:55.054105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd admin admin] The token cache is being invalidate because project 29715d785ccd43d08f3c7e1abb7d70b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:35:55.054412 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:55.055080 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-572192a5-2427-4f78-afb8-5d2cbf9ea5dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:35:55.057241 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1246/2489] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:35:54 2022] DELETE /identity/v3/projects/29715d785ccd43d08f3c7e1abb7d70b0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:55.062765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25359250-5a4c-4ab5-bf67-9b47f1d6b149 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:55.063230 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25359250-5a4c-4ab5-bf67-9b47f1d6b149 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:55.063230 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25359250-5a4c-4ab5-bf67-9b47f1d6b149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:55.082693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-25359250-5a4c-4ab5-bf67-9b47f1d6b149 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:55.083887 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-25359250-5a4c-4ab5-bf67-9b47f1d6b149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:55.147655 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1244/2490] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:35:55.155879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193e44-3ea7-433e-a2bc-141fd80d72da None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:55.156361 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193e44-3ea7-433e-a2bc-141fd80d72da None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:55.157020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193e44-3ea7-433e-a2bc-141fd80d72da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:55.177044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-58193e44-3ea7-433e-a2bc-141fd80d72da None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:55.178386 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-58193e44-3ea7-433e-a2bc-141fd80d72da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:55.186299 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1247/2491] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:55.190803 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25359250-5a4c-4ab5-bf67-9b47f1d6b149 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:55.200657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25359250-5a4c-4ab5-bf67-9b47f1d6b149 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:55.205565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b7d06-6c97-44ff-bba4-26e272625509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:55.206373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b7d06-6c97-44ff-bba4-26e272625509 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:55.206653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b7d06-6c97-44ff-bba4-26e272625509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:55.206925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b7d06-6c97-44ff-bba4-26e272625509 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:55.207576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b7d06-6c97-44ff-bba4-26e272625509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:35:55.207883 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b7d06-6c97-44ff-bba4-26e272625509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:55.209508 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b7d06-6c97-44ff-bba4-26e272625509 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:55.221965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1245/2492] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:35:55.226161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193e44-3ea7-433e-a2bc-141fd80d72da None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:55.236040 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193e44-3ea7-433e-a2bc-141fd80d72da None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:55.240706 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079a64e-e18d-486f-b813-3fbe15acc04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:55.241320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079a64e-e18d-486f-b813-3fbe15acc04c admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:55.241604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079a64e-e18d-486f-b813-3fbe15acc04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:55.241876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079a64e-e18d-486f-b813-3fbe15acc04c admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:55.242545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079a64e-e18d-486f-b813-3fbe15acc04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:55.244434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079a64e-e18d-486f-b813-3fbe15acc04c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:55.327924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1248/2493] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:35:55 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:35:55.332071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b7d06-6c97-44ff-bba4-26e272625509 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:55.342623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b7d06-6c97-44ff-bba4-26e272625509 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:55.398473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2354c-172e-49b9-9648-9e4137796406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:55.399074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2354c-172e-49b9-9648-9e4137796406 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:55.399352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2354c-172e-49b9-9648-9e4137796406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:55.399626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2354c-172e-49b9-9648-9e4137796406 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:55.400734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2354c-172e-49b9-9648-9e4137796406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:55.402698 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2354c-172e-49b9-9648-9e4137796406 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:55.470860 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1246/2494] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:35:55 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:35:55.474994 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079a64e-e18d-486f-b813-3fbe15acc04c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:55.480481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:55.485762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079a64e-e18d-486f-b813-3fbe15acc04c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:55.490664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048d769-04ff-49ed-8892-369e86763f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:55.494328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048d769-04ff-49ed-8892-369e86763f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:55.494328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048d769-04ff-49ed-8892-369e86763f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:55.494328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048d769-04ff-49ed-8892-369e86763f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:55.494328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048d769-04ff-49ed-8892-369e86763f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:55.494328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048d769-04ff-49ed-8892-369e86763f7f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:55.503720 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1249/2495] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:55.507724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2354c-172e-49b9-9648-9e4137796406 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:55.518042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2354c-172e-49b9-9648-9e4137796406 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:55.522595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec27df-8392-4be6-85ba-9a1b3f04a0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:55.523171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec27df-8392-4be6-85ba-9a1b3f04a0ce admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:55.523446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec27df-8392-4be6-85ba-9a1b3f04a0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:55.523713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec27df-8392-4be6-85ba-9a1b3f04a0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:55.528741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec27df-8392-4be6-85ba-9a1b3f04a0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:55.528741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec27df-8392-4be6-85ba-9a1b3f04a0ce admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:55.537677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1247/2496] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:55.541884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048d769-04ff-49ed-8892-369e86763f7f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:55.552970 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048d769-04ff-49ed-8892-369e86763f7f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:55.557815 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feba51-f797-4d73-962d-3bb46ff2a93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:55.558466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feba51-f797-4d73-962d-3bb46ff2a93c admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:55.558748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feba51-f797-4d73-962d-3bb46ff2a93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:55.559024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feba51-f797-4d73-962d-3bb46ff2a93c admin admin] PATH_INFO: `/v3/projects/c15e044ac18044e7b971346d71508c16/users/333225e632ca4422a7a225c18d852ec5/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:55.574761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feba51-f797-4d73-962d-3bb46ff2a93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15e044ac18044e7b971346d71508c16, user_id=333225e632ca4422a7a225c18d852ec5, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:55.577653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feba51-f797-4d73-962d-3bb46ff2a93c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:55.654765 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1250/2497] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:35:55 2022] PUT /identity/v3/projects/c15e044ac18044e7b971346d71508c16/users/333225e632ca4422a7a225c18d852ec5/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:55.665106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbcb19-8a26-4bad-8c78-ab5ab2d46818 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:55.665489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbcb19-8a26-4bad-8c78-ab5ab2d46818 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:55.665766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbcb19-8a26-4bad-8c78-ab5ab2d46818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:55.692905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1fcbcb19-8a26-4bad-8c78-ab5ab2d46818 None None] MFA Rules not processed for user `333225e632ca4422a7a225c18d852ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:55.694140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1fcbcb19-8a26-4bad-8c78-ab5ab2d46818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:55.740162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:55.756964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1248/2498] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:55.762028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feba51-f797-4d73-962d-3bb46ff2a93c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:55.829560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feba51-f797-4d73-962d-3bb46ff2a93c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:55.834798 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a3ec3-f2bf-4a0c-a451-bd0e7fa0d7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:55.835496 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a3ec3-f2bf-4a0c-a451-bd0e7fa0d7ef admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:55.836151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a3ec3-f2bf-4a0c-a451-bd0e7fa0d7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:55.836420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a3ec3-f2bf-4a0c-a451-bd0e7fa0d7ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:55.837116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a3ec3-f2bf-4a0c-a451-bd0e7fa0d7ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:55.840009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a3ec3-f2bf-4a0c-a451-bd0e7fa0d7ef admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:55.924952 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1251/2499] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:35:55 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:35:55.929067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbcb19-8a26-4bad-8c78-ab5ab2d46818 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:55.940306 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbcb19-8a26-4bad-8c78-ab5ab2d46818 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:55.999511 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c257f9a-dcb4-4111-b9b0-858c70e9d42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:56.000097 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c257f9a-dcb4-4111-b9b0-858c70e9d42a admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:56.000384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c257f9a-dcb4-4111-b9b0-858c70e9d42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:56.000767 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c257f9a-dcb4-4111-b9b0-858c70e9d42a admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:56.001460 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c257f9a-dcb4-4111-b9b0-858c70e9d42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:56.003393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c257f9a-dcb4-4111-b9b0-858c70e9d42a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:56.123905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1249/2500] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:35:55 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:35:56.127943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a3ec3-f2bf-4a0c-a451-bd0e7fa0d7ef admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:56.138984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a3ec3-f2bf-4a0c-a451-bd0e7fa0d7ef admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:56.143522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d419481-f092-4395-bd9c-3e5dc3ebd012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:56.144116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d419481-f092-4395-bd9c-3e5dc3ebd012 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:56.144417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d419481-f092-4395-bd9c-3e5dc3ebd012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:56.144691 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d419481-f092-4395-bd9c-3e5dc3ebd012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:56.145354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d419481-f092-4395-bd9c-3e5dc3ebd012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:56.146985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d419481-f092-4395-bd9c-3e5dc3ebd012 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:56.158112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1252/2501] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:56.162112 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c257f9a-dcb4-4111-b9b0-858c70e9d42a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:56.171894 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c257f9a-dcb4-4111-b9b0-858c70e9d42a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:56.176404 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131307b-5257-4f24-b56e-070a7e761b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:56.176986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131307b-5257-4f24-b56e-070a7e761b6d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:56.177278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131307b-5257-4f24-b56e-070a7e761b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:56.177555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131307b-5257-4f24-b56e-070a7e761b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:56.178189 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131307b-5257-4f24-b56e-070a7e761b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:56.179776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131307b-5257-4f24-b56e-070a7e761b6d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:56.189865 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1250/2502] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:56.193645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d419481-f092-4395-bd9c-3e5dc3ebd012 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:56.204002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d419481-f092-4395-bd9c-3e5dc3ebd012 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:56.208462 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf0796-34c5-4638-988d-1aef52018666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:56.209088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf0796-34c5-4638-988d-1aef52018666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:56.209426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf0796-34c5-4638-988d-1aef52018666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:56.209697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf0796-34c5-4638-988d-1aef52018666 admin admin] PATH_INFO: `/v3/projects/7ade279b482f4b93b409353753b58e5c/users/de2f26a7768a43c79c148b0ab577518b/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:56.225422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf0796-34c5-4638-988d-1aef52018666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ade279b482f4b93b409353753b58e5c, user_id=de2f26a7768a43c79c148b0ab577518b, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:56.228573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf0796-34c5-4638-988d-1aef52018666 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:56.319104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1253/2503] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:35:56 2022] PUT /identity/v3/projects/7ade279b482f4b93b409353753b58e5c/users/de2f26a7768a43c79c148b0ab577518b/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:56.330654 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98cb52-276d-46c0-911d-3430574d2ce5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:56.330938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98cb52-276d-46c0-911d-3430574d2ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:56.331212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98cb52-276d-46c0-911d-3430574d2ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:56.361190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6d98cb52-276d-46c0-911d-3430574d2ce5 None None] MFA Rules not processed for user `de2f26a7768a43c79c148b0ab577518b`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:56.362479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6d98cb52-276d-46c0-911d-3430574d2ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:56.429926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1251/2504] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:35:56.435114 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf0796-34c5-4638-988d-1aef52018666 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:56.495847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf0796-34c5-4638-988d-1aef52018666 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:56.500486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edf2ad-b2d9-4ecc-be55-b4ac7f0140c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:56.501087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edf2ad-b2d9-4ecc-be55-b4ac7f0140c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:56.501408 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edf2ad-b2d9-4ecc-be55-b4ac7f0140c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:56.501678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edf2ad-b2d9-4ecc-be55-b4ac7f0140c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:56.502308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edf2ad-b2d9-4ecc-be55-b4ac7f0140c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:56.504205 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edf2ad-b2d9-4ecc-be55-b4ac7f0140c4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:56.580238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1254/2505] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:35:56 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:35:56.584752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98cb52-276d-46c0-911d-3430574d2ce5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:56.597243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98cb52-276d-46c0-911d-3430574d2ce5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:56.648129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:56.654621 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4d745-2e41-432a-bb4d-076cf1746ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:56.655262 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4d745-2e41-432a-bb4d-076cf1746ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:56.655564 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4d745-2e41-432a-bb4d-076cf1746ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:56.655837 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4d745-2e41-432a-bb4d-076cf1746ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:56.656476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4d745-2e41-432a-bb4d-076cf1746ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:56.658572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4d745-2e41-432a-bb4d-076cf1746ca3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:56.741382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1252/2506] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:35:56 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:35:56.744524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edf2ad-b2d9-4ecc-be55-b4ac7f0140c4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:56.750167 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:56.755849 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edf2ad-b2d9-4ecc-be55-b4ac7f0140c4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:56.760537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788537e-cec0-42f4-bf6a-a31bfda1670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:56.761134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788537e-cec0-42f4-bf6a-a31bfda1670c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:56.761453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788537e-cec0-42f4-bf6a-a31bfda1670c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:56.761725 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788537e-cec0-42f4-bf6a-a31bfda1670c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:56.762355 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788537e-cec0-42f4-bf6a-a31bfda1670c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:56.763965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788537e-cec0-42f4-bf6a-a31bfda1670c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:56.776830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1255/2507] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:56.780909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4d745-2e41-432a-bb4d-076cf1746ca3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:56.791482 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4d745-2e41-432a-bb4d-076cf1746ca3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:56.797331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a5007-9207-4a58-842d-8fac12b5527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:56.798199 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a5007-9207-4a58-842d-8fac12b5527e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:56.798456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a5007-9207-4a58-842d-8fac12b5527e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:56.803782 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a5007-9207-4a58-842d-8fac12b5527e admin admin] PATH_INFO: `/v3/projects/f1bbaab1b94e4590b2a29b479825cb41/users/a07e2db8603042c0867ddd6fd184ed32/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:56.814263 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a5007-9207-4a58-842d-8fac12b5527e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bbaab1b94e4590b2a29b479825cb41, user_id=a07e2db8603042c0867ddd6fd184ed32, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:56.816941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a5007-9207-4a58-842d-8fac12b5527e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:56.877918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1253/2508] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:35:56 2022] PUT /identity/v3/projects/f1bbaab1b94e4590b2a29b479825cb41/users/a07e2db8603042c0867ddd6fd184ed32/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:56.882236 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788537e-cec0-42f4-bf6a-a31bfda1670c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:56.893153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788537e-cec0-42f4-bf6a-a31bfda1670c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:56.948921 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f5a96-5735-46e0-86d9-03cff1fad125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:56.949565 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f5a96-5735-46e0-86d9-03cff1fad125 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:56.949842 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f5a96-5735-46e0-86d9-03cff1fad125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:56.950134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f5a96-5735-46e0-86d9-03cff1fad125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:56.950786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f5a96-5735-46e0-86d9-03cff1fad125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:56.953026 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f5a96-5735-46e0-86d9-03cff1fad125 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:56.963989 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1256/2509] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:35:56.968417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a5007-9207-4a58-842d-8fac12b5527e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:56.979177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a5007-9207-4a58-842d-8fac12b5527e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:56.983846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d0828-2557-4d5c-845e-5e1ee3f5cc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:56.984492 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d0828-2557-4d5c-845e-5e1ee3f5cc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:56.984821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d0828-2557-4d5c-845e-5e1ee3f5cc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:56.985095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d0828-2557-4d5c-845e-5e1ee3f5cc09 admin admin] PATH_INFO: `/v3/projects/f1bbaab1b94e4590b2a29b479825cb41/users/a07e2db8603042c0867ddd6fd184ed32/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:56.987077 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d0828-2557-4d5c-845e-5e1ee3f5cc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bbaab1b94e4590b2a29b479825cb41, user_id=a07e2db8603042c0867ddd6fd184ed32, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:56.991096 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d0828-2557-4d5c-845e-5e1ee3f5cc09 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:57.000884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1254/2510] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:35:56 2022] PUT /identity/v3/projects/f1bbaab1b94e4590b2a29b479825cb41/users/a07e2db8603042c0867ddd6fd184ed32/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:35:57.011743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb85a2-a226-443a-a282-915d5e81e507 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:57.012044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb85a2-a226-443a-a282-915d5e81e507 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:57.012321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb85a2-a226-443a-a282-915d5e81e507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:57.041616 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1efb85a2-a226-443a-a282-915d5e81e507 None None] MFA Rules not processed for user `a07e2db8603042c0867ddd6fd184ed32`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:35:57.042825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1efb85a2-a226-443a-a282-915d5e81e507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:57.111730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1257/2511] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:35:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:35:57.123191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d0828-2557-4d5c-845e-5e1ee3f5cc09 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:57.124974 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e44d0828-2557-4d5c-845e-5e1ee3f5cc09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:57.192140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d0828-2557-4d5c-845e-5e1ee3f5cc09 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:57.195992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418a24c-c9fa-401d-a276-bcbe877f089b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:57.196642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418a24c-c9fa-401d-a276-bcbe877f089b service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:57.196925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418a24c-c9fa-401d-a276-bcbe877f089b service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:57.197271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418a24c-c9fa-401d-a276-bcbe877f089b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:57.206665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418a24c-c9fa-401d-a276-bcbe877f089b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:57.208155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418a24c-c9fa-401d-a276-bcbe877f089b service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:57.218081 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1255/2512] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:57.683712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb85a2-a226-443a-a282-915d5e81e507 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:57.685118 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1efb85a2-a226-443a-a282-915d5e81e507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:57.772948 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb85a2-a226-443a-a282-915d5e81e507 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:57.778977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c2aec-9202-480b-9052-f7a77d365ac2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:57.779593 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c2aec-9202-480b-9052-f7a77d365ac2 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:57.779869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c2aec-9202-480b-9052-f7a77d365ac2 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:57.780139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c2aec-9202-480b-9052-f7a77d365ac2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:57.782532 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fa6c2aec-9202-480b-9052-f7a77d365ac2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:57.797804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c2aec-9202-480b-9052-f7a77d365ac2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:57.799525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c2aec-9202-480b-9052-f7a77d365ac2 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:57.807887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:35:57.814536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1258/2513] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:35:58.334529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418a24c-c9fa-401d-a276-bcbe877f089b service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:35:58.336212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0418a24c-c9fa-401d-a276-bcbe877f089b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:35:58.347567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418a24c-c9fa-401d-a276-bcbe877f089b service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:35:58.351153 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0dd92-3f2c-4ea7-a3e1-ae4cdeff58f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:35:58.351746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0dd92-3f2c-4ea7-a3e1-ae4cdeff58f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:35:58.352026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0dd92-3f2c-4ea7-a3e1-ae4cdeff58f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:35:58.352298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0dd92-3f2c-4ea7-a3e1-ae4cdeff58f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:35:58.418795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0dd92-3f2c-4ea7-a3e1-ae4cdeff58f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:35:58.420285 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0dd92-3f2c-4ea7-a3e1-ae4cdeff58f2 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:35:58.431533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1256/2514] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:35:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:03.212876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c2aec-9202-480b-9052-f7a77d365ac2 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:03.222099 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c2aec-9202-480b-9052-f7a77d365ac2 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:03.225722 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3185fcf-9434-45fd-80fc-4373359aeb2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:03.226302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3185fcf-9434-45fd-80fc-4373359aeb2e service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:03.226576 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3185fcf-9434-45fd-80fc-4373359aeb2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:03.226844 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3185fcf-9434-45fd-80fc-4373359aeb2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:03.282697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3185fcf-9434-45fd-80fc-4373359aeb2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:03.284122 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3185fcf-9434-45fd-80fc-4373359aeb2e service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:03.292901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1259/2515] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:04.957173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0dd92-3f2c-4ea7-a3e1-ae4cdeff58f2 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:04.958612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5ce0dd92-3f2c-4ea7-a3e1-ae4cdeff58f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:05.015969 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0dd92-3f2c-4ea7-a3e1-ae4cdeff58f2 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:05.019616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981837f7-bf33-4eaa-988b-e793ec93a957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:05.020216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981837f7-bf33-4eaa-988b-e793ec93a957 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:05.020494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981837f7-bf33-4eaa-988b-e793ec93a957 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:05.020765 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981837f7-bf33-4eaa-988b-e793ec93a957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:05.022490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-981837f7-bf33-4eaa-988b-e793ec93a957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:05.027241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:05.085934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981837f7-bf33-4eaa-988b-e793ec93a957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:05.087635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981837f7-bf33-4eaa-988b-e793ec93a957 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:05.097701 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1257/2516] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:07.476889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3185fcf-9434-45fd-80fc-4373359aeb2e service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:07.488678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3185fcf-9434-45fd-80fc-4373359aeb2e service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:07.493492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:07.494206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:07.494715 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:07.495057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] PATH_INFO: `/v3/users/333225e632ca4422a7a225c18d852ec5` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:07.496284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=333225e632ca4422a7a225c18d852ec5)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:07.498876 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:07.720046 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333225e632ca4422a7a225c18d852ec5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:07.813774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333225e632ca4422a7a225c18d852ec5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:07.814435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333225e632ca4422a7a225c18d852ec5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:07.815339 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333225e632ca4422a7a225c18d852ec5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:07.827058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333225e632ca4422a7a225c18d852ec5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:07.861710 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1260/2517] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:07 2022] DELETE /identity/v3/users/333225e632ca4422a7a225c18d852ec5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:07.865921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9f59e-103d-44a6-9688-b0e0e222a2cc None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:07.866416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9f59e-103d-44a6-9688-b0e0e222a2cc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:07.866517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9f59e-103d-44a6-9688-b0e0e222a2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:07.892377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e1c9f59e-103d-44a6-9688-b0e0e222a2cc None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:07.894164 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e1c9f59e-103d-44a6-9688-b0e0e222a2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:07.970351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1258/2518] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:07.992014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:07.992014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:08.061854 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e827d-cd0a-4f5f-a69d-426076ccb6d3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:08.071130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500e104-4967-4c3d-b0f2-f9bf2b752529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:08.071130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500e104-4967-4c3d-b0f2-f9bf2b752529 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:08.071130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500e104-4967-4c3d-b0f2-f9bf2b752529 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:08.071130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500e104-4967-4c3d-b0f2-f9bf2b752529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:08.080012 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500e104-4967-4c3d-b0f2-f9bf2b752529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:08.081541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500e104-4967-4c3d-b0f2-f9bf2b752529 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:08.093175 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1261/2519] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:08.575450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9f59e-103d-44a6-9688-b0e0e222a2cc None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:08.577549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e1c9f59e-103d-44a6-9688-b0e0e222a2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:08.589678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9f59e-103d-44a6-9688-b0e0e222a2cc None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:08.595957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:08.596599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:08.604137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:08.604507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] PATH_INFO: `/v3/projects/c15e044ac18044e7b971346d71508c16` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:08.605899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15e044ac18044e7b971346d71508c16)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:08.607912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:08.799547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15e044ac18044e7b971346d71508c16', 'request_id': 'req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:08.806201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15e044ac18044e7b971346d71508c16', 'request_id': 'req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:08.821458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500e104-4967-4c3d-b0f2-f9bf2b752529 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:08.823614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9500e104-4967-4c3d-b0f2-f9bf2b752529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:08.839479 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:08.877775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15e044ac18044e7b971346d71508c16', 'request_id': 'req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:08.889445 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] The token cache is being invalidate because project c15e044ac18044e7b971346d71508c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:08.889737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:08.890370 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:08.891854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1259/2520] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:08 2022] DELETE /identity/v3/projects/c15e044ac18044e7b971346d71508c16 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:08.895691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:08.896806 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500e104-4967-4c3d-b0f2-f9bf2b752529 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:08.896998 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:08.924700 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:08.958528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fc479-a02e-4fd5-8003-64f4581e2694 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261a9485c3b4d2aa657a931e0388389', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:08.959141 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc479-a02e-4fd5-8003-64f4581e2694 service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:08.959419 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc479-a02e-4fd5-8003-64f4581e2694 service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:08.959982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc479-a02e-4fd5-8003-64f4581e2694 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:08.962280 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0d7fc479-a02e-4fd5-8003-64f4581e2694 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:08.973931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70ea2b-bd4b-41cc-a404-e60a106b3d38 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:08.977244 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fc479-a02e-4fd5-8003-64f4581e2694 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:08.978919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fc479-a02e-4fd5-8003-64f4581e2694 service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:08.981375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:08.983006 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:08.983714 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:08.984065 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] PATH_INFO: `/v3/users/de2f26a7768a43c79c148b0ab577518b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:08.985828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2f26a7768a43c79c148b0ab577518b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:08.987518 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:08.990257 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1262/2521] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:36:08.991216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fc479-a02e-4fd5-8003-64f4581e2694 service placement] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:08.992567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0d7fc479-a02e-4fd5-8003-64f4581e2694 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:09.007061 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fc479-a02e-4fd5-8003-64f4581e2694 service placement] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:09.011848 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:09.012604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:09.012945 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:09.013332 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] PATH_INFO: `/v3/users/1398646888214f8a9ed7be5648a9a231` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:09.014538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1398646888214f8a9ed7be5648a9a231)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:09.016504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:09.209959 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2f26a7768a43c79c148b0ab577518b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:09.210634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2f26a7768a43c79c148b0ab577518b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:09.211520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2f26a7768a43c79c148b0ab577518b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:09.218466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2f26a7768a43c79c148b0ab577518b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:09.230445 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2f26a7768a43c79c148b0ab577518b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:09.240413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1398646888214f8a9ed7be5648a9a231'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:09.322784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1260/2522] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:08 2022] DELETE /identity/v3/users/de2f26a7768a43c79c148b0ab577518b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:09.374158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1398646888214f8a9ed7be5648a9a231'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:09.374883 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1398646888214f8a9ed7be5648a9a231'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:09.375580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1398646888214f8a9ed7be5648a9a231'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:09.386405 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1398646888214f8a9ed7be5648a9a231'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:09.416308 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1263/2523] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:08 2022] DELETE /identity/v3/users/1398646888214f8a9ed7be5648a9a231 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:09.969119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:09.970851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:09.998103 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:10.001681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:10.022928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:10.052873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecc1d0-3f1c-4b47-b0df-c410a69d0dd5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:10.071587 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79a54a-fff2-441a-a330-54b7252f93a7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:10.077548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:10.078173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:10.078534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:10.078820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] PATH_INFO: `/v3/projects/7ade279b482f4b93b409353753b58e5c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:10.080372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ade279b482f4b93b409353753b58e5c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:10.082701 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:10.103401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:10.113085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:10.113741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:10.114022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:10.114311 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0 admin admin] PATH_INFO: `/v3/projects/516145265738464ea7cbeec751e53264` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:10.115449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=516145265738464ea7cbeec751e53264)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:10.117843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:10.192302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ade279b482f4b93b409353753b58e5c', 'request_id': 'req-44577aef-076a-4b6c-84dc-5084ea659ed8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.198514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ade279b482f4b93b409353753b58e5c', 'request_id': 'req-44577aef-076a-4b6c-84dc-5084ea659ed8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.249729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '516145265738464ea7cbeec751e53264', 'request_id': 'req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.255794 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '516145265738464ea7cbeec751e53264', 'request_id': 'req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.345984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ade279b482f4b93b409353753b58e5c', 'request_id': 'req-44577aef-076a-4b6c-84dc-5084ea659ed8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.356712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] The token cache is being invalidate because project 7ade279b482f4b93b409353753b58e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:10.357533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.358146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.359645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1264/2524] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:09 2022] DELETE /identity/v3/projects/7ade279b482f4b93b409353753b58e5c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:10.363504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:10.364904 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:10.402979 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '516145265738464ea7cbeec751e53264', 'request_id': 'req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.413786 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0 admin admin] The token cache is being invalidate because project 516145265738464ea7cbeec751e53264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:10.414107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.414743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1e5b9a8c-20e1-4f0a-8746-4858570e15a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.421068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1261/2525] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:09 2022] DELETE /identity/v3/projects/516145265738464ea7cbeec751e53264 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:10.422440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc6ffb-7599-42dc-80ef-cb52f98ce12e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:10.422727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc6ffb-7599-42dc-80ef-cb52f98ce12e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:10.423004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc6ffb-7599-42dc-80ef-cb52f98ce12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:10.432067 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44577aef-076a-4b6c-84dc-5084ea659ed8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:10.444201 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ebfc6ffb-7599-42dc-80ef-cb52f98ce12e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:10.445434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ebfc6ffb-7599-42dc-80ef-cb52f98ce12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:10.487746 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:10.488379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:10.488651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:10.488922 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] PATH_INFO: `/v3/users/a07e2db8603042c0867ddd6fd184ed32` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:10.490089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07e2db8603042c0867ddd6fd184ed32)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:10.492016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:10.506912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1262/2526] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:10.514347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b7d1-393d-4507-8949-22fd3b0ee9d5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:10.514630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b7d1-393d-4507-8949-22fd3b0ee9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:10.514903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b7d1-393d-4507-8949-22fd3b0ee9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:10.521092 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:10.536066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ba82b7d1-393d-4507-8949-22fd3b0ee9d5 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:10.537273 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ba82b7d1-393d-4507-8949-22fd3b0ee9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:10.545969 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1263/2527] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:10.549695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b7d1-393d-4507-8949-22fd3b0ee9d5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:10.558646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b7d1-393d-4507-8949-22fd3b0ee9d5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:10.564150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c7445-f384-4bee-aad9-02ba08ca5306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:10.564798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c7445-f384-4bee-aad9-02ba08ca5306 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:10.565146 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c7445-f384-4bee-aad9-02ba08ca5306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:10.565516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c7445-f384-4bee-aad9-02ba08ca5306 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:10.566372 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c7445-f384-4bee-aad9-02ba08ca5306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:36:10.566738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c7445-f384-4bee-aad9-02ba08ca5306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:10.568473 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c7445-f384-4bee-aad9-02ba08ca5306 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:10.580616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1264/2528] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:36:10.584827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c7445-f384-4bee-aad9-02ba08ca5306 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:10.595171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c7445-f384-4bee-aad9-02ba08ca5306 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:10.601384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e328650-04e9-4fb3-a186-0ab161d183d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:10.601384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328650-04e9-4fb3-a186-0ab161d183d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:10.601384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328650-04e9-4fb3-a186-0ab161d183d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:10.601384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e328650-04e9-4fb3-a186-0ab161d183d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:10.601857 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e328650-04e9-4fb3-a186-0ab161d183d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:10.603307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e328650-04e9-4fb3-a186-0ab161d183d6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:10.744923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1265/2529] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:10 2022] POST /identity/v3/projects => generated 401 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:10.745953 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e328650-04e9-4fb3-a186-0ab161d183d6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:10.786541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07e2db8603042c0867ddd6fd184ed32'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.792848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:10.813376 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e328650-04e9-4fb3-a186-0ab161d183d6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:10.818019 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70274-6e01-41f7-bc57-24324e6e20cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:10.818626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70274-6e01-41f7-bc57-24324e6e20cb admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:10.818898 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70274-6e01-41f7-bc57-24324e6e20cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:10.819167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70274-6e01-41f7-bc57-24324e6e20cb admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:10.819846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d70274-6e01-41f7-bc57-24324e6e20cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:10.821804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d70274-6e01-41f7-bc57-24324e6e20cb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:10.866358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07e2db8603042c0867ddd6fd184ed32'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.866910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07e2db8603042c0867ddd6fd184ed32'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.867538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07e2db8603042c0867ddd6fd184ed32'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.875105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07e2db8603042c0867ddd6fd184ed32'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:10.891825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1265/2530] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:10 2022] DELETE /identity/v3/users/a07e2db8603042c0867ddd6fd184ed32 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:10.938351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1266/2531] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:10 2022] POST /identity/v3/users => generated 301 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:10.939674 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:10.941213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:11.007166 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b5aa3-5d71-4263-81c6-a6d5663e3d9e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:11.011833 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb1d38-d152-4a73-a80e-ce86bc846767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:11.012426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb1d38-d152-4a73-a80e-ce86bc846767 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.012705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb1d38-d152-4a73-a80e-ce86bc846767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.012969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb1d38-d152-4a73-a80e-ce86bc846767 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.014625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb1d38-d152-4a73-a80e-ce86bc846767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:11.015212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb1d38-d152-4a73-a80e-ce86bc846767 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:11.024869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1266/2532] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:11.029581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70274-6e01-41f7-bc57-24324e6e20cb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:11.039775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70274-6e01-41f7-bc57-24324e6e20cb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:11.045165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834165ef-0d30-4a84-a52e-5c9f9d2a27b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:11.045802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834165ef-0d30-4a84-a52e-5c9f9d2a27b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.046083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834165ef-0d30-4a84-a52e-5c9f9d2a27b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.046351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834165ef-0d30-4a84-a52e-5c9f9d2a27b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.047064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834165ef-0d30-4a84-a52e-5c9f9d2a27b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:11.048710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834165ef-0d30-4a84-a52e-5c9f9d2a27b2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:11.059732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1267/2533] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:36:11.068201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb1d38-d152-4a73-a80e-ce86bc846767 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:11.074268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb1d38-d152-4a73-a80e-ce86bc846767 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:11.080189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f34bd8-f397-4787-b939-784175d0e446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:11.081142 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f34bd8-f397-4787-b939-784175d0e446 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.081290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f34bd8-f397-4787-b939-784175d0e446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.081549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f34bd8-f397-4787-b939-784175d0e446 admin admin] PATH_INFO: `/v3/projects/d86426ed623645aca24dd3f31dc65b16/users/19a834b59e0f443ebbdc8f84ab1c8a70/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.098050 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f34bd8-f397-4787-b939-784175d0e446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86426ed623645aca24dd3f31dc65b16, user_id=19a834b59e0f443ebbdc8f84ab1c8a70, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:11.100738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f34bd8-f397-4787-b939-784175d0e446 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:11.163818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1267/2534] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:11 2022] PUT /identity/v3/projects/d86426ed623645aca24dd3f31dc65b16/users/19a834b59e0f443ebbdc8f84ab1c8a70/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:11.174069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763cd5-81e7-4e65-98af-fe9edf861532 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.174442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763cd5-81e7-4e65-98af-fe9edf861532 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.174797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763cd5-81e7-4e65-98af-fe9edf861532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.203461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f7763cd5-81e7-4e65-98af-fe9edf861532 None None] MFA Rules not processed for user `19a834b59e0f443ebbdc8f84ab1c8a70`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:11.204662 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f7763cd5-81e7-4e65-98af-fe9edf861532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:11.267977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1268/2535] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:11 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:11.272472 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f34bd8-f397-4787-b939-784175d0e446 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:11.284646 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7763cd5-81e7-4e65-98af-fe9edf861532 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:11.286047 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f7763cd5-81e7-4e65-98af-fe9edf861532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:11.327262 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:11.344507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f34bd8-f397-4787-b939-784175d0e446 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:11.349325 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd2f29-76a4-4314-acf1-ae6060175846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:11.349937 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd2f29-76a4-4314-acf1-ae6060175846 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.350218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd2f29-76a4-4314-acf1-ae6060175846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.350490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd2f29-76a4-4314-acf1-ae6060175846 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.351124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd2f29-76a4-4314-acf1-ae6060175846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:11.353022 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd2f29-76a4-4314-acf1-ae6060175846 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:11.357523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7763cd5-81e7-4e65-98af-fe9edf861532 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:11.362274 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf4449-8617-4822-b4d4-9cda568f1410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:11.363203 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf4449-8617-4822-b4d4-9cda568f1410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.363490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf4449-8617-4822-b4d4-9cda568f1410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.363882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf4449-8617-4822-b4d4-9cda568f1410 admin admin] PATH_INFO: `/v3/projects/f1bbaab1b94e4590b2a29b479825cb41` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.369090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf4449-8617-4822-b4d4-9cda568f1410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bbaab1b94e4590b2a29b479825cb41)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:11.369090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf4449-8617-4822-b4d4-9cda568f1410 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:11.456525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1268/2536] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:11 2022] POST /identity/v3/projects => generated 405 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:11.462792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd2f29-76a4-4314-acf1-ae6060175846 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:11.480291 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-74bf4449-8617-4822-b4d4-9cda568f1410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bbaab1b94e4590b2a29b479825cb41', 'request_id': 'req-74bf4449-8617-4822-b4d4-9cda568f1410'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:11.481415 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:11.487040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-74bf4449-8617-4822-b4d4-9cda568f1410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bbaab1b94e4590b2a29b479825cb41', 'request_id': 'req-74bf4449-8617-4822-b4d4-9cda568f1410'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:11.525303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd2f29-76a4-4314-acf1-ae6060175846 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:11.552077 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-74bf4449-8617-4822-b4d4-9cda568f1410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bbaab1b94e4590b2a29b479825cb41', 'request_id': 'req-74bf4449-8617-4822-b4d4-9cda568f1410'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:11.563584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-74bf4449-8617-4822-b4d4-9cda568f1410 admin admin] The token cache is being invalidate because project f1bbaab1b94e4590b2a29b479825cb41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:11.563881 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-74bf4449-8617-4822-b4d4-9cda568f1410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:11.564527 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-74bf4449-8617-4822-b4d4-9cda568f1410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:11.566085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1269/2537] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:11 2022] DELETE /identity/v3/projects/f1bbaab1b94e4590b2a29b479825cb41 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:11.575125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b83e7a-77b2-4714-8104-a8a825daf6b1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.575483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b83e7a-77b2-4714-8104-a8a825daf6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.576407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b83e7a-77b2-4714-8104-a8a825daf6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.581812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662b059-4386-4f1b-b899-fc3ca43e1118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:11.582417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b059-4386-4f1b-b899-fc3ca43e1118 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.582698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b059-4386-4f1b-b899-fc3ca43e1118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.582967 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b059-4386-4f1b-b899-fc3ca43e1118 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.583590 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662b059-4386-4f1b-b899-fc3ca43e1118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:11.585531 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662b059-4386-4f1b-b899-fc3ca43e1118 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:11.596679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-06b83e7a-77b2-4714-8104-a8a825daf6b1 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:11.598279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-06b83e7a-77b2-4714-8104-a8a825daf6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:11.606687 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1270/2538] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:11.615754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571f684-86d8-41f1-8cca-2af45fd7439e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.616036 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571f684-86d8-41f1-8cca-2af45fd7439e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.616311 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571f684-86d8-41f1-8cca-2af45fd7439e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.636172 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0571f684-86d8-41f1-8cca-2af45fd7439e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:11.637366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0571f684-86d8-41f1-8cca-2af45fd7439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:11.645974 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1271/2539] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:11.649983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571f684-86d8-41f1-8cca-2af45fd7439e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:11.659229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571f684-86d8-41f1-8cca-2af45fd7439e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:11.664003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e9d4f-dc00-4493-90de-37b482d1d9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:11.664566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9d4f-dc00-4493-90de-37b482d1d9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.664846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9d4f-dc00-4493-90de-37b482d1d9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.665119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9d4f-dc00-4493-90de-37b482d1d9e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.665813 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9d4f-dc00-4493-90de-37b482d1d9e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:36:11.666121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9d4f-dc00-4493-90de-37b482d1d9e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:11.667721 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9d4f-dc00-4493-90de-37b482d1d9e0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:11.676792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1269/2540] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:11 2022] POST /identity/v3/users => generated 309 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:11.680226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1272/2541] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:36:11.683812 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662b059-4386-4f1b-b899-fc3ca43e1118 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:11.684180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e9d4f-dc00-4493-90de-37b482d1d9e0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:11.686188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1662b059-4386-4f1b-b899-fc3ca43e1118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:11.694614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e9d4f-dc00-4493-90de-37b482d1d9e0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:11.698571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662b059-4386-4f1b-b899-fc3ca43e1118 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:11.699227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6402b4-2fa8-4aa5-89f5-f71da944630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:11.699802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6402b4-2fa8-4aa5-89f5-f71da944630f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.703133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6402b4-2fa8-4aa5-89f5-f71da944630f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.703133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6402b4-2fa8-4aa5-89f5-f71da944630f admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.703133 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6402b4-2fa8-4aa5-89f5-f71da944630f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:11.703566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6402b4-2fa8-4aa5-89f5-f71da944630f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:11.704096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd590a5-51d2-4412-acf4-e7b42a27c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:11.704691 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd590a5-51d2-4412-acf4-e7b42a27c4fe admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.705115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd590a5-51d2-4412-acf4-e7b42a27c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.705433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd590a5-51d2-4412-acf4-e7b42a27c4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.706076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd590a5-51d2-4412-acf4-e7b42a27c4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:11.707662 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd590a5-51d2-4412-acf4-e7b42a27c4fe admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:11.718301 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1270/2542] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:36:11.722605 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd590a5-51d2-4412-acf4-e7b42a27c4fe admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:11.732359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd590a5-51d2-4412-acf4-e7b42a27c4fe admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:11.737095 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14548ac-6cb5-4781-ae4a-bb339b9a3b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:11.737763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14548ac-6cb5-4781-ae4a-bb339b9a3b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.738198 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14548ac-6cb5-4781-ae4a-bb339b9a3b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.738480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14548ac-6cb5-4781-ae4a-bb339b9a3b8e admin admin] PATH_INFO: `/v3/projects/04ec40acf33a42c0a724e57c73869767/users/eb098d7f540b46b6ba81fa600a2efa64/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.753564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14548ac-6cb5-4781-ae4a-bb339b9a3b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ec40acf33a42c0a724e57c73869767, user_id=eb098d7f540b46b6ba81fa600a2efa64, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:11.756291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14548ac-6cb5-4781-ae4a-bb339b9a3b8e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:11.820984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1273/2543] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:11 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:11.824900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6402b4-2fa8-4aa5-89f5-f71da944630f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:11.849017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1271/2544] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:11 2022] PUT /identity/v3/projects/04ec40acf33a42c0a724e57c73869767/users/eb098d7f540b46b6ba81fa600a2efa64/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:11.852866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14548ac-6cb5-4781-ae4a-bb339b9a3b8e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:11.888849 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:11.893052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6402b4-2fa8-4aa5-89f5-f71da944630f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:11.918801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14548ac-6cb5-4781-ae4a-bb339b9a3b8e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:11.923608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6f1eb-f1ab-4ae8-bcd9-bc54b39a4013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:11.924226 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6f1eb-f1ab-4ae8-bcd9-bc54b39a4013 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.924509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6f1eb-f1ab-4ae8-bcd9-bc54b39a4013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.924782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6f1eb-f1ab-4ae8-bcd9-bc54b39a4013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.925477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6f1eb-f1ab-4ae8-bcd9-bc54b39a4013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:11.927078 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6f1eb-f1ab-4ae8-bcd9-bc54b39a4013 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:11.938589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1272/2545] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:36:11.944473 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6f1eb-f1ab-4ae8-bcd9-bc54b39a4013 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:11.953053 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6f1eb-f1ab-4ae8-bcd9-bc54b39a4013 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:11.958065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765317e-1363-4afd-9890-81edc8a06562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:11.958246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398945b8-75d3-4a45-885b-e2fcdd978f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:11.959262 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398945b8-75d3-4a45-885b-e2fcdd978f67 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.959382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765317e-1363-4afd-9890-81edc8a06562 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.959382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765317e-1363-4afd-9890-81edc8a06562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.959554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398945b8-75d3-4a45-885b-e2fcdd978f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.959554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398945b8-75d3-4a45-885b-e2fcdd978f67 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.959714 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765317e-1363-4afd-9890-81edc8a06562 admin admin] PATH_INFO: `/v3/projects/04ec40acf33a42c0a724e57c73869767/users/eb098d7f540b46b6ba81fa600a2efa64/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:11.960021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398945b8-75d3-4a45-885b-e2fcdd978f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:11.961657 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765317e-1363-4afd-9890-81edc8a06562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ec40acf33a42c0a724e57c73869767, user_id=eb098d7f540b46b6ba81fa600a2efa64, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:11.962307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398945b8-75d3-4a45-885b-e2fcdd978f67 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:11.964866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765317e-1363-4afd-9890-81edc8a06562 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:11.983454 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1273/2546] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:11 2022] PUT /identity/v3/projects/04ec40acf33a42c0a724e57c73869767/users/eb098d7f540b46b6ba81fa600a2efa64/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:11.995722 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99438e90-9087-4498-8e74-d662d48293df None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:11.996080 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99438e90-9087-4498-8e74-d662d48293df None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:11.996376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99438e90-9087-4498-8e74-d662d48293df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:12.026773 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-99438e90-9087-4498-8e74-d662d48293df None None] MFA Rules not processed for user `eb098d7f540b46b6ba81fa600a2efa64`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:12.027974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-99438e90-9087-4498-8e74-d662d48293df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:12.041021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1274/2547] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:11 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:12.042265 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398945b8-75d3-4a45-885b-e2fcdd978f67 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:12.053431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398945b8-75d3-4a45-885b-e2fcdd978f67 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:12.081060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:12.107982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1274/2548] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:11 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:12.116814 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6dd4d-af7e-4205-b10e-298fdbdd6baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:12.117488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6dd4d-af7e-4205-b10e-298fdbdd6baa admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:12.117773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6dd4d-af7e-4205-b10e-298fdbdd6baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:12.118304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6dd4d-af7e-4205-b10e-298fdbdd6baa admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:12.118957 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6dd4d-af7e-4205-b10e-298fdbdd6baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:12.119109 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99438e90-9087-4498-8e74-d662d48293df None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:12.120449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-99438e90-9087-4498-8e74-d662d48293df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:12.120578 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6dd4d-af7e-4205-b10e-298fdbdd6baa admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:12.130976 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1275/2549] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:36:12.134831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6dd4d-af7e-4205-b10e-298fdbdd6baa admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:12.146035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6dd4d-af7e-4205-b10e-298fdbdd6baa admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:12.150011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa60e9-9829-4284-9aeb-a872a1d10034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:12.150709 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa60e9-9829-4284-9aeb-a872a1d10034 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:12.150991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa60e9-9829-4284-9aeb-a872a1d10034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:12.151262 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa60e9-9829-4284-9aeb-a872a1d10034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:12.151904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa60e9-9829-4284-9aeb-a872a1d10034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:12.153540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa60e9-9829-4284-9aeb-a872a1d10034 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:12.165797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1276/2550] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:36:12.169896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa60e9-9829-4284-9aeb-a872a1d10034 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:12.180249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa60e9-9829-4284-9aeb-a872a1d10034 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:12.186190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfed59-207a-4925-8609-a74a5c1610bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:12.187211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfed59-207a-4925-8609-a74a5c1610bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:12.187442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99438e90-9087-4498-8e74-d662d48293df None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:12.187565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfed59-207a-4925-8609-a74a5c1610bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:12.187747 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfed59-207a-4925-8609-a74a5c1610bf admin admin] PATH_INFO: `/v3/projects/8cd44091a84e46e09f96835508104d30/users/055ba5edbaa8423d8e434c0a86e091c6/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:12.191115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac0fe9-1a5e-47cd-a67c-07b343603dda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:12.191692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac0fe9-1a5e-47cd-a67c-07b343603dda service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:12.191969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac0fe9-1a5e-47cd-a67c-07b343603dda service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:12.192240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac0fe9-1a5e-47cd-a67c-07b343603dda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:12.201774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac0fe9-1a5e-47cd-a67c-07b343603dda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:12.202555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfed59-207a-4925-8609-a74a5c1610bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cd44091a84e46e09f96835508104d30, user_id=055ba5edbaa8423d8e434c0a86e091c6, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:12.203366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac0fe9-1a5e-47cd-a67c-07b343603dda service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:12.205210 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfed59-207a-4925-8609-a74a5c1610bf admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:12.213225 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1275/2551] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:12 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:36:12.255505 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1277/2552] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:12 2022] PUT /identity/v3/projects/8cd44091a84e46e09f96835508104d30/users/055ba5edbaa8423d8e434c0a86e091c6/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:12.267668 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7de42-dffd-4438-91ae-7c1a83f41efa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:12.268013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7de42-dffd-4438-91ae-7c1a83f41efa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:12.268209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7de42-dffd-4438-91ae-7c1a83f41efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:12.297335 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-caa7de42-dffd-4438-91ae-7c1a83f41efa None None] MFA Rules not processed for user `055ba5edbaa8423d8e434c0a86e091c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:12.298628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-caa7de42-dffd-4438-91ae-7c1a83f41efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:12.332516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:12.354113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfed59-207a-4925-8609-a74a5c1610bf admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:12.369946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1276/2553] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:12.374966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7de42-dffd-4438-91ae-7c1a83f41efa None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:12.419070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfed59-207a-4925-8609-a74a5c1610bf admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:12.423623 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b05e96-71f0-4ba6-99a4-89ccc1bf88c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:12.424241 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b05e96-71f0-4ba6-99a4-89ccc1bf88c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:12.424519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b05e96-71f0-4ba6-99a4-89ccc1bf88c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:12.424775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b05e96-71f0-4ba6-99a4-89ccc1bf88c5 admin admin] PATH_INFO: `/v3/users/19a834b59e0f443ebbdc8f84ab1c8a70` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:12.425905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b05e96-71f0-4ba6-99a4-89ccc1bf88c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a834b59e0f443ebbdc8f84ab1c8a70)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:12.427816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b05e96-71f0-4ba6-99a4-89ccc1bf88c5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:12.439969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7de42-dffd-4438-91ae-7c1a83f41efa None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:12.444654 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e2e2e-fedf-4dc3-9831-0d917a70dec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:12.445270 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e2e2e-fedf-4dc3-9831-0d917a70dec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:12.445563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e2e2e-fedf-4dc3-9831-0d917a70dec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:12.445836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e2e2e-fedf-4dc3-9831-0d917a70dec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:12.446466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e2e2e-fedf-4dc3-9831-0d917a70dec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:12.448367 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e2e2e-fedf-4dc3-9831-0d917a70dec3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:12.576906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1277/2554] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:12 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:12.580917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e2e2e-fedf-4dc3-9831-0d917a70dec3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:12.613325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-16b05e96-71f0-4ba6-99a4-89ccc1bf88c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a834b59e0f443ebbdc8f84ab1c8a70'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:12.614001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-16b05e96-71f0-4ba6-99a4-89ccc1bf88c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a834b59e0f443ebbdc8f84ab1c8a70'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:12.614616 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-16b05e96-71f0-4ba6-99a4-89ccc1bf88c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a834b59e0f443ebbdc8f84ab1c8a70'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:12.621848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-16b05e96-71f0-4ba6-99a4-89ccc1bf88c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a834b59e0f443ebbdc8f84ab1c8a70'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:12.634841 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-16b05e96-71f0-4ba6-99a4-89ccc1bf88c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a834b59e0f443ebbdc8f84ab1c8a70'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:12.646059 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e2e2e-fedf-4dc3-9831-0d917a70dec3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:12.650645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f27235-b535-459b-b694-a3cdfcbf4b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:12.651239 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f27235-b535-459b-b694-a3cdfcbf4b24 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:12.651518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f27235-b535-459b-b694-a3cdfcbf4b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:12.651788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f27235-b535-459b-b694-a3cdfcbf4b24 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:12.652402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f27235-b535-459b-b694-a3cdfcbf4b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:12.654383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f27235-b535-459b-b694-a3cdfcbf4b24 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:12.718179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1278/2555] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:12 2022] DELETE /identity/v3/users/19a834b59e0f443ebbdc8f84ab1c8a70 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:12.722682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36876610-a032-4a7d-a22e-d54a41f653be None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:12.722971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36876610-a032-4a7d-a22e-d54a41f653be None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:12.723249 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36876610-a032-4a7d-a22e-d54a41f653be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:12.736995 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:12.743281 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-36876610-a032-4a7d-a22e-d54a41f653be None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:12.744593 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-36876610-a032-4a7d-a22e-d54a41f653be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:12.751444 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1278/2556] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:12 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:12.756859 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f27235-b535-459b-b694-a3cdfcbf4b24 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:12.758464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f8f27235-b535-459b-b694-a3cdfcbf4b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:12.770646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f27235-b535-459b-b694-a3cdfcbf4b24 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:12.804919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1279/2557] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:12.815326 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36876610-a032-4a7d-a22e-d54a41f653be None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:12.816664 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-36876610-a032-4a7d-a22e-d54a41f653be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:12.816904 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:12.830303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ec7e9-fb1d-4967-a59e-b0a2c9899fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:12.834520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec7e9-fb1d-4967-a59e-b0a2c9899fea admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:12.834520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec7e9-fb1d-4967-a59e-b0a2c9899fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:12.834520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ec7e9-fb1d-4967-a59e-b0a2c9899fea admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:12.834520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ec7e9-fb1d-4967-a59e-b0a2c9899fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:12.834520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ec7e9-fb1d-4967-a59e-b0a2c9899fea admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:12.843864 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1279/2558] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:36:12.848041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ec7e9-fb1d-4967-a59e-b0a2c9899fea admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:12.858244 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ec7e9-fb1d-4967-a59e-b0a2c9899fea admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:12.863474 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed9e6d-e634-4711-b4c2-d463add68026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:12.864125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed9e6d-e634-4711-b4c2-d463add68026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:12.864381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed9e6d-e634-4711-b4c2-d463add68026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:12.864651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed9e6d-e634-4711-b4c2-d463add68026 admin admin] PATH_INFO: `/v3/projects/714723da92f545ba8bd2a649c9d022d2/users/3d8aeea8b8f54752be697cece45e9139/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:12.876945 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36876610-a032-4a7d-a22e-d54a41f653be None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:12.880225 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed9e6d-e634-4711-b4c2-d463add68026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714723da92f545ba8bd2a649c9d022d2, user_id=3d8aeea8b8f54752be697cece45e9139, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:12.880567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6fb73-bf9d-41d1-9513-793450aa9af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:12.881170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6fb73-bf9d-41d1-9513-793450aa9af5 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:12.881780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6fb73-bf9d-41d1-9513-793450aa9af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:12.882299 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6fb73-bf9d-41d1-9513-793450aa9af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:12.883189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed9e6d-e634-4711-b4c2-d463add68026 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:12.892297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6fb73-bf9d-41d1-9513-793450aa9af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:12.893771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6fb73-bf9d-41d1-9513-793450aa9af5 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:12.903079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1280/2559] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:36:12.946510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1280/2560] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:12 2022] PUT /identity/v3/projects/714723da92f545ba8bd2a649c9d022d2/users/3d8aeea8b8f54752be697cece45e9139/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:12.950592 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6fb73-bf9d-41d1-9513-793450aa9af5 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:12.960976 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6fb73-bf9d-41d1-9513-793450aa9af5 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:13.021144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59599076-0658-4f0b-8010-072e124e5ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:13.021776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59599076-0658-4f0b-8010-072e124e5ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:13.022060 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59599076-0658-4f0b-8010-072e124e5ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:13.022333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59599076-0658-4f0b-8010-072e124e5ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:13.022966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59599076-0658-4f0b-8010-072e124e5ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:13.024717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59599076-0658-4f0b-8010-072e124e5ab6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:13.035329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1281/2561] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:13.041851 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed9e6d-e634-4711-b4c2-d463add68026 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:13.050583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed9e6d-e634-4711-b4c2-d463add68026 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:13.055244 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c46dd7-4593-453d-baef-101f2d5ebd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:13.055889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c46dd7-4593-453d-baef-101f2d5ebd7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:13.056168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c46dd7-4593-453d-baef-101f2d5ebd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:13.056441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c46dd7-4593-453d-baef-101f2d5ebd7f admin admin] PATH_INFO: `/v3/projects/714723da92f545ba8bd2a649c9d022d2/users/3d8aeea8b8f54752be697cece45e9139/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:13.058384 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c46dd7-4593-453d-baef-101f2d5ebd7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=714723da92f545ba8bd2a649c9d022d2, user_id=3d8aeea8b8f54752be697cece45e9139, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:13.061007 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c46dd7-4593-453d-baef-101f2d5ebd7f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:13.071195 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1281/2562] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:13 2022] PUT /identity/v3/projects/714723da92f545ba8bd2a649c9d022d2/users/3d8aeea8b8f54752be697cece45e9139/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:13.083194 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f5c96-9d6a-47a1-856c-5c26a114e1fa None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:13.083629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f5c96-9d6a-47a1-856c-5c26a114e1fa None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:13.083629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f5c96-9d6a-47a1-856c-5c26a114e1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:13.114527 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-463f5c96-9d6a-47a1-856c-5c26a114e1fa None None] MFA Rules not processed for user `3d8aeea8b8f54752be697cece45e9139`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:13.115872 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-463f5c96-9d6a-47a1-856c-5c26a114e1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:13.166076 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:13.218099 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1282/2563] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:13.226729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c46dd7-4593-453d-baef-101f2d5ebd7f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:13.228905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b3c46dd7-4593-453d-baef-101f2d5ebd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:13.297671 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c46dd7-4593-453d-baef-101f2d5ebd7f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:13.301403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb598fef-1e4c-47ac-8d35-b8069dcd915a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:13.302014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb598fef-1e4c-47ac-8d35-b8069dcd915a service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:13.302288 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb598fef-1e4c-47ac-8d35-b8069dcd915a service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:13.302559 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb598fef-1e4c-47ac-8d35-b8069dcd915a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:13.304348 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fb598fef-1e4c-47ac-8d35-b8069dcd915a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:13.364450 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb598fef-1e4c-47ac-8d35-b8069dcd915a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:13.365922 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb598fef-1e4c-47ac-8d35-b8069dcd915a service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:13.377129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f5c96-9d6a-47a1-856c-5c26a114e1fa None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:13.378246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1282/2564] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:13.380027 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-463f5c96-9d6a-47a1-856c-5c26a114e1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:13.466259 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f5c96-9d6a-47a1-856c-5c26a114e1fa None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:13.471502 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:13.472213 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:13.472559 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:13.472903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] PATH_INFO: `/v3/projects/d86426ed623645aca24dd3f31dc65b16` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:13.474209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d86426ed623645aca24dd3f31dc65b16)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:13.476284 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:13.626956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd86426ed623645aca24dd3f31dc65b16', 'request_id': 'req-b055bc50-a450-4ca3-a096-d6a8e9644b23'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:13.633454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd86426ed623645aca24dd3f31dc65b16', 'request_id': 'req-b055bc50-a450-4ca3-a096-d6a8e9644b23'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:13.706514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd86426ed623645aca24dd3f31dc65b16', 'request_id': 'req-b055bc50-a450-4ca3-a096-d6a8e9644b23'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:13.717901 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] The token cache is being invalidate because project d86426ed623645aca24dd3f31dc65b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:13.718187 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:13.718857 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:13.720366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1283/2565] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:13 2022] DELETE /identity/v3/projects/d86426ed623645aca24dd3f31dc65b16 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:13.724354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb598fef-1e4c-47ac-8d35-b8069dcd915a service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:13.734909 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb598fef-1e4c-47ac-8d35-b8069dcd915a service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:13.791801 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0012bca-2a1f-4eb8-b30d-f76ee365e1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:13.792431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0012bca-2a1f-4eb8-b30d-f76ee365e1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:13.792707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0012bca-2a1f-4eb8-b30d-f76ee365e1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:13.792977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0012bca-2a1f-4eb8-b30d-f76ee365e1d9 admin admin] PATH_INFO: `/v3/users/eb098d7f540b46b6ba81fa600a2efa64` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:13.794132 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0012bca-2a1f-4eb8-b30d-f76ee365e1d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb098d7f540b46b6ba81fa600a2efa64)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:13.796042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0012bca-2a1f-4eb8-b30d-f76ee365e1d9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:13.797680 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:13.942997 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e0012bca-2a1f-4eb8-b30d-f76ee365e1d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb098d7f540b46b6ba81fa600a2efa64'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:13.997570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e0012bca-2a1f-4eb8-b30d-f76ee365e1d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb098d7f540b46b6ba81fa600a2efa64'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:13.998372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e0012bca-2a1f-4eb8-b30d-f76ee365e1d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb098d7f540b46b6ba81fa600a2efa64'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:13.999058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e0012bca-2a1f-4eb8-b30d-f76ee365e1d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb098d7f540b46b6ba81fa600a2efa64'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:14.008090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e0012bca-2a1f-4eb8-b30d-f76ee365e1d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb098d7f540b46b6ba81fa600a2efa64'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:14.027916 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1283/2566] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:13 2022] DELETE /identity/v3/users/eb098d7f540b46b6ba81fa600a2efa64 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:14.542782 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:14.545916 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:14.558307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055bc50-a450-4ca3-a096-d6a8e9644b23 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:14.617307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9d66e-cd93-450d-9453-530f7faf3ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:14.618048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9d66e-cd93-450d-9453-530f7faf3ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:14.618327 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9d66e-cd93-450d-9453-530f7faf3ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:14.618601 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9d66e-cd93-450d-9453-530f7faf3ccd admin admin] PATH_INFO: `/v3/projects/04ec40acf33a42c0a724e57c73869767` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:14.619704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9d66e-cd93-450d-9453-530f7faf3ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ec40acf33a42c0a724e57c73869767)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:14.621737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9d66e-cd93-450d-9453-530f7faf3ccd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:14.626326 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:14.773639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-78e9d66e-cd93-450d-9453-530f7faf3ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ec40acf33a42c0a724e57c73869767', 'request_id': 'req-78e9d66e-cd93-450d-9453-530f7faf3ccd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:14.779678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-78e9d66e-cd93-450d-9453-530f7faf3ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ec40acf33a42c0a724e57c73869767', 'request_id': 'req-78e9d66e-cd93-450d-9453-530f7faf3ccd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:14.842045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-78e9d66e-cd93-450d-9453-530f7faf3ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ec40acf33a42c0a724e57c73869767', 'request_id': 'req-78e9d66e-cd93-450d-9453-530f7faf3ccd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:14.853606 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-78e9d66e-cd93-450d-9453-530f7faf3ccd admin admin] The token cache is being invalidate because project 04ec40acf33a42c0a724e57c73869767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:14.854098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-78e9d66e-cd93-450d-9453-530f7faf3ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:14.855225 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-78e9d66e-cd93-450d-9453-530f7faf3ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:14.856736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1284/2567] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:14 2022] DELETE /identity/v3/projects/04ec40acf33a42c0a724e57c73869767 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:14.861601 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f731c46-87cc-4400-a304-467ba843a979 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:14.862063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f731c46-87cc-4400-a304-467ba843a979 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:14.862185 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f731c46-87cc-4400-a304-467ba843a979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:14.881693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5f731c46-87cc-4400-a304-467ba843a979 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:14.882875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5f731c46-87cc-4400-a304-467ba843a979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:14.941084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1284/2568] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:14.948726 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c31d27-2b75-45e2-93f9-9fe6e6bf4023 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:14.949007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c31d27-2b75-45e2-93f9-9fe6e6bf4023 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:14.949308 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c31d27-2b75-45e2-93f9-9fe6e6bf4023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:14.969014 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b4c31d27-2b75-45e2-93f9-9fe6e6bf4023 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:14.970792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b4c31d27-2b75-45e2-93f9-9fe6e6bf4023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:14.978469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1285/2569] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:15.002270 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f731c46-87cc-4400-a304-467ba843a979 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:15.012068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f731c46-87cc-4400-a304-467ba843a979 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:15.017150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9be11-19b0-45c5-b982-2bf82011a0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:15.017805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9be11-19b0-45c5-b982-2bf82011a0fa admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:15.018086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9be11-19b0-45c5-b982-2bf82011a0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:15.018358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9be11-19b0-45c5-b982-2bf82011a0fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:15.019041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9be11-19b0-45c5-b982-2bf82011a0fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:36:15.019347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9be11-19b0-45c5-b982-2bf82011a0fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:15.020947 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9be11-19b0-45c5-b982-2bf82011a0fa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:15.033146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1285/2570] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:36:15.037504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c31d27-2b75-45e2-93f9-9fe6e6bf4023 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:15.046761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c31d27-2b75-45e2-93f9-9fe6e6bf4023 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:15.051375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323addf-398e-4e38-a70f-10b553fcd552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:15.051970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323addf-398e-4e38-a70f-10b553fcd552 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:15.052250 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323addf-398e-4e38-a70f-10b553fcd552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:15.052547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323addf-398e-4e38-a70f-10b553fcd552 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:15.053628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323addf-398e-4e38-a70f-10b553fcd552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:15.058545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323addf-398e-4e38-a70f-10b553fcd552 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:15.144698 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1286/2571] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:15 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:15.148710 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9be11-19b0-45c5-b982-2bf82011a0fa admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:15.164576 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9be11-19b0-45c5-b982-2bf82011a0fa admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:15.222821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f43d1-b3a7-4817-b0da-65f0b03f8de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:15.223505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f43d1-b3a7-4817-b0da-65f0b03f8de2 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:15.223779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f43d1-b3a7-4817-b0da-65f0b03f8de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:15.224049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f43d1-b3a7-4817-b0da-65f0b03f8de2 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:15.224721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f43d1-b3a7-4817-b0da-65f0b03f8de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:15.226646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f43d1-b3a7-4817-b0da-65f0b03f8de2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:15.239619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:15.344875 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1286/2572] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:15 2022] POST /identity/v3/users => generated 282 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:15.349051 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323addf-398e-4e38-a70f-10b553fcd552 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:15.358947 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323addf-398e-4e38-a70f-10b553fcd552 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:15.369210 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462972e-686b-459f-89eb-aa4ff0b6967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:15.372345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462972e-686b-459f-89eb-aa4ff0b6967c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:15.372345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462972e-686b-459f-89eb-aa4ff0b6967c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:15.372345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462972e-686b-459f-89eb-aa4ff0b6967c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:15.372345 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462972e-686b-459f-89eb-aa4ff0b6967c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:15.372859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462972e-686b-459f-89eb-aa4ff0b6967c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:15.384470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1287/2573] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:15.388397 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f43d1-b3a7-4817-b0da-65f0b03f8de2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:15.399045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f43d1-b3a7-4817-b0da-65f0b03f8de2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:15.403711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e071e-2400-42c1-beb8-17ccdada640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:15.404300 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e071e-2400-42c1-beb8-17ccdada640d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:15.404577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e071e-2400-42c1-beb8-17ccdada640d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:15.404850 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e071e-2400-42c1-beb8-17ccdada640d admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:15.405517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e071e-2400-42c1-beb8-17ccdada640d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:15.407134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e071e-2400-42c1-beb8-17ccdada640d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:15.417509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1287/2574] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:15.421643 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462972e-686b-459f-89eb-aa4ff0b6967c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:15.431774 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462972e-686b-459f-89eb-aa4ff0b6967c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:15.436390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5f36e-83d5-4e04-aa02-006d0a4e0684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:15.437031 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5f36e-83d5-4e04-aa02-006d0a4e0684 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:15.437340 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5f36e-83d5-4e04-aa02-006d0a4e0684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:15.437620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5f36e-83d5-4e04-aa02-006d0a4e0684 admin admin] PATH_INFO: `/v3/projects/95a534b4046346c09e7d56bc58726bf0/users/021995f821dd46518550e7573f57b561/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:15.452664 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5f36e-83d5-4e04-aa02-006d0a4e0684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a534b4046346c09e7d56bc58726bf0, user_id=021995f821dd46518550e7573f57b561, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:15.456056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5f36e-83d5-4e04-aa02-006d0a4e0684 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:15.533651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1288/2575] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:15 2022] PUT /identity/v3/projects/95a534b4046346c09e7d56bc58726bf0/users/021995f821dd46518550e7573f57b561/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:15.544604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384ba04-4d97-4fba-a5d7-4554fc1dc2ea None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:15.544931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384ba04-4d97-4fba-a5d7-4554fc1dc2ea None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:15.545182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384ba04-4d97-4fba-a5d7-4554fc1dc2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:15.574052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d384ba04-4d97-4fba-a5d7-4554fc1dc2ea None None] MFA Rules not processed for user `021995f821dd46518550e7573f57b561`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:15.575272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d384ba04-4d97-4fba-a5d7-4554fc1dc2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:15.644852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1288/2576] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:15.649468 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5f36e-83d5-4e04-aa02-006d0a4e0684 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:15.712599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5f36e-83d5-4e04-aa02-006d0a4e0684 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:15.717423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3c3d4-2656-49d9-891e-7df1108e339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:15.718056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3c3d4-2656-49d9-891e-7df1108e339c admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:15.718331 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3c3d4-2656-49d9-891e-7df1108e339c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:15.718599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3c3d4-2656-49d9-891e-7df1108e339c admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:15.719211 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3c3d4-2656-49d9-891e-7df1108e339c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:15.721209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3c3d4-2656-49d9-891e-7df1108e339c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:15.845463 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1289/2577] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:15 2022] POST /identity/v3/projects => generated 363 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:15.849566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384ba04-4d97-4fba-a5d7-4554fc1dc2ea None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:15.860892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384ba04-4d97-4fba-a5d7-4554fc1dc2ea None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:15.917271 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d2183-2f31-487e-bc2b-9495b0b2f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:15.917901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d2183-2f31-487e-bc2b-9495b0b2f1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:15.918178 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d2183-2f31-487e-bc2b-9495b0b2f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:15.918451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d2183-2f31-487e-bc2b-9495b0b2f1b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:15.919102 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d2183-2f31-487e-bc2b-9495b0b2f1b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:15.921019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d2183-2f31-487e-bc2b-9495b0b2f1b6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:16.009612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1289/2578] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:15 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:16.013491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3c3d4-2656-49d9-891e-7df1108e339c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:16.024266 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3c3d4-2656-49d9-891e-7df1108e339c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:16.029103 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01977759-b2e5-4ba0-8b5f-354f649404e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:16.029740 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01977759-b2e5-4ba0-8b5f-354f649404e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:16.030073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01977759-b2e5-4ba0-8b5f-354f649404e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:16.030344 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01977759-b2e5-4ba0-8b5f-354f649404e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:16.030924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01977759-b2e5-4ba0-8b5f-354f649404e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:16.033054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01977759-b2e5-4ba0-8b5f-354f649404e3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:16.044194 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1290/2579] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:16.049075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d2183-2f31-487e-bc2b-9495b0b2f1b6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:16.059127 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d2183-2f31-487e-bc2b-9495b0b2f1b6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:16.064064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddafbd5-bb27-4a6a-99a0-0a2b5633c604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:16.064761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddafbd5-bb27-4a6a-99a0-0a2b5633c604 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:16.065097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddafbd5-bb27-4a6a-99a0-0a2b5633c604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:16.065451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddafbd5-bb27-4a6a-99a0-0a2b5633c604 admin admin] PATH_INFO: `/v3/projects/8e50ed3c94c44a99901115c771769ed2/users/be2962e30b9a43aa9e6a039193f083e4/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:16.084775 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddafbd5-bb27-4a6a-99a0-0a2b5633c604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e50ed3c94c44a99901115c771769ed2, user_id=be2962e30b9a43aa9e6a039193f083e4, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:16.087832 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddafbd5-bb27-4a6a-99a0-0a2b5633c604 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:16.146534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1290/2580] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:16 2022] PUT /identity/v3/projects/8e50ed3c94c44a99901115c771769ed2/users/be2962e30b9a43aa9e6a039193f083e4/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:16.153992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01977759-b2e5-4ba0-8b5f-354f649404e3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:16.159813 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:16.164997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01977759-b2e5-4ba0-8b5f-354f649404e3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:16.222276 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40579d6-7b74-4be2-bcc5-59ceb2a07fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:16.222919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40579d6-7b74-4be2-bcc5-59ceb2a07fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:16.223172 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40579d6-7b74-4be2-bcc5-59ceb2a07fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:16.223451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40579d6-7b74-4be2-bcc5-59ceb2a07fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:16.224085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40579d6-7b74-4be2-bcc5-59ceb2a07fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:16.225732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40579d6-7b74-4be2-bcc5-59ceb2a07fa5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:16.235893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1291/2581] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:16.240200 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddafbd5-bb27-4a6a-99a0-0a2b5633c604 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:16.250738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddafbd5-bb27-4a6a-99a0-0a2b5633c604 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:16.255431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a9829-7902-4a12-8f30-2043c60e5b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:16.256079 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a9829-7902-4a12-8f30-2043c60e5b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:16.256362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a9829-7902-4a12-8f30-2043c60e5b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:16.256641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a9829-7902-4a12-8f30-2043c60e5b1b admin admin] PATH_INFO: `/v3/projects/8e50ed3c94c44a99901115c771769ed2/users/be2962e30b9a43aa9e6a039193f083e4/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:16.258624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a9829-7902-4a12-8f30-2043c60e5b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e50ed3c94c44a99901115c771769ed2, user_id=be2962e30b9a43aa9e6a039193f083e4, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:16.261279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a9829-7902-4a12-8f30-2043c60e5b1b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:16.271532 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1291/2582] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:16 2022] PUT /identity/v3/projects/8e50ed3c94c44a99901115c771769ed2/users/be2962e30b9a43aa9e6a039193f083e4/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:16.283318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f732b-ca0d-44ef-904d-45c844326cd7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:16.283602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f732b-ca0d-44ef-904d-45c844326cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:16.283877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f732b-ca0d-44ef-904d-45c844326cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:16.311748 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e41f732b-ca0d-44ef-904d-45c844326cd7 None None] MFA Rules not processed for user `be2962e30b9a43aa9e6a039193f083e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:16.312967 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e41f732b-ca0d-44ef-904d-45c844326cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:16.381030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1292/2583] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:16.393211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a9829-7902-4a12-8f30-2043c60e5b1b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:16.394978 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7e1a9829-7902-4a12-8f30-2043c60e5b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:16.426211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:16.453435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a9829-7902-4a12-8f30-2043c60e5b1b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:16.457635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e9d79-ae65-4a88-ae37-03ccd80d4e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:16.458230 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e9d79-ae65-4a88-ae37-03ccd80d4e6d service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:16.458506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e9d79-ae65-4a88-ae37-03ccd80d4e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:16.458774 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e9d79-ae65-4a88-ae37-03ccd80d4e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:16.468932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e9d79-ae65-4a88-ae37-03ccd80d4e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:16.471110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e9d79-ae65-4a88-ae37-03ccd80d4e6d service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:16.480820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1292/2584] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:17.385819 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f732b-ca0d-44ef-904d-45c844326cd7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:17.450661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f732b-ca0d-44ef-904d-45c844326cd7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:17.456691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:17.456691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:17.456691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:17.456691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] PATH_INFO: `/v3/users/021995f821dd46518550e7573f57b561` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:17.457595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] RBAC: Authorizing `identity:delete_user(user_id=021995f821dd46518550e7573f57b561)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:17.459530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:17.568879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:17.651429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '021995f821dd46518550e7573f57b561'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:17.652068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '021995f821dd46518550e7573f57b561'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:17.652667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '021995f821dd46518550e7573f57b561'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:17.660068 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '021995f821dd46518550e7573f57b561'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:17.671831 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '021995f821dd46518550e7573f57b561'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:17.756125 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1293/2585] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:17 2022] DELETE /identity/v3/users/021995f821dd46518550e7573f57b561 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:17.760599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ca309-d55e-47e4-9ccf-6395bf44f43e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:17.761069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ca309-d55e-47e4-9ccf-6395bf44f43e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:17.761195 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ca309-d55e-47e4-9ccf-6395bf44f43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:17.902539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8b5ca309-d55e-47e4-9ccf-6395bf44f43e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:17.903742 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8b5ca309-d55e-47e4-9ccf-6395bf44f43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:17.965479 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1293/2586] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:17.975948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:17.977417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:18.044764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f60a-abd0-4744-ab00-925567af054a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:18.048475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea0268-5ede-4be3-8cd4-1b3e9dfb1efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:18.049079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea0268-5ede-4be3-8cd4-1b3e9dfb1efa service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:18.049385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea0268-5ede-4be3-8cd4-1b3e9dfb1efa service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:18.049660 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea0268-5ede-4be3-8cd4-1b3e9dfb1efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:18.058467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea0268-5ede-4be3-8cd4-1b3e9dfb1efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:18.059931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea0268-5ede-4be3-8cd4-1b3e9dfb1efa service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:18.069698 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1294/2587] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:18.456772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ca309-d55e-47e4-9ccf-6395bf44f43e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:18.458263 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8b5ca309-d55e-47e4-9ccf-6395bf44f43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:18.471935 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ca309-d55e-47e4-9ccf-6395bf44f43e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:18.476532 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:18.478642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:18.478642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:18.478642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] PATH_INFO: `/v3/projects/95a534b4046346c09e7d56bc58726bf0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:18.482426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a534b4046346c09e7d56bc58726bf0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:18.487643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:18.565997 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a534b4046346c09e7d56bc58726bf0', 'request_id': 'req-82493f85-75d6-481a-8d95-21d890a01be8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:18.572324 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a534b4046346c09e7d56bc58726bf0', 'request_id': 'req-82493f85-75d6-481a-8d95-21d890a01be8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:18.598954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea0268-5ede-4be3-8cd4-1b3e9dfb1efa service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:18.600393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9eea0268-5ede-4be3-8cd4-1b3e9dfb1efa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:18.655783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea0268-5ede-4be3-8cd4-1b3e9dfb1efa service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:18.661416 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a534b4046346c09e7d56bc58726bf0', 'request_id': 'req-82493f85-75d6-481a-8d95-21d890a01be8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:18.673350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] The token cache is being invalidate because project 95a534b4046346c09e7d56bc58726bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:18.673571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:18.674224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:18.675780 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1294/2588] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:18 2022] DELETE /identity/v3/projects/95a534b4046346c09e7d56bc58726bf0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:18.679674 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:18.681395 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:18.706478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f25860-9e32-499b-bd15-fb9ac4ed6b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:18.707083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f25860-9e32-499b-bd15-fb9ac4ed6b40 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:18.707362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f25860-9e32-499b-bd15-fb9ac4ed6b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:18.707635 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f25860-9e32-499b-bd15-fb9ac4ed6b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:18.709465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-20f25860-9e32-499b-bd15-fb9ac4ed6b40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:18.723342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:18.735434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:18.747470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82493f85-75d6-481a-8d95-21d890a01be8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:18.753233 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de55b9-8d9a-4814-bae9-5f6fa0a4eec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:18.753889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de55b9-8d9a-4814-bae9-5f6fa0a4eec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:18.754166 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de55b9-8d9a-4814-bae9-5f6fa0a4eec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:18.754439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de55b9-8d9a-4814-bae9-5f6fa0a4eec5 admin admin] PATH_INFO: `/v3/users/be2962e30b9a43aa9e6a039193f083e4` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:18.755803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de55b9-8d9a-4814-bae9-5f6fa0a4eec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2962e30b9a43aa9e6a039193f083e4)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:18.757745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de55b9-8d9a-4814-bae9-5f6fa0a4eec5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:18.773714 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f25860-9e32-499b-bd15-fb9ac4ed6b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:18.775266 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f25860-9e32-499b-bd15-fb9ac4ed6b40 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:18.785317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1295/2589] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:36:18.880849 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-16de55b9-8d9a-4814-bae9-5f6fa0a4eec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2962e30b9a43aa9e6a039193f083e4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:18.979154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-16de55b9-8d9a-4814-bae9-5f6fa0a4eec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2962e30b9a43aa9e6a039193f083e4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:18.979789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-16de55b9-8d9a-4814-bae9-5f6fa0a4eec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2962e30b9a43aa9e6a039193f083e4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:18.980447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-16de55b9-8d9a-4814-bae9-5f6fa0a4eec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2962e30b9a43aa9e6a039193f083e4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:18.988629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-16de55b9-8d9a-4814-bae9-5f6fa0a4eec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2962e30b9a43aa9e6a039193f083e4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:19.005762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1295/2590] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:18 2022] DELETE /identity/v3/users/be2962e30b9a43aa9e6a039193f083e4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:19.461793 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f25860-9e32-499b-bd15-fb9ac4ed6b40 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:19.473288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f25860-9e32-499b-bd15-fb9ac4ed6b40 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:19.536528 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7830cda-17c5-4757-90ae-24a11c2fb63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:19.537163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7830cda-17c5-4757-90ae-24a11c2fb63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:19.537475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7830cda-17c5-4757-90ae-24a11c2fb63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:19.537751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7830cda-17c5-4757-90ae-24a11c2fb63e admin admin] PATH_INFO: `/v3/projects/8e50ed3c94c44a99901115c771769ed2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:19.538913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7830cda-17c5-4757-90ae-24a11c2fb63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e50ed3c94c44a99901115c771769ed2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:19.540851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7830cda-17c5-4757-90ae-24a11c2fb63e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:19.637474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d7830cda-17c5-4757-90ae-24a11c2fb63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e50ed3c94c44a99901115c771769ed2', 'request_id': 'req-d7830cda-17c5-4757-90ae-24a11c2fb63e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:19.644073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d7830cda-17c5-4757-90ae-24a11c2fb63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e50ed3c94c44a99901115c771769ed2', 'request_id': 'req-d7830cda-17c5-4757-90ae-24a11c2fb63e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:19.746298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d7830cda-17c5-4757-90ae-24a11c2fb63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e50ed3c94c44a99901115c771769ed2', 'request_id': 'req-d7830cda-17c5-4757-90ae-24a11c2fb63e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:19.757900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d7830cda-17c5-4757-90ae-24a11c2fb63e admin admin] The token cache is being invalidate because project 8e50ed3c94c44a99901115c771769ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:19.758191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d7830cda-17c5-4757-90ae-24a11c2fb63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:19.766983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d7830cda-17c5-4757-90ae-24a11c2fb63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:19.766983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1296/2591] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:19 2022] DELETE /identity/v3/projects/8e50ed3c94c44a99901115c771769ed2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:19.767209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dcef5-37dd-44b7-933e-6d7fca9b3c8d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:19.767209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dcef5-37dd-44b7-933e-6d7fca9b3c8d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:19.767209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dcef5-37dd-44b7-933e-6d7fca9b3c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:19.785915 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-133dcef5-37dd-44b7-933e-6d7fca9b3c8d None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:19.787146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-133dcef5-37dd-44b7-933e-6d7fca9b3c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:19.846106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1296/2592] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:19.853734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c237e53-0db6-42bb-9994-c4803975d7dc None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:19.854023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c237e53-0db6-42bb-9994-c4803975d7dc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:19.854302 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c237e53-0db6-42bb-9994-c4803975d7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:19.873737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2c237e53-0db6-42bb-9994-c4803975d7dc None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:19.874944 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2c237e53-0db6-42bb-9994-c4803975d7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:19.883334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1297/2593] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:19.887431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dcef5-37dd-44b7-933e-6d7fca9b3c8d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:19.897732 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dcef5-37dd-44b7-933e-6d7fca9b3c8d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:19.902237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8fb51-b484-4b96-bd40-70ba6f5c48d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:19.902821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8fb51-b484-4b96-bd40-70ba6f5c48d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:19.903097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8fb51-b484-4b96-bd40-70ba6f5c48d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:19.903369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8fb51-b484-4b96-bd40-70ba6f5c48d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:19.904004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8fb51-b484-4b96-bd40-70ba6f5c48d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:36:19.904301 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8fb51-b484-4b96-bd40-70ba6f5c48d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:19.905919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8fb51-b484-4b96-bd40-70ba6f5c48d9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:19.917189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1297/2594] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:36:19.921374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c237e53-0db6-42bb-9994-c4803975d7dc None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:19.930517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c237e53-0db6-42bb-9994-c4803975d7dc None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:19.935150 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e926b-fd12-45d1-a789-05a2fcb32ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:19.935739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e926b-fd12-45d1-a789-05a2fcb32ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:19.936046 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e926b-fd12-45d1-a789-05a2fcb32ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:19.936319 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e926b-fd12-45d1-a789-05a2fcb32ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:19.937790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e926b-fd12-45d1-a789-05a2fcb32ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:19.939419 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e926b-fd12-45d1-a789-05a2fcb32ec8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:20.061711 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1298/2595] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:19 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:20.066499 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8fb51-b484-4b96-bd40-70ba6f5c48d9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:20.076459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8fb51-b484-4b96-bd40-70ba6f5c48d9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:20.132733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a0278-f03d-4722-8511-237699706f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:20.133359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a0278-f03d-4722-8511-237699706f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:20.133643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a0278-f03d-4722-8511-237699706f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:20.133941 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a0278-f03d-4722-8511-237699706f6f admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:20.134561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a0278-f03d-4722-8511-237699706f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:20.136463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a0278-f03d-4722-8511-237699706f6f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:20.144527 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:20.219670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1298/2596] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:20 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:20.223891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e926b-fd12-45d1-a789-05a2fcb32ec8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:20.234190 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e926b-fd12-45d1-a789-05a2fcb32ec8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:20.239297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad2e47-be9a-482f-9fba-ae6590a03635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:20.239892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad2e47-be9a-482f-9fba-ae6590a03635 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:20.240169 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad2e47-be9a-482f-9fba-ae6590a03635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:20.240441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad2e47-be9a-482f-9fba-ae6590a03635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:20.241075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad2e47-be9a-482f-9fba-ae6590a03635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:20.242763 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad2e47-be9a-482f-9fba-ae6590a03635 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:20.254447 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1299/2597] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:20.259719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a0278-f03d-4722-8511-237699706f6f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:20.269698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a0278-f03d-4722-8511-237699706f6f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:20.275040 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13327cd-61aa-4720-8ce7-f75f9a221dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:20.275634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13327cd-61aa-4720-8ce7-f75f9a221dfe admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:20.275963 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13327cd-61aa-4720-8ce7-f75f9a221dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:20.276240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13327cd-61aa-4720-8ce7-f75f9a221dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:20.276884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13327cd-61aa-4720-8ce7-f75f9a221dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:20.278501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13327cd-61aa-4720-8ce7-f75f9a221dfe admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:20.288465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1299/2598] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:20.292671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad2e47-be9a-482f-9fba-ae6590a03635 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:20.298353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:20.303934 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad2e47-be9a-482f-9fba-ae6590a03635 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:20.308564 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299601bb-d8df-4b89-87b1-b5663f7b5ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:20.309282 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299601bb-d8df-4b89-87b1-b5663f7b5ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:20.309562 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299601bb-d8df-4b89-87b1-b5663f7b5ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:20.309836 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299601bb-d8df-4b89-87b1-b5663f7b5ff1 admin admin] PATH_INFO: `/v3/projects/71c5a4a5888a4588b7ddf15f7d904fd0/users/a5ae4a20bf784d17aef19db4bd86e6c5/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:20.325780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299601bb-d8df-4b89-87b1-b5663f7b5ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c5a4a5888a4588b7ddf15f7d904fd0, user_id=a5ae4a20bf784d17aef19db4bd86e6c5, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:20.328515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299601bb-d8df-4b89-87b1-b5663f7b5ff1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:20.420005 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1300/2599] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:20 2022] PUT /identity/v3/projects/71c5a4a5888a4588b7ddf15f7d904fd0/users/a5ae4a20bf784d17aef19db4bd86e6c5/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:20.432641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee4f2-29bc-4526-a407-5132b69fa858 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:20.432931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee4f2-29bc-4526-a407-5132b69fa858 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:20.433207 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ee4f2-29bc-4526-a407-5132b69fa858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:20.460890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-003ee4f2-29bc-4526-a407-5132b69fa858 None None] MFA Rules not processed for user `a5ae4a20bf784d17aef19db4bd86e6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:20.462384 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-003ee4f2-29bc-4526-a407-5132b69fa858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:20.528466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1300/2600] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:20.533672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299601bb-d8df-4b89-87b1-b5663f7b5ff1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:20.596715 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299601bb-d8df-4b89-87b1-b5663f7b5ff1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:20.601449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccdead-da3d-4bd5-91ea-47b481159968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:20.602101 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccdead-da3d-4bd5-91ea-47b481159968 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:20.602375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccdead-da3d-4bd5-91ea-47b481159968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:20.602638 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccdead-da3d-4bd5-91ea-47b481159968 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:20.603273 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccdead-da3d-4bd5-91ea-47b481159968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:20.605167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccdead-da3d-4bd5-91ea-47b481159968 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:20.684903 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1301/2601] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:20 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:20.688976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ee4f2-29bc-4526-a407-5132b69fa858 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:20.699853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ee4f2-29bc-4526-a407-5132b69fa858 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:20.756853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b757692-ebe3-4dd6-a853-e5917cf46bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:20.757495 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b757692-ebe3-4dd6-a853-e5917cf46bae admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:20.757776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b757692-ebe3-4dd6-a853-e5917cf46bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:20.758051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b757692-ebe3-4dd6-a853-e5917cf46bae admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:20.758686 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b757692-ebe3-4dd6-a853-e5917cf46bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:20.760598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b757692-ebe3-4dd6-a853-e5917cf46bae admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:20.888311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1301/2602] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:20 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:20.892846 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccdead-da3d-4bd5-91ea-47b481159968 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:20.902986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccdead-da3d-4bd5-91ea-47b481159968 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:20.908075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b950e-0eb1-49ca-88bd-78ceb4f01477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:20.908666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b950e-0eb1-49ca-88bd-78ceb4f01477 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:20.908943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b950e-0eb1-49ca-88bd-78ceb4f01477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:20.909290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b950e-0eb1-49ca-88bd-78ceb4f01477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:20.909884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b950e-0eb1-49ca-88bd-78ceb4f01477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:20.911486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b950e-0eb1-49ca-88bd-78ceb4f01477 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:20.922424 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1302/2603] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:36:20.926769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b757692-ebe3-4dd6-a853-e5917cf46bae admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:20.936708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b757692-ebe3-4dd6-a853-e5917cf46bae admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:20.941447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a972259-62f0-405a-b9c9-ed4b6ad252e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:20.942081 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a972259-62f0-405a-b9c9-ed4b6ad252e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:20.942353 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a972259-62f0-405a-b9c9-ed4b6ad252e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:20.942620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a972259-62f0-405a-b9c9-ed4b6ad252e3 admin admin] PATH_INFO: `/v3/projects/73ab5e94276f4203b09cf22962ccbcce/users/bda6f2a2ca9041eb9e244aab37159b3f/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:20.957862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a972259-62f0-405a-b9c9-ed4b6ad252e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ab5e94276f4203b09cf22962ccbcce, user_id=bda6f2a2ca9041eb9e244aab37159b3f, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:20.960545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a972259-62f0-405a-b9c9-ed4b6ad252e3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:21.054148 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1302/2604] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:20 2022] PUT /identity/v3/projects/73ab5e94276f4203b09cf22962ccbcce/users/bda6f2a2ca9041eb9e244aab37159b3f/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:21.060091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b950e-0eb1-49ca-88bd-78ceb4f01477 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:21.070074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b950e-0eb1-49ca-88bd-78ceb4f01477 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:21.126945 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecbbde-eae9-47fa-8971-2e442d3293a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:21.127543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecbbde-eae9-47fa-8971-2e442d3293a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:21.127815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecbbde-eae9-47fa-8971-2e442d3293a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:21.128085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecbbde-eae9-47fa-8971-2e442d3293a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:21.128720 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecbbde-eae9-47fa-8971-2e442d3293a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:21.130357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecbbde-eae9-47fa-8971-2e442d3293a9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:21.140466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1303/2605] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:21.145151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a972259-62f0-405a-b9c9-ed4b6ad252e3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:21.156485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a972259-62f0-405a-b9c9-ed4b6ad252e3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:21.161747 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808b3c1-fff2-4faf-b642-c73740114ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:21.162369 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808b3c1-fff2-4faf-b642-c73740114ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:21.162762 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808b3c1-fff2-4faf-b642-c73740114ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:21.163048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808b3c1-fff2-4faf-b642-c73740114ba5 admin admin] PATH_INFO: `/v3/projects/73ab5e94276f4203b09cf22962ccbcce/users/bda6f2a2ca9041eb9e244aab37159b3f/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:21.164979 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808b3c1-fff2-4faf-b642-c73740114ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ab5e94276f4203b09cf22962ccbcce, user_id=bda6f2a2ca9041eb9e244aab37159b3f, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:21.167705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808b3c1-fff2-4faf-b642-c73740114ba5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:21.177999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1303/2606] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:21 2022] PUT /identity/v3/projects/73ab5e94276f4203b09cf22962ccbcce/users/bda6f2a2ca9041eb9e244aab37159b3f/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:21.189863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76248f60-a408-4837-93d5-2dcb8ead0e06 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:21.190145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76248f60-a408-4837-93d5-2dcb8ead0e06 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:21.190420 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76248f60-a408-4837-93d5-2dcb8ead0e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:21.219529 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-76248f60-a408-4837-93d5-2dcb8ead0e06 None None] MFA Rules not processed for user `bda6f2a2ca9041eb9e244aab37159b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:21.220739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-76248f60-a408-4837-93d5-2dcb8ead0e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:21.380172 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:21.412099 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1304/2607] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:21.422655 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808b3c1-fff2-4faf-b642-c73740114ba5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:21.424424 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4808b3c1-fff2-4faf-b642-c73740114ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:21.448577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:21.485805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808b3c1-fff2-4faf-b642-c73740114ba5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:21.491177 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8019-d135-4ffb-a6bc-0195e77bc39f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:21.491896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8019-d135-4ffb-a6bc-0195e77bc39f service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:21.492242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8019-d135-4ffb-a6bc-0195e77bc39f service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:21.492578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8019-d135-4ffb-a6bc-0195e77bc39f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:21.502468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca8019-d135-4ffb-a6bc-0195e77bc39f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:21.503946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca8019-d135-4ffb-a6bc-0195e77bc39f service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:21.513415 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1304/2608] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:24.357377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76248f60-a408-4837-93d5-2dcb8ead0e06 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:24.419381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76248f60-a408-4837-93d5-2dcb8ead0e06 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:24.423862 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed6020-8b71-4d8e-9be6-644a7382f5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:24.424485 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed6020-8b71-4d8e-9be6-644a7382f5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:24.424766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed6020-8b71-4d8e-9be6-644a7382f5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:24.425040 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed6020-8b71-4d8e-9be6-644a7382f5d6 admin admin] PATH_INFO: `/v3/users/a5ae4a20bf784d17aef19db4bd86e6c5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:24.426214 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed6020-8b71-4d8e-9be6-644a7382f5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ae4a20bf784d17aef19db4bd86e6c5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:24.428116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed6020-8b71-4d8e-9be6-644a7382f5d6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:24.658806 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95ed6020-8b71-4d8e-9be6-644a7382f5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ae4a20bf784d17aef19db4bd86e6c5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:24.659458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95ed6020-8b71-4d8e-9be6-644a7382f5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ae4a20bf784d17aef19db4bd86e6c5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:24.660597 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95ed6020-8b71-4d8e-9be6-644a7382f5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ae4a20bf784d17aef19db4bd86e6c5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:24.667995 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95ed6020-8b71-4d8e-9be6-644a7382f5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ae4a20bf784d17aef19db4bd86e6c5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:24.671088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8019-d135-4ffb-a6bc-0195e77bc39f service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:24.672518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aaca8019-d135-4ffb-a6bc-0195e77bc39f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:24.683234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95ed6020-8b71-4d8e-9be6-644a7382f5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ae4a20bf784d17aef19db4bd86e6c5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:24.686229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8019-d135-4ffb-a6bc-0195e77bc39f service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:24.690648 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:24.691287 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:24.691557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:24.691820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] PATH_INFO: `/v3/users/055ba5edbaa8423d8e434c0a86e091c6` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:24.692903 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] RBAC: Authorizing `identity:delete_user(user_id=055ba5edbaa8423d8e434c0a86e091c6)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:24.694859 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:24.761805 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1305/2609] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:24 2022] DELETE /identity/v3/users/a5ae4a20bf784d17aef19db4bd86e6c5 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:24.766393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fafe8-62ca-4eb1-9304-bd6875ec1bc0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:24.766677 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fafe8-62ca-4eb1-9304-bd6875ec1bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:24.766951 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fafe8-62ca-4eb1-9304-bd6875ec1bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:24.785700 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1d8fafe8-62ca-4eb1-9304-bd6875ec1bc0 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:24.786899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1d8fafe8-62ca-4eb1-9304-bd6875ec1bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:24.832087 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:24.844200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1306/2610] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:24.854349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fafe8-62ca-4eb1-9304-bd6875ec1bc0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:24.855650 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1d8fafe8-62ca-4eb1-9304-bd6875ec1bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:24.874678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055ba5edbaa8423d8e434c0a86e091c6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:24.912088 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fafe8-62ca-4eb1-9304-bd6875ec1bc0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:24.915793 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7992b4-97c1-4b56-9272-39fe54597692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:24.916395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7992b4-97c1-4b56-9272-39fe54597692 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:24.916671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7992b4-97c1-4b56-9272-39fe54597692 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:24.916943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7992b4-97c1-4b56-9272-39fe54597692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:24.925796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7992b4-97c1-4b56-9272-39fe54597692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:24.927262 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7992b4-97c1-4b56-9272-39fe54597692 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:24.937466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1307/2611] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:36:24.957238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055ba5edbaa8423d8e434c0a86e091c6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:24.957896 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055ba5edbaa8423d8e434c0a86e091c6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:24.958578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055ba5edbaa8423d8e434c0a86e091c6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:24.966465 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055ba5edbaa8423d8e434c0a86e091c6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:24.989459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1305/2612] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:24 2022] DELETE /identity/v3/users/055ba5edbaa8423d8e434c0a86e091c6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:24.993931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185a21d-54c3-4775-9ecb-6b3314ae58a2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:25.000741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185a21d-54c3-4775-9ecb-6b3314ae58a2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:25.000741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185a21d-54c3-4775-9ecb-6b3314ae58a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:25.015636 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9185a21d-54c3-4775-9ecb-6b3314ae58a2 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:25.016843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9185a21d-54c3-4775-9ecb-6b3314ae58a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:25.078137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1308/2613] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:25.089534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:25.090974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:25.156628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c49409-d25c-4ad3-a65c-ea30f66d634c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:25.160936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0326653-2241-4f24-8114-ca3f4f57dbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:25.161711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0326653-2241-4f24-8114-ca3f4f57dbdb service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:25.162045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0326653-2241-4f24-8114-ca3f4f57dbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:25.162386 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0326653-2241-4f24-8114-ca3f4f57dbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:25.172180 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0326653-2241-4f24-8114-ca3f4f57dbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:25.173735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0326653-2241-4f24-8114-ca3f4f57dbdb service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:25.185390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1306/2614] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:36:25.475576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185a21d-54c3-4775-9ecb-6b3314ae58a2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:25.479108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9185a21d-54c3-4775-9ecb-6b3314ae58a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:25.491006 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185a21d-54c3-4775-9ecb-6b3314ae58a2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:25.497209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:25.498470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:25.498729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:25.499007 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] PATH_INFO: `/v3/projects/71c5a4a5888a4588b7ddf15f7d904fd0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:25.500240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c5a4a5888a4588b7ddf15f7d904fd0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:25.503023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:25.599274 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c5a4a5888a4588b7ddf15f7d904fd0', 'request_id': 'req-06a2e255-1cbb-4d67-a007-7599e45b533d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:25.605538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c5a4a5888a4588b7ddf15f7d904fd0', 'request_id': 'req-06a2e255-1cbb-4d67-a007-7599e45b533d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:25.689187 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c5a4a5888a4588b7ddf15f7d904fd0', 'request_id': 'req-06a2e255-1cbb-4d67-a007-7599e45b533d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:25.698322 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0326653-2241-4f24-8114-ca3f4f57dbdb service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:25.699165 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a0326653-2241-4f24-8114-ca3f4f57dbdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:25.703726 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] The token cache is being invalidate because project 71c5a4a5888a4588b7ddf15f7d904fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:25.704140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:25.704865 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:25.706556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1309/2615] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:25 2022] DELETE /identity/v3/projects/71c5a4a5888a4588b7ddf15f7d904fd0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:25.710589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:25.712182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:25.714074 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0326653-2241-4f24-8114-ca3f4f57dbdb service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:25.736183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:25.756709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:25.779858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:25.780487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:25.780763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:25.780990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2e255-1cbb-4d67-a007-7599e45b533d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:25.781105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] PATH_INFO: `/v3/projects/8cd44091a84e46e09f96835508104d30` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:25.782206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cd44091a84e46e09f96835508104d30)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:25.784316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:25.785649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:25.786268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:25.786542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:25.786810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] PATH_INFO: `/v3/users/bda6f2a2ca9041eb9e244aab37159b3f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:25.787921 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda6f2a2ca9041eb9e244aab37159b3f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:25.789853 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:25.972548 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd44091a84e46e09f96835508104d30', 'request_id': 'req-04da3434-1046-4fd8-b244-5681df3d08e8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:25.972953 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda6f2a2ca9041eb9e244aab37159b3f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:25.973695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda6f2a2ca9041eb9e244aab37159b3f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:25.974290 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda6f2a2ca9041eb9e244aab37159b3f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:25.978910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd44091a84e46e09f96835508104d30', 'request_id': 'req-04da3434-1046-4fd8-b244-5681df3d08e8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:25.981348 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda6f2a2ca9041eb9e244aab37159b3f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:25.993740 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda6f2a2ca9041eb9e244aab37159b3f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:26.032429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd44091a84e46e09f96835508104d30', 'request_id': 'req-04da3434-1046-4fd8-b244-5681df3d08e8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:26.043930 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] The token cache is being invalidate because project 8cd44091a84e46e09f96835508104d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:26.044214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:26.044821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:26.046351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1307/2616] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:25 2022] DELETE /identity/v3/projects/8cd44091a84e46e09f96835508104d30 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:26.050194 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:26.051946 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:26.112582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da3434-1046-4fd8-b244-5681df3d08e8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:26.117932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:26.118544 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:26.118817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:26.119085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] PATH_INFO: `/v3/users/3d8aeea8b8f54752be697cece45e9139` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:26.120186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8aeea8b8f54752be697cece45e9139)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:26.122169 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:26.157906 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1310/2617] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:25 2022] DELETE /identity/v3/users/bda6f2a2ca9041eb9e244aab37159b3f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:26.269828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8aeea8b8f54752be697cece45e9139'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:26.345715 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8aeea8b8f54752be697cece45e9139'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:26.346552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8aeea8b8f54752be697cece45e9139'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:26.347980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8aeea8b8f54752be697cece45e9139'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:26.363737 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8aeea8b8f54752be697cece45e9139'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:26.371100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:26.385467 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1308/2618] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:26 2022] DELETE /identity/v3/users/3d8aeea8b8f54752be697cece45e9139 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:26.661900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:26.663560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:26.742898 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d744df-ed6b-4363-897a-70c7c9bc4639 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:26.790342 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:26.802746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d18266-6081-42ee-ba04-48decb5a5b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:26.803439 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d18266-6081-42ee-ba04-48decb5a5b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:26.803716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d18266-6081-42ee-ba04-48decb5a5b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:26.803991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d18266-6081-42ee-ba04-48decb5a5b9f admin admin] PATH_INFO: `/v3/projects/73ab5e94276f4203b09cf22962ccbcce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:26.805199 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d18266-6081-42ee-ba04-48decb5a5b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ab5e94276f4203b09cf22962ccbcce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:26.807178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d18266-6081-42ee-ba04-48decb5a5b9f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:26.913303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:26.914753 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:26.925488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e4d18266-6081-42ee-ba04-48decb5a5b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ab5e94276f4203b09cf22962ccbcce', 'request_id': 'req-e4d18266-6081-42ee-ba04-48decb5a5b9f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:26.928131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9b5dc-3514-4383-b848-5dda845b800e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:26.932689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e4d18266-6081-42ee-ba04-48decb5a5b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ab5e94276f4203b09cf22962ccbcce', 'request_id': 'req-e4d18266-6081-42ee-ba04-48decb5a5b9f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:26.986676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74167047-e0ce-48e0-95f7-0021189999e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:26.986983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e4d18266-6081-42ee-ba04-48decb5a5b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ab5e94276f4203b09cf22962ccbcce', 'request_id': 'req-e4d18266-6081-42ee-ba04-48decb5a5b9f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:26.987311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74167047-e0ce-48e0-95f7-0021189999e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:26.987585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74167047-e0ce-48e0-95f7-0021189999e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:26.987858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74167047-e0ce-48e0-95f7-0021189999e5 admin admin] PATH_INFO: `/v3/projects/714723da92f545ba8bd2a649c9d022d2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:26.989004 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74167047-e0ce-48e0-95f7-0021189999e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=714723da92f545ba8bd2a649c9d022d2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:26.991018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74167047-e0ce-48e0-95f7-0021189999e5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.000255 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e4d18266-6081-42ee-ba04-48decb5a5b9f admin admin] The token cache is being invalidate because project 73ab5e94276f4203b09cf22962ccbcce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:27.000546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e4d18266-6081-42ee-ba04-48decb5a5b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:27.001199 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e4d18266-6081-42ee-ba04-48decb5a5b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:27.007522 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1311/2619] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:26 2022] DELETE /identity/v3/projects/73ab5e94276f4203b09cf22962ccbcce => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:27.008935 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d5f92-79ee-4be8-955f-68e789467a36 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.009328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d5f92-79ee-4be8-955f-68e789467a36 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.009676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d5f92-79ee-4be8-955f-68e789467a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.030602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8b4d5f92-79ee-4be8-955f-68e789467a36 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:27.031863 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8b4d5f92-79ee-4be8-955f-68e789467a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:27.040461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1312/2620] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:27.053109 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016a0b2-3efb-43b6-b518-0aee18434fe7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.053484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016a0b2-3efb-43b6-b518-0aee18434fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.053755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016a0b2-3efb-43b6-b518-0aee18434fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.073163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6016a0b2-3efb-43b6-b518-0aee18434fe7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:27.074430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6016a0b2-3efb-43b6-b518-0aee18434fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:27.084670 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1313/2621] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:27.088828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016a0b2-3efb-43b6-b518-0aee18434fe7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:27.100176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016a0b2-3efb-43b6-b518-0aee18434fe7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:27.110008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74167047-e0ce-48e0-95f7-0021189999e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714723da92f545ba8bd2a649c9d022d2', 'request_id': 'req-74167047-e0ce-48e0-95f7-0021189999e5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:27.117740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74167047-e0ce-48e0-95f7-0021189999e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714723da92f545ba8bd2a649c9d022d2', 'request_id': 'req-74167047-e0ce-48e0-95f7-0021189999e5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:27.162187 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a1667-0d8e-4c9f-8dd6-fddd85436fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:27.162818 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a1667-0d8e-4c9f-8dd6-fddd85436fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.163067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a1667-0d8e-4c9f-8dd6-fddd85436fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.163334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a1667-0d8e-4c9f-8dd6-fddd85436fdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.163971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a1667-0d8e-4c9f-8dd6-fddd85436fdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:36:27.164267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a1667-0d8e-4c9f-8dd6-fddd85436fdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:27.165898 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a1667-0d8e-4c9f-8dd6-fddd85436fdc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.177452 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1314/2622] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:36:27.181820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a1667-0d8e-4c9f-8dd6-fddd85436fdc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:27.186227 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74167047-e0ce-48e0-95f7-0021189999e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714723da92f545ba8bd2a649c9d022d2', 'request_id': 'req-74167047-e0ce-48e0-95f7-0021189999e5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:27.191963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a1667-0d8e-4c9f-8dd6-fddd85436fdc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:27.196850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987466e-6f37-485e-92cf-f3113696a5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:27.197519 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987466e-6f37-485e-92cf-f3113696a5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.197797 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987466e-6f37-485e-92cf-f3113696a5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.198062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987466e-6f37-485e-92cf-f3113696a5c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.198679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987466e-6f37-485e-92cf-f3113696a5c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:27.198985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74167047-e0ce-48e0-95f7-0021189999e5 admin admin] The token cache is being invalidate because project 714723da92f545ba8bd2a649c9d022d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:27.199372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74167047-e0ce-48e0-95f7-0021189999e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:27.200120 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74167047-e0ce-48e0-95f7-0021189999e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:27.200546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987466e-6f37-485e-92cf-f3113696a5c1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.201865 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1309/2623] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:26 2022] DELETE /identity/v3/projects/714723da92f545ba8bd2a649c9d022d2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:27.212726 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1018bd0-68ad-4baa-b03e-0a66d27485f3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.213010 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1018bd0-68ad-4baa-b03e-0a66d27485f3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.213309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1018bd0-68ad-4baa-b03e-0a66d27485f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.233084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a1018bd0-68ad-4baa-b03e-0a66d27485f3 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:27.236751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a1018bd0-68ad-4baa-b03e-0a66d27485f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:27.243104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1310/2624] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:27.251410 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d572da-24be-4a6f-b52d-47e79a49ae64 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.251691 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d572da-24be-4a6f-b52d-47e79a49ae64 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.251964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d572da-24be-4a6f-b52d-47e79a49ae64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.273203 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-49d572da-24be-4a6f-b52d-47e79a49ae64 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:27.274425 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-49d572da-24be-4a6f-b52d-47e79a49ae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:27.282556 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1311/2625] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:27.286638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d572da-24be-4a6f-b52d-47e79a49ae64 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:27.295585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d572da-24be-4a6f-b52d-47e79a49ae64 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:27.299501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1315/2626] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:27 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:27.301221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987466e-6f37-485e-92cf-f3113696a5c1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:27.304218 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2987466e-6f37-485e-92cf-f3113696a5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:27.351568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:27.360820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f13cc-785b-4c6d-b085-8cb3128cc19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:27.362059 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f13cc-785b-4c6d-b085-8cb3128cc19b admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.363634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f13cc-785b-4c6d-b085-8cb3128cc19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.363634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f13cc-785b-4c6d-b085-8cb3128cc19b admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.364466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f13cc-785b-4c6d-b085-8cb3128cc19b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:36:27.364777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f13cc-785b-4c6d-b085-8cb3128cc19b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:27.366537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f13cc-785b-4c6d-b085-8cb3128cc19b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.373998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:27.378577 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987466e-6f37-485e-92cf-f3113696a5c1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:27.381231 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1312/2627] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:36:27.385126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f13cc-785b-4c6d-b085-8cb3128cc19b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:27.395379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f13cc-785b-4c6d-b085-8cb3128cc19b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:27.398268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0500d-185b-465d-8a7e-f7e58f88e452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:27.398970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0500d-185b-465d-8a7e-f7e58f88e452 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.399256 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0500d-185b-465d-8a7e-f7e58f88e452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.399532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0500d-185b-465d-8a7e-f7e58f88e452 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.401131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1735f-dda1-4bd8-87f0-1c4dd4d513f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:27.401954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1735f-dda1-4bd8-87f0-1c4dd4d513f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.408016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1735f-dda1-4bd8-87f0-1c4dd4d513f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.408352 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0500d-185b-465d-8a7e-f7e58f88e452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:27.408454 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1735f-dda1-4bd8-87f0-1c4dd4d513f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.408454 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1735f-dda1-4bd8-87f0-1c4dd4d513f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:27.408618 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0500d-185b-465d-8a7e-f7e58f88e452 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.408736 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1735f-dda1-4bd8-87f0-1c4dd4d513f2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.488427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1313/2628] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:27 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:27.489984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1735f-dda1-4bd8-87f0-1c4dd4d513f2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:27.505727 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1316/2629] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:27 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:27.508496 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0500d-185b-465d-8a7e-f7e58f88e452 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:27.518279 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0500d-185b-465d-8a7e-f7e58f88e452 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:27.563672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1735f-dda1-4bd8-87f0-1c4dd4d513f2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:27.568446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e5a13-b7bf-4cb0-8994-6a2daaf15cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:27.569047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e5a13-b7bf-4cb0-8994-6a2daaf15cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.569357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e5a13-b7bf-4cb0-8994-6a2daaf15cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.569633 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e5a13-b7bf-4cb0-8994-6a2daaf15cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.570287 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e5a13-b7bf-4cb0-8994-6a2daaf15cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:27.572190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e5a13-b7bf-4cb0-8994-6a2daaf15cc6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.599052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d8d33-6088-45be-b926-3c1f76ca28d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:27.599667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d8d33-6088-45be-b926-3c1f76ca28d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.599947 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d8d33-6088-45be-b926-3c1f76ca28d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.600219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d8d33-6088-45be-b926-3c1f76ca28d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.600861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d8d33-6088-45be-b926-3c1f76ca28d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:27.602580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d8d33-6088-45be-b926-3c1f76ca28d9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.612264 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1317/2630] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:36:27.622006 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d8d33-6088-45be-b926-3c1f76ca28d9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:27.631543 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d8d33-6088-45be-b926-3c1f76ca28d9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:27.636116 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82a047-1f86-4843-85b4-e42cb0216d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:27.636784 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82a047-1f86-4843-85b4-e42cb0216d0d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.637058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82a047-1f86-4843-85b4-e42cb0216d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.637369 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82a047-1f86-4843-85b4-e42cb0216d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.637988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82a047-1f86-4843-85b4-e42cb0216d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:27.639641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82a047-1f86-4843-85b4-e42cb0216d0d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.649286 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1318/2631] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:36:27.653242 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82a047-1f86-4843-85b4-e42cb0216d0d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:27.663066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82a047-1f86-4843-85b4-e42cb0216d0d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:27.667931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb62a6-581a-4246-85a3-1b2ca0e33131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:27.668622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb62a6-581a-4246-85a3-1b2ca0e33131 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.668899 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb62a6-581a-4246-85a3-1b2ca0e33131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.669170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb62a6-581a-4246-85a3-1b2ca0e33131 admin admin] PATH_INFO: `/v3/projects/ac259816f8a143dfb1f2823e70de21e5/users/971cc79cc04f4d87bbf41671db465a1b/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.671342 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1314/2632] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:27 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:27.678458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e5a13-b7bf-4cb0-8994-6a2daaf15cc6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:27.686035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb62a6-581a-4246-85a3-1b2ca0e33131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac259816f8a143dfb1f2823e70de21e5, user_id=971cc79cc04f4d87bbf41671db465a1b, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:27.688159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e5a13-b7bf-4cb0-8994-6a2daaf15cc6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:27.688653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb62a6-581a-4246-85a3-1b2ca0e33131 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.692994 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa67a60-ae4b-41a8-acbb-7158fe3c3a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:27.693697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa67a60-ae4b-41a8-acbb-7158fe3c3a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.694066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa67a60-ae4b-41a8-acbb-7158fe3c3a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.694398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa67a60-ae4b-41a8-acbb-7158fe3c3a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.695089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa67a60-ae4b-41a8-acbb-7158fe3c3a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:27.696711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa67a60-ae4b-41a8-acbb-7158fe3c3a21 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.706980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1315/2633] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:27.710813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa67a60-ae4b-41a8-acbb-7158fe3c3a21 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:27.720603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa67a60-ae4b-41a8-acbb-7158fe3c3a21 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:27.726621 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f5ec7-f61d-4c1b-bfca-e58b14385217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:27.727234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f5ec7-f61d-4c1b-bfca-e58b14385217 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.732437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f5ec7-f61d-4c1b-bfca-e58b14385217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.732437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f5ec7-f61d-4c1b-bfca-e58b14385217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.732437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f5ec7-f61d-4c1b-bfca-e58b14385217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:27.732437 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f5ec7-f61d-4c1b-bfca-e58b14385217 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.740998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1316/2634] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:36:27.744818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f5ec7-f61d-4c1b-bfca-e58b14385217 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:27.754374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f5ec7-f61d-4c1b-bfca-e58b14385217 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:27.757462 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1319/2635] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:27 2022] PUT /identity/v3/projects/ac259816f8a143dfb1f2823e70de21e5/users/971cc79cc04f4d87bbf41671db465a1b/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:27.768728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8f4de-7a1b-4bd4-8eda-993c669d36b6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.769009 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8f4de-7a1b-4bd4-8eda-993c669d36b6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.769304 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8f4de-7a1b-4bd4-8eda-993c669d36b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.797165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-aaf8f4de-7a1b-4bd4-8eda-993c669d36b6 None None] MFA Rules not processed for user `971cc79cc04f4d87bbf41671db465a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:27.798493 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-aaf8f4de-7a1b-4bd4-8eda-993c669d36b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:27.816661 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053249ba-6d86-4bd7-95bf-984c8e92ade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:27.817535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053249ba-6d86-4bd7-95bf-984c8e92ade1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.817839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053249ba-6d86-4bd7-95bf-984c8e92ade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.818106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053249ba-6d86-4bd7-95bf-984c8e92ade1 admin admin] PATH_INFO: `/v3/projects/7ea63530f9e342bc9d794d77460eb731/users/37c8efdc3a684c90a0babebd8ffb9dea/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.835889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053249ba-6d86-4bd7-95bf-984c8e92ade1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea63530f9e342bc9d794d77460eb731, user_id=37c8efdc3a684c90a0babebd8ffb9dea, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:27.835889 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053249ba-6d86-4bd7-95bf-984c8e92ade1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.873470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1320/2636] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:27.877961 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8f4de-7a1b-4bd4-8eda-993c669d36b6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:27.887830 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8f4de-7a1b-4bd4-8eda-993c669d36b6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:27.892295 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5710c6a-aa36-459c-afd7-e6402ce1bc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:27.892986 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5710c6a-aa36-459c-afd7-e6402ce1bc4e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.893283 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5710c6a-aa36-459c-afd7-e6402ce1bc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.893562 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5710c6a-aa36-459c-afd7-e6402ce1bc4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.894684 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5710c6a-aa36-459c-afd7-e6402ce1bc4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:27.896560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5710c6a-aa36-459c-afd7-e6402ce1bc4e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:27.911215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:27.918048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1317/2637] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:27 2022] PUT /identity/v3/projects/7ea63530f9e342bc9d794d77460eb731/users/37c8efdc3a684c90a0babebd8ffb9dea/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:27.929302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56479-9ceb-4dd1-a516-1c68199d2319 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:27.929592 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56479-9ceb-4dd1-a516-1c68199d2319 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:27.929867 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae56479-9ceb-4dd1-a516-1c68199d2319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:27.957372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7ae56479-9ceb-4dd1-a516-1c68199d2319 None None] MFA Rules not processed for user `37c8efdc3a684c90a0babebd8ffb9dea`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:27.958585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7ae56479-9ceb-4dd1-a516-1c68199d2319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:27.971417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:28.022814 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1321/2638] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:27 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:28.028453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1318/2639] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:28.029341 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5710c6a-aa36-459c-afd7-e6402ce1bc4e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:28.036082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae56479-9ceb-4dd1-a516-1c68199d2319 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:28.037669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7ae56479-9ceb-4dd1-a516-1c68199d2319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:28.092605 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae56479-9ceb-4dd1-a516-1c68199d2319 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:28.093104 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5710c6a-aa36-459c-afd7-e6402ce1bc4e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:28.098591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86deb43-c39b-4fa0-8460-b2bc41b60ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:28.099299 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86deb43-c39b-4fa0-8460-b2bc41b60ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:28.099530 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86deb43-c39b-4fa0-8460-b2bc41b60ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:28.099802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86deb43-c39b-4fa0-8460-b2bc41b60ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:28.100433 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86deb43-c39b-4fa0-8460-b2bc41b60ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:28.102394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86deb43-c39b-4fa0-8460-b2bc41b60ba3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:28.146442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeda42-af4c-4324-b4d9-67d305743748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:28.147051 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeda42-af4c-4324-b4d9-67d305743748 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:28.147329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeda42-af4c-4324-b4d9-67d305743748 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:28.147598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeda42-af4c-4324-b4d9-67d305743748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:28.180708 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1322/2640] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:28 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:28.184678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86deb43-c39b-4fa0-8460-b2bc41b60ba3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:28.196776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86deb43-c39b-4fa0-8460-b2bc41b60ba3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:28.202277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a2e00-27c3-4df9-9558-02d1a87258d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:28.202956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a2e00-27c3-4df9-9558-02d1a87258d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:28.209229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a2e00-27c3-4df9-9558-02d1a87258d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:28.209229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a2e00-27c3-4df9-9558-02d1a87258d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:28.209229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a2e00-27c3-4df9-9558-02d1a87258d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:28.209229 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a2e00-27c3-4df9-9558-02d1a87258d9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:28.209675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeda42-af4c-4324-b4d9-67d305743748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:28.209675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeda42-af4c-4324-b4d9-67d305743748 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:28.218529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1319/2641] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:36:28.222979 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1323/2642] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:36:28.224205 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeda42-af4c-4324-b4d9-67d305743748 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:28.235392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeda42-af4c-4324-b4d9-67d305743748 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:28.240339 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9dcdb-5cc2-499d-9537-47ad643fbb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:28.241020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9dcdb-5cc2-499d-9537-47ad643fbb62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:28.241354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9dcdb-5cc2-499d-9537-47ad643fbb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:28.241631 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9dcdb-5cc2-499d-9537-47ad643fbb62 admin admin] PATH_INFO: `/v3/projects/4599922eb1bb4f63a461a633da0959f5/users/7565fc95f2c3481092a645213ee09a85/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:28.256809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9dcdb-5cc2-499d-9537-47ad643fbb62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4599922eb1bb4f63a461a633da0959f5, user_id=7565fc95f2c3481092a645213ee09a85, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:28.259533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9dcdb-5cc2-499d-9537-47ad643fbb62 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:28.340755 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1320/2643] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:28 2022] PUT /identity/v3/projects/4599922eb1bb4f63a461a633da0959f5/users/7565fc95f2c3481092a645213ee09a85/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:28.345672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a2e00-27c3-4df9-9558-02d1a87258d9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:28.356518 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a2e00-27c3-4df9-9558-02d1a87258d9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:28.412908 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3fa61-c095-4eb7-a98b-7c04a2d0ee45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:28.413546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3fa61-c095-4eb7-a98b-7c04a2d0ee45 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:28.413821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3fa61-c095-4eb7-a98b-7c04a2d0ee45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:28.414088 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3fa61-c095-4eb7-a98b-7c04a2d0ee45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:28.414712 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3fa61-c095-4eb7-a98b-7c04a2d0ee45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:28.416324 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3fa61-c095-4eb7-a98b-7c04a2d0ee45 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:28.427013 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1324/2644] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:28.431891 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9dcdb-5cc2-499d-9537-47ad643fbb62 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:28.437877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:28.443837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9dcdb-5cc2-499d-9537-47ad643fbb62 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:28.448809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b294d05-bf4a-4b0e-8bb7-643f71d35f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:28.449504 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b294d05-bf4a-4b0e-8bb7-643f71d35f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:28.449790 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b294d05-bf4a-4b0e-8bb7-643f71d35f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:28.450069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b294d05-bf4a-4b0e-8bb7-643f71d35f8c admin admin] PATH_INFO: `/v3/projects/4599922eb1bb4f63a461a633da0959f5/users/7565fc95f2c3481092a645213ee09a85/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:28.452064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b294d05-bf4a-4b0e-8bb7-643f71d35f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4599922eb1bb4f63a461a633da0959f5, user_id=7565fc95f2c3481092a645213ee09a85, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:28.454768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b294d05-bf4a-4b0e-8bb7-643f71d35f8c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:28.465954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1321/2645] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:28 2022] PUT /identity/v3/projects/4599922eb1bb4f63a461a633da0959f5/users/7565fc95f2c3481092a645213ee09a85/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:28.476403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d2acc-69fb-4060-b40d-978c36ada5be None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:28.476756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d2acc-69fb-4060-b40d-978c36ada5be None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:28.476987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d2acc-69fb-4060-b40d-978c36ada5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:28.505078 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ed2d2acc-69fb-4060-b40d-978c36ada5be None None] MFA Rules not processed for user `7565fc95f2c3481092a645213ee09a85`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:28.506455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ed2d2acc-69fb-4060-b40d-978c36ada5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:28.565657 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:28.576815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1325/2646] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:28.588508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b294d05-bf4a-4b0e-8bb7-643f71d35f8c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:28.590654 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0b294d05-bf4a-4b0e-8bb7-643f71d35f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:28.668045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b294d05-bf4a-4b0e-8bb7-643f71d35f8c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:28.672179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc2b8c-8546-4d80-b9e7-3aa0bc511afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:28.672944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc2b8c-8546-4d80-b9e7-3aa0bc511afa service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:28.673529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc2b8c-8546-4d80-b9e7-3aa0bc511afa service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:28.673880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc2b8c-8546-4d80-b9e7-3aa0bc511afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:28.739726 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc2b8c-8546-4d80-b9e7-3aa0bc511afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:28.743684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc2b8c-8546-4d80-b9e7-3aa0bc511afa service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:28.750591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1322/2647] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:28.791333 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006d0f9-4d68-47c6-af33-f53d2ffca69d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:28.792402 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006d0f9-4d68-47c6-af33-f53d2ffca69d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:28.792994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006d0f9-4d68-47c6-af33-f53d2ffca69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:28.814293 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f006d0f9-4d68-47c6-af33-f53d2ffca69d None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:28.815776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f006d0f9-4d68-47c6-af33-f53d2ffca69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:28.880661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1326/2648] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:36:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:29.035772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc2b8c-8546-4d80-b9e7-3aa0bc511afa service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:29.037165 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-96dc2b8c-8546-4d80-b9e7-3aa0bc511afa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:29.115039 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc2b8c-8546-4d80-b9e7-3aa0bc511afa service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:29.120376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2a8ab-3d27-400b-a847-f4c8a09c652f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:29.120982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2a8ab-3d27-400b-a847-f4c8a09c652f service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:29.121296 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2a8ab-3d27-400b-a847-f4c8a09c652f service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:29.121553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2a8ab-3d27-400b-a847-f4c8a09c652f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:29.123111 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006d0f9-4d68-47c6-af33-f53d2ffca69d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:29.125733 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f006d0f9-4d68-47c6-af33-f53d2ffca69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:29.131527 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2a8ab-3d27-400b-a847-f4c8a09c652f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:29.132676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2a8ab-3d27-400b-a847-f4c8a09c652f service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:29.143123 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1323/2649] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:36:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 03:36:29.255920 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006d0f9-4d68-47c6-af33-f53d2ffca69d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:29.261854 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199e8a8-6cbb-4151-a4fd-2a4bf70679e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:29.262470 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199e8a8-6cbb-4151-a4fd-2a4bf70679e7 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:29.262751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199e8a8-6cbb-4151-a4fd-2a4bf70679e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:29.263025 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199e8a8-6cbb-4151-a4fd-2a4bf70679e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:29.267466 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e199e8a8-6cbb-4151-a4fd-2a4bf70679e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:29.282002 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199e8a8-6cbb-4151-a4fd-2a4bf70679e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:29.285288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199e8a8-6cbb-4151-a4fd-2a4bf70679e7 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:29.296964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1327/2650] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:32.307822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2a8ab-3d27-400b-a847-f4c8a09c652f service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:32.318345 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2a8ab-3d27-400b-a847-f4c8a09c652f service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:32.322508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afc8a1-e6a8-4140-9e28-26fb63cc5e39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:32.323242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afc8a1-e6a8-4140-9e28-26fb63cc5e39 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:32.323622 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afc8a1-e6a8-4140-9e28-26fb63cc5e39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:32.323985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afc8a1-e6a8-4140-9e28-26fb63cc5e39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:32.334637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afc8a1-e6a8-4140-9e28-26fb63cc5e39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:32.336262 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afc8a1-e6a8-4140-9e28-26fb63cc5e39 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:32.353009 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1324/2651] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:36:39.292095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=62 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:42.343025 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:44.653099 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199e8a8-6cbb-4151-a4fd-2a4bf70679e7 service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:44.717380 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199e8a8-6cbb-4151-a4fd-2a4bf70679e7 service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:44.721902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620bd1d-9a59-4693-bc55-d2e4ed07f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:44.722600 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620bd1d-9a59-4693-bc55-d2e4ed07f08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:44.722875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620bd1d-9a59-4693-bc55-d2e4ed07f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:44.723144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620bd1d-9a59-4693-bc55-d2e4ed07f08b admin admin] PATH_INFO: `/v3/users/37c8efdc3a684c90a0babebd8ffb9dea` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:44.727819 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620bd1d-9a59-4693-bc55-d2e4ed07f08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c8efdc3a684c90a0babebd8ffb9dea)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:44.727819 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620bd1d-9a59-4693-bc55-d2e4ed07f08b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:44.926477 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f620bd1d-9a59-4693-bc55-d2e4ed07f08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c8efdc3a684c90a0babebd8ffb9dea'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:44.927142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f620bd1d-9a59-4693-bc55-d2e4ed07f08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c8efdc3a684c90a0babebd8ffb9dea'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:44.927742 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f620bd1d-9a59-4693-bc55-d2e4ed07f08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c8efdc3a684c90a0babebd8ffb9dea'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:44.937428 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f620bd1d-9a59-4693-bc55-d2e4ed07f08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c8efdc3a684c90a0babebd8ffb9dea'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:44.945076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c664a-df8a-4c34-830e-25c8b603042b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:44.945628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c664a-df8a-4c34-830e-25c8b603042b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:44.945628 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c664a-df8a-4c34-830e-25c8b603042b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:44.947111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1325/2652] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:36:44.956271 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346004b0-e513-4e7a-807a-e80748985959 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:44.956866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346004b0-e513-4e7a-807a-e80748985959 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:44.957333 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346004b0-e513-4e7a-807a-e80748985959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:44.966866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f620bd1d-9a59-4693-bc55-d2e4ed07f08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c8efdc3a684c90a0babebd8ffb9dea'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:44.983349 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-346004b0-e513-4e7a-807a-e80748985959 None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:44.984733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-346004b0-e513-4e7a-807a-e80748985959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:44.995963 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1326/2653] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:36:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:45.010594 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346004b0-e513-4e7a-807a-e80748985959 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:45.012269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-346004b0-e513-4e7a-807a-e80748985959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:45.051217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1328/2654] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:44 2022] DELETE /identity/v3/users/37c8efdc3a684c90a0babebd8ffb9dea => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:45.056126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b2fcb-ca25-4e21-9f56-f6463b616768 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:45.056410 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b2fcb-ca25-4e21-9f56-f6463b616768 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:45.056816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b2fcb-ca25-4e21-9f56-f6463b616768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:45.069735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346004b0-e513-4e7a-807a-e80748985959 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:45.075491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-748b2fcb-ca25-4e21-9f56-f6463b616768 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:45.076829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-748b2fcb-ca25-4e21-9f56-f6463b616768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:45.145708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6638b48-3b1e-42d8-9619-8ef6a40e3b8b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f746dd2ce4404b679db81794c4d23f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:45.146705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6638b48-3b1e-42d8-9619-8ef6a40e3b8b service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:45.146913 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6638b48-3b1e-42d8-9619-8ef6a40e3b8b service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:45.147321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6638b48-3b1e-42d8-9619-8ef6a40e3b8b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:45.183246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1329/2655] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:45.193465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b2fcb-ca25-4e21-9f56-f6463b616768 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:45.195339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-748b2fcb-ca25-4e21-9f56-f6463b616768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:45.228367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:45.237542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6638b48-3b1e-42d8-9619-8ef6a40e3b8b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:45.240858 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6638b48-3b1e-42d8-9619-8ef6a40e3b8b service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:45.261764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1327/2656] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:45.275048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b2fcb-ca25-4e21-9f56-f6463b616768 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:45.280464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e1348-5883-4c12-9aed-076b5f7d1bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:45.281104 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e1348-5883-4c12-9aed-076b5f7d1bae service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:45.285334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e1348-5883-4c12-9aed-076b5f7d1bae service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:45.285334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e1348-5883-4c12-9aed-076b5f7d1bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:45.292388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e1348-5883-4c12-9aed-076b5f7d1bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:45.294926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e1348-5883-4c12-9aed-076b5f7d1bae service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:45.318448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1330/2657] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:45.511016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e300b6-f744-4365-8f4f-4b790eba94a8 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:45.511304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e300b6-f744-4365-8f4f-4b790eba94a8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:45.511581 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e300b6-f744-4365-8f4f-4b790eba94a8 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:45.512980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1328/2658] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:36:45.518717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27892da-d253-46cd-8a57-4e87afefbca1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:45.519098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27892da-d253-46cd-8a57-4e87afefbca1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:45.519661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27892da-d253-46cd-8a57-4e87afefbca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:45.543464 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f27892da-d253-46cd-8a57-4e87afefbca1 None None] MFA Rules not processed for user `5bb4ef26660244ce90b0105113e252b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:45.544911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f27892da-d253-46cd-8a57-4e87afefbca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:45.553773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1331/2659] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:36:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:45.568604 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e300b6-f744-4365-8f4f-4b790eba94a8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:45.570457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-85e300b6-f744-4365-8f4f-4b790eba94a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:45.584056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e300b6-f744-4365-8f4f-4b790eba94a8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:45.588204 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed296e4f-a964-46a3-888e-843357ce18be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:45.588887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed296e4f-a964-46a3-888e-843357ce18be service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:45.589167 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed296e4f-a964-46a3-888e-843357ce18be service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:45.589557 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed296e4f-a964-46a3-888e-843357ce18be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:45.597511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed296e4f-a964-46a3-888e-843357ce18be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:45.599514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed296e4f-a964-46a3-888e-843357ce18be service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:45.607696 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1329/2660] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:45.719070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba60a48-9d23-450b-8ba4-a8e210f97011 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:45.719560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba60a48-9d23-450b-8ba4-a8e210f97011 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:45.719743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba60a48-9d23-450b-8ba4-a8e210f97011 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:45.721149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1332/2661] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:36:45.726205 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948d38d-bd2b-4952-84b5-e004c1c123ac None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:45.726491 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948d38d-bd2b-4952-84b5-e004c1c123ac None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:45.726766 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948d38d-bd2b-4952-84b5-e004c1c123ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:45.746651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c948d38d-bd2b-4952-84b5-e004c1c123ac None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:45.747791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c948d38d-bd2b-4952-84b5-e004c1c123ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:45.757820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1330/2662] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:36:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:45.768353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba60a48-9d23-450b-8ba4-a8e210f97011 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:45.780075 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba60a48-9d23-450b-8ba4-a8e210f97011 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:45.783728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693ae22-60f2-4614-83f2-3b6d30cd304d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:45.784542 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693ae22-60f2-4614-83f2-3b6d30cd304d service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:45.784788 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693ae22-60f2-4614-83f2-3b6d30cd304d service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:45.785011 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693ae22-60f2-4614-83f2-3b6d30cd304d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:45.795191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693ae22-60f2-4614-83f2-3b6d30cd304d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:45.796694 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693ae22-60f2-4614-83f2-3b6d30cd304d service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:45.810329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1333/2663] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:45.811330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948d38d-bd2b-4952-84b5-e004c1c123ac None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:45.813429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c948d38d-bd2b-4952-84b5-e004c1c123ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:45.827859 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948d38d-bd2b-4952-84b5-e004c1c123ac None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:45.832761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db62f1-e4cd-49e9-b777-39cb25b9a661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:45.833990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db62f1-e4cd-49e9-b777-39cb25b9a661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:45.834269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db62f1-e4cd-49e9-b777-39cb25b9a661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:45.834539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db62f1-e4cd-49e9-b777-39cb25b9a661 admin admin] PATH_INFO: `/v3/projects/7ea63530f9e342bc9d794d77460eb731` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:45.835678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db62f1-e4cd-49e9-b777-39cb25b9a661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea63530f9e342bc9d794d77460eb731)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:45.837891 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db62f1-e4cd-49e9-b777-39cb25b9a661 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:45.948426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:45.966605 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-76db62f1-e4cd-49e9-b777-39cb25b9a661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea63530f9e342bc9d794d77460eb731', 'request_id': 'req-76db62f1-e4cd-49e9-b777-39cb25b9a661'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:45.973088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-76db62f1-e4cd-49e9-b777-39cb25b9a661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea63530f9e342bc9d794d77460eb731', 'request_id': 'req-76db62f1-e4cd-49e9-b777-39cb25b9a661'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:46.045455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-76db62f1-e4cd-49e9-b777-39cb25b9a661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea63530f9e342bc9d794d77460eb731', 'request_id': 'req-76db62f1-e4cd-49e9-b777-39cb25b9a661'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:46.056354 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-76db62f1-e4cd-49e9-b777-39cb25b9a661 admin admin] The token cache is being invalidate because project 7ea63530f9e342bc9d794d77460eb731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:46.056639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-76db62f1-e4cd-49e9-b777-39cb25b9a661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:46.057336 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-76db62f1-e4cd-49e9-b777-39cb25b9a661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:46.059037 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1331/2664] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:45 2022] DELETE /identity/v3/projects/7ea63530f9e342bc9d794d77460eb731 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:46.063890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be2b36-704c-4b6d-bbb1-720018e0ec2f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:46.064173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be2b36-704c-4b6d-bbb1-720018e0ec2f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:46.064442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be2b36-704c-4b6d-bbb1-720018e0ec2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:46.084871 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-80be2b36-704c-4b6d-bbb1-720018e0ec2f None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:46.086126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-80be2b36-704c-4b6d-bbb1-720018e0ec2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:46.153171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1334/2665] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:46.160954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85db12-f64c-498e-b87b-274d50a1b85f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:46.161426 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85db12-f64c-498e-b87b-274d50a1b85f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:46.161852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85db12-f64c-498e-b87b-274d50a1b85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:46.183445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ad85db12-f64c-498e-b87b-274d50a1b85f None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:46.184575 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ad85db12-f64c-498e-b87b-274d50a1b85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:46.193499 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1332/2666] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:46.197531 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be2b36-704c-4b6d-bbb1-720018e0ec2f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:46.207215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be2b36-704c-4b6d-bbb1-720018e0ec2f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:46.212235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252a2e-a71a-481b-a1a1-5b0bdd65376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:46.212888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252a2e-a71a-481b-a1a1-5b0bdd65376e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:46.213165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252a2e-a71a-481b-a1a1-5b0bdd65376e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:46.213465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e252a2e-a71a-481b-a1a1-5b0bdd65376e admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:46.214140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e252a2e-a71a-481b-a1a1-5b0bdd65376e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:36:46.214442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e252a2e-a71a-481b-a1a1-5b0bdd65376e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:46.216074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e252a2e-a71a-481b-a1a1-5b0bdd65376e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:46.228347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1335/2667] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:36:46.232804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85db12-f64c-498e-b87b-274d50a1b85f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:46.243130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85db12-f64c-498e-b87b-274d50a1b85f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:46.248018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920269b1-795f-4948-8613-32e9178cb3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:46.248615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920269b1-795f-4948-8613-32e9178cb3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:46.248884 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920269b1-795f-4948-8613-32e9178cb3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:46.249151 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920269b1-795f-4948-8613-32e9178cb3d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:46.249837 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920269b1-795f-4948-8613-32e9178cb3d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:46.251707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920269b1-795f-4948-8613-32e9178cb3d1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:46.354335 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1333/2668] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:46 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:46.358378 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252a2e-a71a-481b-a1a1-5b0bdd65376e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:46.369021 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e252a2e-a71a-481b-a1a1-5b0bdd65376e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:46.423582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1792a7-2c12-4587-aab0-db4395a1ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:46.424181 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1792a7-2c12-4587-aab0-db4395a1ba0e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:46.424458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1792a7-2c12-4587-aab0-db4395a1ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:46.424729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1792a7-2c12-4587-aab0-db4395a1ba0e admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:46.425395 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1792a7-2c12-4587-aab0-db4395a1ba0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:46.427958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1792a7-2c12-4587-aab0-db4395a1ba0e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:46.490208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1336/2669] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:46 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:46.494412 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920269b1-795f-4948-8613-32e9178cb3d1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:46.504570 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920269b1-795f-4948-8613-32e9178cb3d1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:46.509652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a75a5-96b8-410f-b003-5c2bc341293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:46.510238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a75a5-96b8-410f-b003-5c2bc341293d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:46.510509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a75a5-96b8-410f-b003-5c2bc341293d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:46.510778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a75a5-96b8-410f-b003-5c2bc341293d admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:46.511407 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a75a5-96b8-410f-b003-5c2bc341293d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:46.512964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a75a5-96b8-410f-b003-5c2bc341293d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:46.523511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1334/2670] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:46.527690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1792a7-2c12-4587-aab0-db4395a1ba0e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:46.538431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1792a7-2c12-4587-aab0-db4395a1ba0e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:46.543246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea2e65-f943-4e0c-8923-ba14849ba830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:46.556312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2e65-f943-4e0c-8923-ba14849ba830 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:46.556312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2e65-f943-4e0c-8923-ba14849ba830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:46.556312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea2e65-f943-4e0c-8923-ba14849ba830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:46.556312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea2e65-f943-4e0c-8923-ba14849ba830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:46.556312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea2e65-f943-4e0c-8923-ba14849ba830 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:46.561987 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1337/2671] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:36:46.562918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a75a5-96b8-410f-b003-5c2bc341293d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:46.573552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a75a5-96b8-410f-b003-5c2bc341293d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:46.578484 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a322f-388f-4dbc-a205-69f3bbd6f49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:46.579159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a322f-388f-4dbc-a205-69f3bbd6f49c admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:46.579436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a322f-388f-4dbc-a205-69f3bbd6f49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:46.579755 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a322f-388f-4dbc-a205-69f3bbd6f49c admin admin] PATH_INFO: `/v3/projects/a4365f146ef54b1b90e8ea1742d297c2/users/0faf7491acfa42ada54897410160eeb6/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:46.595555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a322f-388f-4dbc-a205-69f3bbd6f49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4365f146ef54b1b90e8ea1742d297c2, user_id=0faf7491acfa42ada54897410160eeb6, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:46.598310 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a322f-388f-4dbc-a205-69f3bbd6f49c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:46.713509 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1335/2672] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:46 2022] PUT /identity/v3/projects/a4365f146ef54b1b90e8ea1742d297c2/users/0faf7491acfa42ada54897410160eeb6/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:46.718559 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60913-eed5-4b7f-8808-a2733686bbf7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:46.718924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60913-eed5-4b7f-8808-a2733686bbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:46.719109 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60913-eed5-4b7f-8808-a2733686bbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:46.738793 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-65e60913-eed5-4b7f-8808-a2733686bbf7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:46.740507 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-65e60913-eed5-4b7f-8808-a2733686bbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:46.744636 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:46.812115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1338/2673] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:46.823612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a322f-388f-4dbc-a205-69f3bbd6f49c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:46.825573 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-de3a322f-388f-4dbc-a205-69f3bbd6f49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:46.896272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a322f-388f-4dbc-a205-69f3bbd6f49c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:46.900182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de02675-7e00-40d0-baee-e247b55d9839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:46.900780 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de02675-7e00-40d0-baee-e247b55d9839 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:46.901060 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de02675-7e00-40d0-baee-e247b55d9839 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:46.901364 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de02675-7e00-40d0-baee-e247b55d9839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:46.910828 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de02675-7e00-40d0-baee-e247b55d9839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:46.915447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de02675-7e00-40d0-baee-e247b55d9839 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:46.922054 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1336/2674] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:47.867930 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60913-eed5-4b7f-8808-a2733686bbf7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:47.869448 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-65e60913-eed5-4b7f-8808-a2733686bbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:47.883422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60913-eed5-4b7f-8808-a2733686bbf7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:47.888277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:47.888898 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:47.892915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:47.892915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] PATH_INFO: `/v3/users/971cc79cc04f4d87bbf41671db465a1b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:47.892915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=971cc79cc04f4d87bbf41671db465a1b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:47.892915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:48.098072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971cc79cc04f4d87bbf41671db465a1b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:48.098738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971cc79cc04f4d87bbf41671db465a1b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:48.099334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971cc79cc04f4d87bbf41671db465a1b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:48.106353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971cc79cc04f4d87bbf41671db465a1b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:48.118750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971cc79cc04f4d87bbf41671db465a1b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:48.175017 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1339/2675] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:47 2022] DELETE /identity/v3/users/971cc79cc04f4d87bbf41671db465a1b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:48.179567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e66d5-0c6f-40b2-9745-d1ae6e5fbb7e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:48.180023 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e66d5-0c6f-40b2-9745-d1ae6e5fbb7e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:48.180150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e66d5-0c6f-40b2-9745-d1ae6e5fbb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:48.198642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-003e66d5-0c6f-40b2-9745-d1ae6e5fbb7e None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:48.199825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-003e66d5-0c6f-40b2-9745-d1ae6e5fbb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:48.250529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:48.262591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1337/2676] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:48.275732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:48.277444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:48.303738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962d5f8-dfc8-475d-84e8-376394b6977e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:48.304083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962d5f8-dfc8-475d-84e8-376394b6977e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:48.304357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962d5f8-dfc8-475d-84e8-376394b6977e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:48.334692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f962d5f8-dfc8-475d-84e8-376394b6977e None None] MFA Rules not processed for user `0faf7491acfa42ada54897410160eeb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:48.335892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f962d5f8-dfc8-475d-84e8-376394b6977e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:48.365570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bf4d7-7917-4dc3-b4bb-140f8b416c1f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:48.370723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd1cd1-0970-4b55-8b73-fbc226ca4aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:48.371407 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd1cd1-0970-4b55-8b73-fbc226ca4aba service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:48.371795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd1cd1-0970-4b55-8b73-fbc226ca4aba service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:48.372591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd1cd1-0970-4b55-8b73-fbc226ca4aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:48.383696 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd1cd1-0970-4b55-8b73-fbc226ca4aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:48.385402 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd1cd1-0970-4b55-8b73-fbc226ca4aba service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:48.397550 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1340/2677] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:48.451684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1338/2678] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:48.464138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd1cd1-0970-4b55-8b73-fbc226ca4aba service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:48.465717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c1cd1cd1-0970-4b55-8b73-fbc226ca4aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:48.518726 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:48.559235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd1cd1-0970-4b55-8b73-fbc226ca4aba service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:48.563451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d80fb-1010-4d19-b348-a7ffd77dfaac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:48.564167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d80fb-1010-4d19-b348-a7ffd77dfaac service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:48.564559 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d80fb-1010-4d19-b348-a7ffd77dfaac service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:48.564885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d80fb-1010-4d19-b348-a7ffd77dfaac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:48.576754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d80fb-1010-4d19-b348-a7ffd77dfaac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:48.578704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d80fb-1010-4d19-b348-a7ffd77dfaac service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:48.600086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1341/2679] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:48.844600 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962d5f8-dfc8-475d-84e8-376394b6977e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:48.846130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f962d5f8-dfc8-475d-84e8-376394b6977e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:48.875595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962d5f8-dfc8-475d-84e8-376394b6977e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:48.879512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd4074-ea58-498e-8feb-98413df1a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:48.880903 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd4074-ea58-498e-8feb-98413df1a110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:48.881112 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd4074-ea58-498e-8feb-98413df1a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:48.881422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd4074-ea58-498e-8feb-98413df1a110 admin admin] PATH_INFO: `/v3/projects/ac259816f8a143dfb1f2823e70de21e5` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:48.882765 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd4074-ea58-498e-8feb-98413df1a110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac259816f8a143dfb1f2823e70de21e5)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:48.884765 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd4074-ea58-498e-8feb-98413df1a110 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:49.000707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-42dd4074-ea58-498e-8feb-98413df1a110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac259816f8a143dfb1f2823e70de21e5', 'request_id': 'req-42dd4074-ea58-498e-8feb-98413df1a110'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:49.007699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-42dd4074-ea58-498e-8feb-98413df1a110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac259816f8a143dfb1f2823e70de21e5', 'request_id': 'req-42dd4074-ea58-498e-8feb-98413df1a110'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:49.117797 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-42dd4074-ea58-498e-8feb-98413df1a110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac259816f8a143dfb1f2823e70de21e5', 'request_id': 'req-42dd4074-ea58-498e-8feb-98413df1a110'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:49.128657 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-42dd4074-ea58-498e-8feb-98413df1a110 admin admin] The token cache is being invalidate because project ac259816f8a143dfb1f2823e70de21e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:49.128951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-42dd4074-ea58-498e-8feb-98413df1a110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:49.129643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-42dd4074-ea58-498e-8feb-98413df1a110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:49.131066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1339/2680] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:48 2022] DELETE /identity/v3/projects/ac259816f8a143dfb1f2823e70de21e5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:49.135180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d80fb-1010-4d19-b348-a7ffd77dfaac service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:49.147772 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d80fb-1010-4d19-b348-a7ffd77dfaac service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:49.208796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:49.209451 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:49.209737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:49.213827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] PATH_INFO: `/v3/users/7565fc95f2c3481092a645213ee09a85` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:49.213827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7565fc95f2c3481092a645213ee09a85)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:49.213827 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:49.322236 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babec40-1dff-4851-88ba-62a9a20c2c60 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:49.323111 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babec40-1dff-4851-88ba-62a9a20c2c60 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:49.323389 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babec40-1dff-4851-88ba-62a9a20c2c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:49.344863 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2babec40-1dff-4851-88ba-62a9a20c2c60 None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:49.346140 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2babec40-1dff-4851-88ba-62a9a20c2c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:49.406529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1340/2681] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:36:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:49.413320 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7565fc95f2c3481092a645213ee09a85'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:49.414071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7565fc95f2c3481092a645213ee09a85'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:49.414667 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7565fc95f2c3481092a645213ee09a85'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:49.419049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babec40-1dff-4851-88ba-62a9a20c2c60 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:49.420982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2babec40-1dff-4851-88ba-62a9a20c2c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:49.422095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7565fc95f2c3481092a645213ee09a85'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:49.434666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7565fc95f2c3481092a645213ee09a85'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:49.437908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:49.492538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babec40-1dff-4851-88ba-62a9a20c2c60 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:49.497713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e212e-a0ac-4270-bd05-f9f98e97f531 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:49.498317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e212e-a0ac-4270-bd05-f9f98e97f531 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:49.498622 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e212e-a0ac-4270-bd05-f9f98e97f531 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:49.498920 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e212e-a0ac-4270-bd05-f9f98e97f531 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:49.500744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7e7e212e-a0ac-4270-bd05-f9f98e97f531 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:49.512317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e212e-a0ac-4270-bd05-f9f98e97f531 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:49.513083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1342/2682] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:49 2022] DELETE /identity/v3/users/7565fc95f2c3481092a645213ee09a85 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:49.514297 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e212e-a0ac-4270-bd05-f9f98e97f531 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:49.523311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1341/2683] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:36:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 03:36:50.098080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:50.100090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:50.157868 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:50.176003 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480409a0-d54d-426f-9034-db8248e64ad5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:50.182292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:50.183639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:50.184414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:50.184978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac admin admin] PATH_INFO: `/v3/projects/4599922eb1bb4f63a461a633da0959f5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:50.186985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4599922eb1bb4f63a461a633da0959f5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:50.189804 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:50.287585 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4599922eb1bb4f63a461a633da0959f5', 'request_id': 'req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:50.294828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4599922eb1bb4f63a461a633da0959f5', 'request_id': 'req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:50.353367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4599922eb1bb4f63a461a633da0959f5', 'request_id': 'req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:50.369907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac admin admin] The token cache is being invalidate because project 4599922eb1bb4f63a461a633da0959f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:50.370237 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:50.370879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d6f3a803-6fc3-4bb1-bf25-41c4c1a09cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:50.373157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1343/2684] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:50 2022] DELETE /identity/v3/projects/4599922eb1bb4f63a461a633da0959f5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:50.377901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aacf40-d827-4f78-92d2-cc8785fb26b0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:50.378399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aacf40-d827-4f78-92d2-cc8785fb26b0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:50.378485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aacf40-d827-4f78-92d2-cc8785fb26b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:50.410052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d5aacf40-d827-4f78-92d2-cc8785fb26b0 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:50.412350 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d5aacf40-d827-4f78-92d2-cc8785fb26b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:50.477130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65516f97-1d39-4d8d-9403-17789c7ca962 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:50.477524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65516f97-1d39-4d8d-9403-17789c7ca962 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:50.477718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65516f97-1d39-4d8d-9403-17789c7ca962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:50.491699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1342/2685] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:50.500578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71e570-a4f3-4009-b333-ae9d4ddc7009 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:50.500905 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71e570-a4f3-4009-b333-ae9d4ddc7009 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:50.501134 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71e570-a4f3-4009-b333-ae9d4ddc7009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:50.501291 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-65516f97-1d39-4d8d-9403-17789c7ca962 None None] MFA Rules not processed for user `0faf7491acfa42ada54897410160eeb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:50.502434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-65516f97-1d39-4d8d-9403-17789c7ca962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:50.528032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9f71e570-a4f3-4009-b333-ae9d4ddc7009 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:50.529730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9f71e570-a4f3-4009-b333-ae9d4ddc7009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:50.539789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1343/2686] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:50.544343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71e570-a4f3-4009-b333-ae9d4ddc7009 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:50.554490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71e570-a4f3-4009-b333-ae9d4ddc7009 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:50.564585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391763a-ae5e-4eb1-acaa-934013b1ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:50.565209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391763a-ae5e-4eb1-acaa-934013b1ed1f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:50.565521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391763a-ae5e-4eb1-acaa-934013b1ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:50.565795 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391763a-ae5e-4eb1-acaa-934013b1ed1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:50.566477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391763a-ae5e-4eb1-acaa-934013b1ed1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:36:50.566782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391763a-ae5e-4eb1-acaa-934013b1ed1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:50.568503 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391763a-ae5e-4eb1-acaa-934013b1ed1f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:50.583294 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1344/2687] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:36:50.591064 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391763a-ae5e-4eb1-acaa-934013b1ed1f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:50.613709 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391763a-ae5e-4eb1-acaa-934013b1ed1f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:50.618700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1beef-db42-44af-9cce-7cec799e0600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:50.619306 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1beef-db42-44af-9cce-7cec799e0600 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:50.619585 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1beef-db42-44af-9cce-7cec799e0600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:50.619885 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1beef-db42-44af-9cce-7cec799e0600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:50.620542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1beef-db42-44af-9cce-7cec799e0600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:50.622486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1beef-db42-44af-9cce-7cec799e0600 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:50.623444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1344/2688] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:36:50.705673 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1345/2689] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:50 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:50.709454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65516f97-1d39-4d8d-9403-17789c7ca962 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:50.721670 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65516f97-1d39-4d8d-9403-17789c7ca962 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:50.823267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e71f4-7819-4ba4-a2fd-3fcb207483d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:50.824137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e71f4-7819-4ba4-a2fd-3fcb207483d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:50.824572 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e71f4-7819-4ba4-a2fd-3fcb207483d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:50.825015 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e71f4-7819-4ba4-a2fd-3fcb207483d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:50.825838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e71f4-7819-4ba4-a2fd-3fcb207483d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:50.827942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e71f4-7819-4ba4-a2fd-3fcb207483d9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:50.902737 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1beef-db42-44af-9cce-7cec799e0600 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:50.904949 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1af1beef-db42-44af-9cce-7cec799e0600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:50.907850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1345/2690] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:50 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:50.912243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e71f4-7819-4ba4-a2fd-3fcb207483d9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:50.923465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e71f4-7819-4ba4-a2fd-3fcb207483d9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:50.928305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45ee3d-d9cf-48c5-ac85-6d5451a7eb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:50.928936 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45ee3d-d9cf-48c5-ac85-6d5451a7eb39 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:50.929212 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45ee3d-d9cf-48c5-ac85-6d5451a7eb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:50.929514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45ee3d-d9cf-48c5-ac85-6d5451a7eb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:50.930157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45ee3d-d9cf-48c5-ac85-6d5451a7eb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:50.931931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45ee3d-d9cf-48c5-ac85-6d5451a7eb39 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:50.949216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:50.949816 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1346/2691] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:50.950869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45ee3d-d9cf-48c5-ac85-6d5451a7eb39 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:50.969686 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45ee3d-d9cf-48c5-ac85-6d5451a7eb39 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:50.978264 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2f674-a4a9-45e6-b75e-43b81e7379e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:50.981965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2f674-a4a9-45e6-b75e-43b81e7379e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:50.981965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2f674-a4a9-45e6-b75e-43b81e7379e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:50.981965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2f674-a4a9-45e6-b75e-43b81e7379e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:50.981965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2f674-a4a9-45e6-b75e-43b81e7379e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:50.982526 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1beef-db42-44af-9cce-7cec799e0600 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:50.982630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2f674-a4a9-45e6-b75e-43b81e7379e1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:50.986490 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb326b-97c9-4429-a17f-2b9456521413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:50.987429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb326b-97c9-4429-a17f-2b9456521413 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:50.987781 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb326b-97c9-4429-a17f-2b9456521413 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:50.988316 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb326b-97c9-4429-a17f-2b9456521413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:50.990564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-08cb326b-97c9-4429-a17f-2b9456521413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:51.000392 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1347/2692] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:51.001722 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb326b-97c9-4429-a17f-2b9456521413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:51.003671 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb326b-97c9-4429-a17f-2b9456521413 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:51.004332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2f674-a4a9-45e6-b75e-43b81e7379e1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:51.017323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2f674-a4a9-45e6-b75e-43b81e7379e1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:51.019881 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1346/2693] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:36:51.023740 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d17da-9050-490e-92da-06ff6c3c1649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:51.024460 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d17da-9050-490e-92da-06ff6c3c1649 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:51.024811 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d17da-9050-490e-92da-06ff6c3c1649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:51.025182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d17da-9050-490e-92da-06ff6c3c1649 admin admin] PATH_INFO: `/v3/projects/19251b66b4dc46d6a17d012e6b7b93e2/users/ac418494c2044adaaa24b0b544c73698/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:51.042204 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d17da-9050-490e-92da-06ff6c3c1649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19251b66b4dc46d6a17d012e6b7b93e2, user_id=ac418494c2044adaaa24b0b544c73698, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:51.045985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d17da-9050-490e-92da-06ff6c3c1649 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:51.101539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1348/2694] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:51 2022] PUT /identity/v3/projects/19251b66b4dc46d6a17d012e6b7b93e2/users/ac418494c2044adaaa24b0b544c73698/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:51.108582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c362f-5836-4288-998f-33364aa0baa0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:51.108954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c362f-5836-4288-998f-33364aa0baa0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:51.109330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c362f-5836-4288-998f-33364aa0baa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:51.118000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:51.172562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b61c362f-5836-4288-998f-33364aa0baa0 None None] MFA Rules not processed for user `ac418494c2044adaaa24b0b544c73698`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:51.177740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b61c362f-5836-4288-998f-33364aa0baa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:51.309984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1347/2695] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:51.318565 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d17da-9050-490e-92da-06ff6c3c1649 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:51.403828 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d17da-9050-490e-92da-06ff6c3c1649 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:51.409728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54613ae0-8a00-4661-a1e8-9db2b636278f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:51.410347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54613ae0-8a00-4661-a1e8-9db2b636278f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:51.410630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54613ae0-8a00-4661-a1e8-9db2b636278f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:51.410904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54613ae0-8a00-4661-a1e8-9db2b636278f admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:51.411615 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54613ae0-8a00-4661-a1e8-9db2b636278f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:51.413591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54613ae0-8a00-4661-a1e8-9db2b636278f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:51.515246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1349/2696] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:51 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:36:51.523478 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c362f-5836-4288-998f-33364aa0baa0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:51.542071 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c362f-5836-4288-998f-33364aa0baa0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:51.693486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da1dee-182b-4fbf-ae5c-afd477f932e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:51.694160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da1dee-182b-4fbf-ae5c-afd477f932e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:51.694450 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da1dee-182b-4fbf-ae5c-afd477f932e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:51.694727 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da1dee-182b-4fbf-ae5c-afd477f932e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:51.695367 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da1dee-182b-4fbf-ae5c-afd477f932e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:51.697430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da1dee-182b-4fbf-ae5c-afd477f932e1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:51.822265 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1348/2697] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:51 2022] POST /identity/v3/users => generated 290 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:51.826132 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54613ae0-8a00-4661-a1e8-9db2b636278f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:51.838176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54613ae0-8a00-4661-a1e8-9db2b636278f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:51.843876 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e111393-4384-4e0e-8e1f-b0b573ce28b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:51.844545 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e111393-4384-4e0e-8e1f-b0b573ce28b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:51.844823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e111393-4384-4e0e-8e1f-b0b573ce28b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:51.845089 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e111393-4384-4e0e-8e1f-b0b573ce28b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:51.845835 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e111393-4384-4e0e-8e1f-b0b573ce28b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:51.847455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e111393-4384-4e0e-8e1f-b0b573ce28b2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:51.859429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1350/2698] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:36:51.863523 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da1dee-182b-4fbf-ae5c-afd477f932e1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:51.873996 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da1dee-182b-4fbf-ae5c-afd477f932e1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:51.879040 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c6067-e53e-4e71-90b1-31b8aa66ec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:51.879647 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6067-e53e-4e71-90b1-31b8aa66ec64 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:51.879929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6067-e53e-4e71-90b1-31b8aa66ec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:51.880205 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6067-e53e-4e71-90b1-31b8aa66ec64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:51.880874 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c6067-e53e-4e71-90b1-31b8aa66ec64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:51.882577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c6067-e53e-4e71-90b1-31b8aa66ec64 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:51.895680 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1349/2699] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:51.900004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e111393-4384-4e0e-8e1f-b0b573ce28b2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:51.911449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e111393-4384-4e0e-8e1f-b0b573ce28b2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:51.916992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516021b-5fff-4e14-8d27-484f72f04970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:51.917775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516021b-5fff-4e14-8d27-484f72f04970 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:51.918124 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516021b-5fff-4e14-8d27-484f72f04970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:51.918469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516021b-5fff-4e14-8d27-484f72f04970 admin admin] PATH_INFO: `/v3/projects/fdc8bf6a37bf4d2bb8d2b52d0190a35e/users/17c9708556594967b04aaa0a0df43075/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:51.937002 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516021b-5fff-4e14-8d27-484f72f04970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc8bf6a37bf4d2bb8d2b52d0190a35e, user_id=17c9708556594967b04aaa0a0df43075, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:51.940429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516021b-5fff-4e14-8d27-484f72f04970 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:52.011639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1351/2700] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:51 2022] PUT /identity/v3/projects/fdc8bf6a37bf4d2bb8d2b52d0190a35e/users/17c9708556594967b04aaa0a0df43075/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:36:52.022486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c42f4-3213-46f6-8cfe-6ef703a734ef None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:52.022779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c42f4-3213-46f6-8cfe-6ef703a734ef None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:52.023057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c42f4-3213-46f6-8cfe-6ef703a734ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:52.057545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-643c42f4-3213-46f6-8cfe-6ef703a734ef None None] MFA Rules not processed for user `17c9708556594967b04aaa0a0df43075`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:52.058818 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-643c42f4-3213-46f6-8cfe-6ef703a734ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:52.164693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:52.172130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1350/2701] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:52.173824 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516021b-5fff-4e14-8d27-484f72f04970 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:52.245675 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516021b-5fff-4e14-8d27-484f72f04970 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:52.253785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b24a3-416d-4d5a-9f42-413ddef146c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:52.254591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b24a3-416d-4d5a-9f42-413ddef146c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:52.254931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b24a3-416d-4d5a-9f42-413ddef146c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:52.256022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b24a3-416d-4d5a-9f42-413ddef146c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:52.256531 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b24a3-416d-4d5a-9f42-413ddef146c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:52.258577 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b24a3-416d-4d5a-9f42-413ddef146c1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:52.344554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:52.355769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1352/2702] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:36:52 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:52.357031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c42f4-3213-46f6-8cfe-6ef703a734ef None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:52.369974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c42f4-3213-46f6-8cfe-6ef703a734ef None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:52.454943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0311ab-0f2d-4c1c-86f7-bdc7b75305d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:52.455830 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0311ab-0f2d-4c1c-86f7-bdc7b75305d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:52.456280 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0311ab-0f2d-4c1c-86f7-bdc7b75305d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:52.456738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0311ab-0f2d-4c1c-86f7-bdc7b75305d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:52.457566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0311ab-0f2d-4c1c-86f7-bdc7b75305d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:52.460414 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0311ab-0f2d-4c1c-86f7-bdc7b75305d3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:52.577047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1351/2703] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:36:52 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:36:52.589994 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b24a3-416d-4d5a-9f42-413ddef146c1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:52.601205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b24a3-416d-4d5a-9f42-413ddef146c1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:52.607128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39122def-13ca-4502-abe0-ffa29c8cfd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:52.607751 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122def-13ca-4502-abe0-ffa29c8cfd66 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:52.608027 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122def-13ca-4502-abe0-ffa29c8cfd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:52.608355 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122def-13ca-4502-abe0-ffa29c8cfd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:52.609136 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39122def-13ca-4502-abe0-ffa29c8cfd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:52.611018 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39122def-13ca-4502-abe0-ffa29c8cfd66 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:52.627292 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1353/2704] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:52.628493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0311ab-0f2d-4c1c-86f7-bdc7b75305d3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:52.640861 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0311ab-0f2d-4c1c-86f7-bdc7b75305d3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:52.646106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541579bc-4900-4c53-830e-95f9f3cd4c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:52.646759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541579bc-4900-4c53-830e-95f9f3cd4c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:52.647035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541579bc-4900-4c53-830e-95f9f3cd4c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:52.647329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541579bc-4900-4c53-830e-95f9f3cd4c44 admin admin] PATH_INFO: `/v3/projects/9a19334e579246a0ac2cc6e6dce6a84b/users/8b2c75f06a744c049697b3711fa7ffee/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:52.666712 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541579bc-4900-4c53-830e-95f9f3cd4c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a19334e579246a0ac2cc6e6dce6a84b, user_id=8b2c75f06a744c049697b3711fa7ffee, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:52.670438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541579bc-4900-4c53-830e-95f9f3cd4c44 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:52.760340 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1352/2705] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:52 2022] PUT /identity/v3/projects/9a19334e579246a0ac2cc6e6dce6a84b/users/8b2c75f06a744c049697b3711fa7ffee/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:52.768782 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39122def-13ca-4502-abe0-ffa29c8cfd66 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:52.780777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39122def-13ca-4502-abe0-ffa29c8cfd66 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:52.841030 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bead8-669c-4873-af74-7dfaeb423659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:52.841671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bead8-669c-4873-af74-7dfaeb423659 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:52.841944 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bead8-669c-4873-af74-7dfaeb423659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:52.842215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bead8-669c-4873-af74-7dfaeb423659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:52.842858 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bead8-669c-4873-af74-7dfaeb423659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:52.844981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bead8-669c-4873-af74-7dfaeb423659 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:52.856378 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1354/2706] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:36:52.861349 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541579bc-4900-4c53-830e-95f9f3cd4c44 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:52.873193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541579bc-4900-4c53-830e-95f9f3cd4c44 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:52.878045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381b052-75e5-44f4-9e8f-464d45e5ce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:52.878711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381b052-75e5-44f4-9e8f-464d45e5ce10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:52.878983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381b052-75e5-44f4-9e8f-464d45e5ce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:52.879248 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381b052-75e5-44f4-9e8f-464d45e5ce10 admin admin] PATH_INFO: `/v3/projects/9a19334e579246a0ac2cc6e6dce6a84b/users/8b2c75f06a744c049697b3711fa7ffee/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:52.881772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381b052-75e5-44f4-9e8f-464d45e5ce10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a19334e579246a0ac2cc6e6dce6a84b, user_id=8b2c75f06a744c049697b3711fa7ffee, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:52.884464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381b052-75e5-44f4-9e8f-464d45e5ce10 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:52.895685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1353/2707] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:36:52 2022] PUT /identity/v3/projects/9a19334e579246a0ac2cc6e6dce6a84b/users/8b2c75f06a744c049697b3711fa7ffee/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:52.965947 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289f67-e436-464e-97ac-f91b6613208b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:52.966357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289f67-e436-464e-97ac-f91b6613208b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:52.966709 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289f67-e436-464e-97ac-f91b6613208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:52.997590 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-88289f67-e436-464e-97ac-f91b6613208b None None] MFA Rules not processed for user `8b2c75f06a744c049697b3711fa7ffee`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:52.998730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-88289f67-e436-464e-97ac-f91b6613208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:53.082004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1355/2708] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:53.089852 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381b052-75e5-44f4-9e8f-464d45e5ce10 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:53.091555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6381b052-75e5-44f4-9e8f-464d45e5ce10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:53.159207 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381b052-75e5-44f4-9e8f-464d45e5ce10 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:53.163720 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59202e-67ed-4e05-aeca-7fbd19a9a9b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:53.164334 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59202e-67ed-4e05-aeca-7fbd19a9a9b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:53.164615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59202e-67ed-4e05-aeca-7fbd19a9a9b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:53.164888 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59202e-67ed-4e05-aeca-7fbd19a9a9b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:53.175566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59202e-67ed-4e05-aeca-7fbd19a9a9b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:53.177031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59202e-67ed-4e05-aeca-7fbd19a9a9b9 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:53.187951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1354/2709] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:53.285444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88289f67-e436-464e-97ac-f91b6613208b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:53.287517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-88289f67-e436-464e-97ac-f91b6613208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:53.301198 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88289f67-e436-464e-97ac-f91b6613208b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:53.305682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc3d5c-a900-4bab-be8e-65cc230060eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:53.306350 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc3d5c-a900-4bab-be8e-65cc230060eb service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:53.306566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc3d5c-a900-4bab-be8e-65cc230060eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:53.306838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc3d5c-a900-4bab-be8e-65cc230060eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:53.368682 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc3d5c-a900-4bab-be8e-65cc230060eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:53.379449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc3d5c-a900-4bab-be8e-65cc230060eb service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:53.385446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1356/2710] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:58.481607 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59202e-67ed-4e05-aeca-7fbd19a9a9b9 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:58.537550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:58.542943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59202e-67ed-4e05-aeca-7fbd19a9a9b9 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:58.547468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:58.548091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:58.548366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:58.548638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] PATH_INFO: `/v3/users/ac418494c2044adaaa24b0b544c73698` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:58.549782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac418494c2044adaaa24b0b544c73698)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:58.551676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:58.776918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac418494c2044adaaa24b0b544c73698'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:58.843684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac418494c2044adaaa24b0b544c73698'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:58.844311 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac418494c2044adaaa24b0b544c73698'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:58.844928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac418494c2044adaaa24b0b544c73698'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:58.854379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac418494c2044adaaa24b0b544c73698'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:58.870562 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1355/2711] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:58 2022] DELETE /identity/v3/users/ac418494c2044adaaa24b0b544c73698 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:58.875044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74424237-7f2e-42c0-b25d-945e2203339c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:58.875560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74424237-7f2e-42c0-b25d-945e2203339c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:58.875678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74424237-7f2e-42c0-b25d-945e2203339c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:58.894880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-74424237-7f2e-42c0-b25d-945e2203339c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:36:58.896093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-74424237-7f2e-42c0-b25d-945e2203339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:58.900126 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:58.952770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1357/2712] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:36:58.962660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:58.964162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:59.020682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff44687-a960-43b6-b18a-7628d2a4ae4f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:59.024246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d23a3-8eff-4354-9fbf-3e2ec7ba62fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:59.024834 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d23a3-8eff-4354-9fbf-3e2ec7ba62fb service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:59.025107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d23a3-8eff-4354-9fbf-3e2ec7ba62fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:59.025398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d23a3-8eff-4354-9fbf-3e2ec7ba62fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:59.034176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d23a3-8eff-4354-9fbf-3e2ec7ba62fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:59.035597 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d23a3-8eff-4354-9fbf-3e2ec7ba62fb service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:59.045235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1356/2713] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:36:59.475618 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74424237-7f2e-42c0-b25d-945e2203339c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:59.477248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-74424237-7f2e-42c0-b25d-945e2203339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:36:59.489713 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74424237-7f2e-42c0-b25d-945e2203339c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:59.498389 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:59.499444 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:59.504806 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:59.510000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] PATH_INFO: `/v3/projects/19251b66b4dc46d6a17d012e6b7b93e2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:59.522457 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] RBAC: Authorizing `identity:delete_project(project_id=19251b66b4dc46d6a17d012e6b7b93e2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:59.524163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:59.656224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19251b66b4dc46d6a17d012e6b7b93e2', 'request_id': 'req-97d02fff-51df-4414-979e-f96dda9b987d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:59.662973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19251b66b4dc46d6a17d012e6b7b93e2', 'request_id': 'req-97d02fff-51df-4414-979e-f96dda9b987d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:59.712472 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19251b66b4dc46d6a17d012e6b7b93e2', 'request_id': 'req-97d02fff-51df-4414-979e-f96dda9b987d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:59.724341 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] The token cache is being invalidate because project 19251b66b4dc46d6a17d012e6b7b93e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:36:59.726050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:59.726050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:36:59.727204 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1358/2714] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:36:59 2022] DELETE /identity/v3/projects/19251b66b4dc46d6a17d012e6b7b93e2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:36:59.730955 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d23a3-8eff-4354-9fbf-3e2ec7ba62fb service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:36:59.741280 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d23a3-8eff-4354-9fbf-3e2ec7ba62fb service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:36:59.801931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:36:59.806782 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:36:59.807501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:36:59.807501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] PATH_INFO: `/v3/users/17c9708556594967b04aaa0a0df43075` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:36:59.808636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c9708556594967b04aaa0a0df43075)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:36:59.810901 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:36:59.837925 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:36:59.980508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c9708556594967b04aaa0a0df43075'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:00.020917 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c9708556594967b04aaa0a0df43075'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:00.022123 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c9708556594967b04aaa0a0df43075'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:00.022729 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c9708556594967b04aaa0a0df43075'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:00.031513 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c9708556594967b04aaa0a0df43075'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:00.049159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1357/2715] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:36:59 2022] DELETE /identity/v3/users/17c9708556594967b04aaa0a0df43075 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:00.666188 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:00.666188 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:00.689728 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02fff-51df-4414-979e-f96dda9b987d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:00.747114 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:00.752435 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:00.752435 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:00.752435 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] PATH_INFO: `/v3/projects/fdc8bf6a37bf4d2bb8d2b52d0190a35e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:00.752435 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc8bf6a37bf4d2bb8d2b52d0190a35e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:00.752435 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:00.885802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:00.894974 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc8bf6a37bf4d2bb8d2b52d0190a35e', 'request_id': 'req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:00.901783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc8bf6a37bf4d2bb8d2b52d0190a35e', 'request_id': 'req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:01.026791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc8bf6a37bf4d2bb8d2b52d0190a35e', 'request_id': 'req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:01.039131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] The token cache is being invalidate because project fdc8bf6a37bf4d2bb8d2b52d0190a35e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:37:01.044414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:01.044414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:01.044414 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1359/2716] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:37:00 2022] DELETE /identity/v3/projects/fdc8bf6a37bf4d2bb8d2b52d0190a35e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:01.046541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:01.048011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:01.061499 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32ec3b-6626-489b-baeb-e37ce6e6f7f5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:01.123049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f530da-77f5-476d-9b94-48f80559ee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:01.123979 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f530da-77f5-476d-9b94-48f80559ee26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:01.124370 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f530da-77f5-476d-9b94-48f80559ee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:01.124735 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f530da-77f5-476d-9b94-48f80559ee26 admin admin] PATH_INFO: `/v3/users/8b2c75f06a744c049697b3711fa7ffee` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:01.134146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f530da-77f5-476d-9b94-48f80559ee26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2c75f06a744c049697b3711fa7ffee)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:01.141225 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f530da-77f5-476d-9b94-48f80559ee26 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:01.329726 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-56f530da-77f5-476d-9b94-48f80559ee26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2c75f06a744c049697b3711fa7ffee'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:01.380769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-56f530da-77f5-476d-9b94-48f80559ee26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2c75f06a744c049697b3711fa7ffee'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:01.381440 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-56f530da-77f5-476d-9b94-48f80559ee26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2c75f06a744c049697b3711fa7ffee'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:01.382061 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-56f530da-77f5-476d-9b94-48f80559ee26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2c75f06a744c049697b3711fa7ffee'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:01.389700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-56f530da-77f5-476d-9b94-48f80559ee26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2c75f06a744c049697b3711fa7ffee'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:01.410846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1358/2717] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:37:01 2022] DELETE /identity/v3/users/8b2c75f06a744c049697b3711fa7ffee => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:01.852242 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:01.853773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:01.868300 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9bd8b-b787-4bed-ac4e-d59f5c2f55b9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:01.941582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:01.942120 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:01.942402 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:01.943541 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f admin admin] PATH_INFO: `/v3/projects/9a19334e579246a0ac2cc6e6dce6a84b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:01.944484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a19334e579246a0ac2cc6e6dce6a84b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:01.946481 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:02.063363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a19334e579246a0ac2cc6e6dce6a84b', 'request_id': 'req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:02.069896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a19334e579246a0ac2cc6e6dce6a84b', 'request_id': 'req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:02.118391 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a19334e579246a0ac2cc6e6dce6a84b', 'request_id': 'req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:02.129988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f admin admin] The token cache is being invalidate because project 9a19334e579246a0ac2cc6e6dce6a84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:37:02.130771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:02.131467 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-04a232c9-db17-4055-bf1b-c3bfbb7e1a2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:02.132964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1360/2718] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:37:01 2022] DELETE /identity/v3/projects/9a19334e579246a0ac2cc6e6dce6a84b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:02.138918 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a75e69-c7a2-4570-842e-a96ec5f47db0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:02.142521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a75e69-c7a2-4570-842e-a96ec5f47db0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:02.142521 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a75e69-c7a2-4570-842e-a96ec5f47db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:02.164984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-47a75e69-c7a2-4570-842e-a96ec5f47db0 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:02.166255 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-47a75e69-c7a2-4570-842e-a96ec5f47db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:02.179957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:02.237615 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1359/2719] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:02.239840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0b62-53c0-4354-875e-9974eb0c1b91 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:02.240300 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0b62-53c0-4354-875e-9974eb0c1b91 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:02.240579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f0b62-53c0-4354-875e-9974eb0c1b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:02.262301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7d5f0b62-53c0-4354-875e-9974eb0c1b91 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:02.263539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7d5f0b62-53c0-4354-875e-9974eb0c1b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:02.272243 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1361/2720] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:02.281821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a75e69-c7a2-4570-842e-a96ec5f47db0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:02.292309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a75e69-c7a2-4570-842e-a96ec5f47db0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:02.298215 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5857417-0add-47fe-a0b7-25c835da2220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:02.301952 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5857417-0add-47fe-a0b7-25c835da2220 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:02.301952 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5857417-0add-47fe-a0b7-25c835da2220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:02.301952 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5857417-0add-47fe-a0b7-25c835da2220 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:02.301952 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5857417-0add-47fe-a0b7-25c835da2220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:37:02.301952 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5857417-0add-47fe-a0b7-25c835da2220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:02.301952 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5857417-0add-47fe-a0b7-25c835da2220 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:02.314629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1360/2721] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 03:37:02.319577 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f0b62-53c0-4354-875e-9974eb0c1b91 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:02.329275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f0b62-53c0-4354-875e-9974eb0c1b91 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:02.334641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d072f-4c27-41f5-a7f3-f60eb71f2d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:02.335255 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d072f-4c27-41f5-a7f3-f60eb71f2d1b admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:02.335531 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d072f-4c27-41f5-a7f3-f60eb71f2d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:02.335798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d072f-4c27-41f5-a7f3-f60eb71f2d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:02.336446 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d072f-4c27-41f5-a7f3-f60eb71f2d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:02.338840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d072f-4c27-41f5-a7f3-f60eb71f2d1b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:02.416480 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1362/2722] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:37:02 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:37:02.420677 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5857417-0add-47fe-a0b7-25c835da2220 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:02.431752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5857417-0add-47fe-a0b7-25c835da2220 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:02.492943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c98f9-d4d7-4071-a9b3-19a2799697c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:02.493676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c98f9-d4d7-4071-a9b3-19a2799697c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:02.493952 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c98f9-d4d7-4071-a9b3-19a2799697c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:02.494268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c98f9-d4d7-4071-a9b3-19a2799697c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:02.494891 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c98f9-d4d7-4071-a9b3-19a2799697c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:02.496803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c98f9-d4d7-4071-a9b3-19a2799697c4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:02.661031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1361/2723] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:37:02 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:37:02.665997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d072f-4c27-41f5-a7f3-f60eb71f2d1b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:02.676315 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d072f-4c27-41f5-a7f3-f60eb71f2d1b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:02.681799 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57839e60-3ffc-4ffe-b8ae-55f2d98c0030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:02.682484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57839e60-3ffc-4ffe-b8ae-55f2d98c0030 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:02.682943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57839e60-3ffc-4ffe-b8ae-55f2d98c0030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:02.683244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57839e60-3ffc-4ffe-b8ae-55f2d98c0030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:02.683893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57839e60-3ffc-4ffe-b8ae-55f2d98c0030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:02.685558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57839e60-3ffc-4ffe-b8ae-55f2d98c0030 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:02.696385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1363/2724] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:37:02.705413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c98f9-d4d7-4071-a9b3-19a2799697c4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:02.715693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c98f9-d4d7-4071-a9b3-19a2799697c4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:02.720511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828cadc-a3ae-4982-a7b3-11577a69b803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:02.721106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828cadc-a3ae-4982-a7b3-11577a69b803 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:02.721430 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828cadc-a3ae-4982-a7b3-11577a69b803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:02.721699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828cadc-a3ae-4982-a7b3-11577a69b803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:02.722488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828cadc-a3ae-4982-a7b3-11577a69b803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:02.724624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828cadc-a3ae-4982-a7b3-11577a69b803 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:02.740460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1362/2725] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:37:02.745049 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57839e60-3ffc-4ffe-b8ae-55f2d98c0030 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:02.756138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57839e60-3ffc-4ffe-b8ae-55f2d98c0030 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:02.760896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048ba16-d080-47cc-a813-7ab413a2849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:02.761607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048ba16-d080-47cc-a813-7ab413a2849e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:02.761887 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048ba16-d080-47cc-a813-7ab413a2849e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:02.762157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048ba16-d080-47cc-a813-7ab413a2849e admin admin] PATH_INFO: `/v3/projects/924aa7724b214ca090ef2db3d9ec8984/users/3c44a9ea0e48468099cca24ee4f163fe/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:02.773764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:02.777810 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048ba16-d080-47cc-a813-7ab413a2849e admin admin] RBAC: Authorizing `identity:create_grant(project_id=924aa7724b214ca090ef2db3d9ec8984, user_id=3c44a9ea0e48468099cca24ee4f163fe, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:02.780567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048ba16-d080-47cc-a813-7ab413a2849e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:02.856039 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1364/2726] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:37:02 2022] PUT /identity/v3/projects/924aa7724b214ca090ef2db3d9ec8984/users/3c44a9ea0e48468099cca24ee4f163fe/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:02.867769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cc02e-b707-44ad-a855-94155a701464 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:02.868058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cc02e-b707-44ad-a855-94155a701464 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:02.868333 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cc02e-b707-44ad-a855-94155a701464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:02.895849 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a62cc02e-b707-44ad-a855-94155a701464 None None] MFA Rules not processed for user `3c44a9ea0e48468099cca24ee4f163fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:02.897066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a62cc02e-b707-44ad-a855-94155a701464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:02.964099 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1363/2727] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:02.968630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048ba16-d080-47cc-a813-7ab413a2849e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:03.031629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048ba16-d080-47cc-a813-7ab413a2849e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:03.037235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa463e-c83f-401b-8a7b-c16a129aa05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:03.037875 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa463e-c83f-401b-8a7b-c16a129aa05a admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:03.038149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa463e-c83f-401b-8a7b-c16a129aa05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:03.038416 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa463e-c83f-401b-8a7b-c16a129aa05a admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:03.039061 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa463e-c83f-401b-8a7b-c16a129aa05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:03.041023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa463e-c83f-401b-8a7b-c16a129aa05a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:03.119062 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1365/2728] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:37:02 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:37:03.123107 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cc02e-b707-44ad-a855-94155a701464 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:03.133914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cc02e-b707-44ad-a855-94155a701464 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:03.146346 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:03.195610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b2700-e301-4fad-99fc-fa294712498d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:03.196222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b2700-e301-4fad-99fc-fa294712498d admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:03.196630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b2700-e301-4fad-99fc-fa294712498d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:03.196906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b2700-e301-4fad-99fc-fa294712498d admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:03.197596 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b2700-e301-4fad-99fc-fa294712498d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:03.199670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b2700-e301-4fad-99fc-fa294712498d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:03.328235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1364/2729] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:37:03 2022] POST /identity/v3/users => generated 299 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:37:03.329580 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa463e-c83f-401b-8a7b-c16a129aa05a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:03.340574 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa463e-c83f-401b-8a7b-c16a129aa05a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:03.345291 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e1611-184e-4b02-a417-2153b7ce5eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:03.345902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e1611-184e-4b02-a417-2153b7ce5eee admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:03.346205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e1611-184e-4b02-a417-2153b7ce5eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:03.346475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e1611-184e-4b02-a417-2153b7ce5eee admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:03.347110 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e1611-184e-4b02-a417-2153b7ce5eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:03.348825 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e1611-184e-4b02-a417-2153b7ce5eee admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:03.359528 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1366/2730] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:37:03.363697 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b2700-e301-4fad-99fc-fa294712498d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:03.374418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b2700-e301-4fad-99fc-fa294712498d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:03.380269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9737894-8138-4678-b0ba-cfff37cb9856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:03.384049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9737894-8138-4678-b0ba-cfff37cb9856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:03.384049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9737894-8138-4678-b0ba-cfff37cb9856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:03.384049 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9737894-8138-4678-b0ba-cfff37cb9856 admin admin] PATH_INFO: `/v3/projects/ed8f29d4c3a34e95b7a2bca2b9e86ac5/users/8068c49fbf9d4b8e8dca87ff67afdf94/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:03.397515 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9737894-8138-4678-b0ba-cfff37cb9856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8f29d4c3a34e95b7a2bca2b9e86ac5, user_id=8068c49fbf9d4b8e8dca87ff67afdf94, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:03.400136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9737894-8138-4678-b0ba-cfff37cb9856 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:03.478686 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1365/2731] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:37:03 2022] PUT /identity/v3/projects/ed8f29d4c3a34e95b7a2bca2b9e86ac5/users/8068c49fbf9d4b8e8dca87ff67afdf94/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:37:03.482838 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e1611-184e-4b02-a417-2153b7ce5eee admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:03.493430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e1611-184e-4b02-a417-2153b7ce5eee admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:03.552841 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dd1cb-dba4-4d8e-b5f1-28ed29b9f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:03.553514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dd1cb-dba4-4d8e-b5f1-28ed29b9f34a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:03.553789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dd1cb-dba4-4d8e-b5f1-28ed29b9f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:03.554058 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dd1cb-dba4-4d8e-b5f1-28ed29b9f34a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:03.554692 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dd1cb-dba4-4d8e-b5f1-28ed29b9f34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:03.556337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dd1cb-dba4-4d8e-b5f1-28ed29b9f34a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:03.566268 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1367/2732] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:37:03.570550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9737894-8138-4678-b0ba-cfff37cb9856 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:03.581015 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9737894-8138-4678-b0ba-cfff37cb9856 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:03.585720 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a061b-b26b-4f1f-b743-7326d02e0f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:03.586367 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a061b-b26b-4f1f-b743-7326d02e0f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:03.591658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a061b-b26b-4f1f-b743-7326d02e0f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:03.591658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a061b-b26b-4f1f-b743-7326d02e0f5c admin admin] PATH_INFO: `/v3/projects/ed8f29d4c3a34e95b7a2bca2b9e86ac5/users/8068c49fbf9d4b8e8dca87ff67afdf94/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:03.591658 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a061b-b26b-4f1f-b743-7326d02e0f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8f29d4c3a34e95b7a2bca2b9e86ac5, user_id=8068c49fbf9d4b8e8dca87ff67afdf94, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:03.591948 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a061b-b26b-4f1f-b743-7326d02e0f5c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:03.602605 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1366/2733] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:37:03 2022] PUT /identity/v3/projects/ed8f29d4c3a34e95b7a2bca2b9e86ac5/users/8068c49fbf9d4b8e8dca87ff67afdf94/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:03.613880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8773f-e379-46a0-9f1d-e1b4f614a87d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:03.614167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8773f-e379-46a0-9f1d-e1b4f614a87d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:03.614445 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8773f-e379-46a0-9f1d-e1b4f614a87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:03.642674 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c9d8773f-e379-46a0-9f1d-e1b4f614a87d None None] MFA Rules not processed for user `8068c49fbf9d4b8e8dca87ff67afdf94`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:03.643917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c9d8773f-e379-46a0-9f1d-e1b4f614a87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:03.693761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:03.715550 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1368/2734] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:03.727650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a061b-b26b-4f1f-b743-7326d02e0f5c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:03.729533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-486a061b-b26b-4f1f-b743-7326d02e0f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:03.789061 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a061b-b26b-4f1f-b743-7326d02e0f5c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:03.792718 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd7ea9-e507-4eca-9b1e-c70f1b988d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:03.793351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd7ea9-e507-4eca-9b1e-c70f1b988d34 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:03.793630 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd7ea9-e507-4eca-9b1e-c70f1b988d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:03.793903 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd7ea9-e507-4eca-9b1e-c70f1b988d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:03.804057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd7ea9-e507-4eca-9b1e-c70f1b988d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:03.805517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd7ea9-e507-4eca-9b1e-c70f1b988d34 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:03.815442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1367/2735] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:37:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:37:04.847100 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8773f-e379-46a0-9f1d-e1b4f614a87d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:04.913622 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8773f-e379-46a0-9f1d-e1b4f614a87d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:04.918149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d601ed5-fa8e-4b96-9687-8d1b467eecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:04.918777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d601ed5-fa8e-4b96-9687-8d1b467eecd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:04.919057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d601ed5-fa8e-4b96-9687-8d1b467eecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:04.919332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d601ed5-fa8e-4b96-9687-8d1b467eecd2 admin admin] PATH_INFO: `/v3/users/3c44a9ea0e48468099cca24ee4f163fe` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:04.920476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d601ed5-fa8e-4b96-9687-8d1b467eecd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c44a9ea0e48468099cca24ee4f163fe)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:04.922436 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d601ed5-fa8e-4b96-9687-8d1b467eecd2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:05.120796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3d601ed5-fa8e-4b96-9687-8d1b467eecd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c44a9ea0e48468099cca24ee4f163fe'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:05.121618 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3d601ed5-fa8e-4b96-9687-8d1b467eecd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c44a9ea0e48468099cca24ee4f163fe'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:05.122298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3d601ed5-fa8e-4b96-9687-8d1b467eecd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c44a9ea0e48468099cca24ee4f163fe'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:05.129954 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3d601ed5-fa8e-4b96-9687-8d1b467eecd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c44a9ea0e48468099cca24ee4f163fe'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:05.144770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3d601ed5-fa8e-4b96-9687-8d1b467eecd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c44a9ea0e48468099cca24ee4f163fe'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:05.149871 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a897f-8720-4fe1-928b-6bed90a04292 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:05.150366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a897f-8720-4fe1-928b-6bed90a04292 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:05.150528 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a897f-8720-4fe1-928b-6bed90a04292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:05.170336 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9b7a897f-8720-4fe1-928b-6bed90a04292 None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:05.171558 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9b7a897f-8720-4fe1-928b-6bed90a04292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:05.200216 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1369/2736] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:37:04 2022] DELETE /identity/v3/users/3c44a9ea0e48468099cca24ee4f163fe => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:05.204661 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305abda-581e-46ce-87a4-daca45b50608 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:05.204946 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305abda-581e-46ce-87a4-daca45b50608 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:05.205217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305abda-581e-46ce-87a4-daca45b50608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:05.227523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2305abda-581e-46ce-87a4-daca45b50608 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:05.228736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2305abda-581e-46ce-87a4-daca45b50608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:05.237121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1368/2737] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 13 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:37:05.251531 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a897f-8720-4fe1-928b-6bed90a04292 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:05.253044 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9b7a897f-8720-4fe1-928b-6bed90a04292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:05.272422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:05.300554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1370/2738] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:37:05.312343 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305abda-581e-46ce-87a4-daca45b50608 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:05.314195 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2305abda-581e-46ce-87a4-daca45b50608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:05.321829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:05.349510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a897f-8720-4fe1-928b-6bed90a04292 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:05.392892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305abda-581e-46ce-87a4-daca45b50608 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:05.396876 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e29a9-5dbd-4c6a-818a-758f90a05437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:05.397911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e29a9-5dbd-4c6a-818a-758f90a05437 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:05.398191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e29a9-5dbd-4c6a-818a-758f90a05437 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:05.399032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e29a9-5dbd-4c6a-818a-758f90a05437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:05.413206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e29a9-5dbd-4c6a-818a-758f90a05437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:05.414821 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e29a9-5dbd-4c6a-818a-758f90a05437 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:05.422366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38cccd-9773-4207-ad09-011606893d09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:05.423069 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38cccd-9773-4207-ad09-011606893d09 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:05.423447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38cccd-9773-4207-ad09-011606893d09 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:05.423788 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38cccd-9773-4207-ad09-011606893d09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:05.425408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1371/2739] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:37:05.493860 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38cccd-9773-4207-ad09-011606893d09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:05.495764 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38cccd-9773-4207-ad09-011606893d09 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:05.504846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1369/2740] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:37:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 03:37:05.859119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e29a9-5dbd-4c6a-818a-758f90a05437 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:05.859119 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5c1e29a9-5dbd-4c6a-818a-758f90a05437 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:05.874235 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e29a9-5dbd-4c6a-818a-758f90a05437 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:05.879000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:05.881960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:05.881960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:05.881960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] PATH_INFO: `/v3/projects/924aa7724b214ca090ef2db3d9ec8984` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:05.881960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=924aa7724b214ca090ef2db3d9ec8984)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:05.883873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:05.998579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924aa7724b214ca090ef2db3d9ec8984', 'request_id': 'req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:06.004756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924aa7724b214ca090ef2db3d9ec8984', 'request_id': 'req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:06.078524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924aa7724b214ca090ef2db3d9ec8984', 'request_id': 'req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:06.092559 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] The token cache is being invalidate because project 924aa7724b214ca090ef2db3d9ec8984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:37:06.092849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:06.093571 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:06.099626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1372/2741] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:37:05 2022] DELETE /identity/v3/projects/924aa7724b214ca090ef2db3d9ec8984 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:06.099777 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38cccd-9773-4207-ad09-011606893d09 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:06.109902 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38cccd-9773-4207-ad09-011606893d09 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:06.175170 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:06.183198 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02724d0-20e4-4887-b727-6d2047907bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:06.184048 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02724d0-20e4-4887-b727-6d2047907bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:06.184329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02724d0-20e4-4887-b727-6d2047907bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:06.184603 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02724d0-20e4-4887-b727-6d2047907bc7 admin admin] PATH_INFO: `/v3/users/8068c49fbf9d4b8e8dca87ff67afdf94` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:06.185792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02724d0-20e4-4887-b727-6d2047907bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8068c49fbf9d4b8e8dca87ff67afdf94)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:06.187770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02724d0-20e4-4887-b727-6d2047907bc7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:06.336667 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c02724d0-20e4-4887-b727-6d2047907bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8068c49fbf9d4b8e8dca87ff67afdf94'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:06.397692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c02724d0-20e4-4887-b727-6d2047907bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8068c49fbf9d4b8e8dca87ff67afdf94'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:06.398400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c02724d0-20e4-4887-b727-6d2047907bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8068c49fbf9d4b8e8dca87ff67afdf94'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:06.399088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c02724d0-20e4-4887-b727-6d2047907bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8068c49fbf9d4b8e8dca87ff67afdf94'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:06.407099 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c02724d0-20e4-4887-b727-6d2047907bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8068c49fbf9d4b8e8dca87ff67afdf94'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:06.425016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1370/2742] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:37:06 2022] DELETE /identity/v3/users/8068c49fbf9d4b8e8dca87ff67afdf94 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:37:06.875139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:06.876778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:06.893018 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81781a-a9e5-4c65-aa87-d065de3a3c3c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:06.950703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:06.951325 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:06.951599 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:06.951868 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896 admin admin] PATH_INFO: `/v3/projects/ed8f29d4c3a34e95b7a2bca2b9e86ac5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:06.952962 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8f29d4c3a34e95b7a2bca2b9e86ac5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:06.954890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:07.043188 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:07.054795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8f29d4c3a34e95b7a2bca2b9e86ac5', 'request_id': 'req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:07.060699 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8f29d4c3a34e95b7a2bca2b9e86ac5', 'request_id': 'req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:07.122555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8f29d4c3a34e95b7a2bca2b9e86ac5', 'request_id': 'req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:07.133382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896 admin admin] The token cache is being invalidate because project ed8f29d4c3a34e95b7a2bca2b9e86ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:37:07.134718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:07.134718 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-dd7b6b51-7a2a-4d5b-b1a1-e51f1ef61896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:07.135720 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1373/2743] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:37:06 2022] DELETE /identity/v3/projects/ed8f29d4c3a34e95b7a2bca2b9e86ac5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:07.140707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad41c5e-728e-4941-b529-573e5c3eb07a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:07.141105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad41c5e-728e-4941-b529-573e5c3eb07a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:07.141471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad41c5e-728e-4941-b529-573e5c3eb07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:07.161990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fad41c5e-728e-4941-b529-573e5c3eb07a None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:07.163190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fad41c5e-728e-4941-b529-573e5c3eb07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:07.225843 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1371/2744] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:07.233768 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d483f26-1f15-44bb-ae09-602f89c70cd0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:07.233952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d483f26-1f15-44bb-ae09-602f89c70cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:07.234233 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d483f26-1f15-44bb-ae09-602f89c70cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:07.254983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2d483f26-1f15-44bb-ae09-602f89c70cd0 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:07.256192 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2d483f26-1f15-44bb-ae09-602f89c70cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:07.264740 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1374/2745] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:07.269119 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad41c5e-728e-4941-b529-573e5c3eb07a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:07.279566 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad41c5e-728e-4941-b529-573e5c3eb07a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:07.284335 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33922d0b-2988-4ba0-aa20-7ea7b45ddea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:07.284931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33922d0b-2988-4ba0-aa20-7ea7b45ddea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:07.285209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33922d0b-2988-4ba0-aa20-7ea7b45ddea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:07.285514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33922d0b-2988-4ba0-aa20-7ea7b45ddea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:07.286157 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33922d0b-2988-4ba0-aa20-7ea7b45ddea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:37:07.286466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33922d0b-2988-4ba0-aa20-7ea7b45ddea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:07.288093 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33922d0b-2988-4ba0-aa20-7ea7b45ddea9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:07.300348 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1372/2746] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:37:07.305388 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d483f26-1f15-44bb-ae09-602f89c70cd0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:07.314484 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d483f26-1f15-44bb-ae09-602f89c70cd0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:07.319247 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe331afc-d382-4cd3-9e91-77a892990cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:07.320404 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe331afc-d382-4cd3-9e91-77a892990cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:07.320680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe331afc-d382-4cd3-9e91-77a892990cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:07.320950 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe331afc-d382-4cd3-9e91-77a892990cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:07.321618 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe331afc-d382-4cd3-9e91-77a892990cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:07.323546 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe331afc-d382-4cd3-9e91-77a892990cdb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:07.411864 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1375/2747] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:37:07 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:37:07.417241 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33922d0b-2988-4ba0-aa20-7ea7b45ddea9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:07.427643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33922d0b-2988-4ba0-aa20-7ea7b45ddea9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:07.491245 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9391a79-b057-4388-9dab-38ae803d63d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:07.492512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9391a79-b057-4388-9dab-38ae803d63d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:07.492792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9391a79-b057-4388-9dab-38ae803d63d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:07.493068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9391a79-b057-4388-9dab-38ae803d63d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:07.493740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9391a79-b057-4388-9dab-38ae803d63d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:07.495667 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9391a79-b057-4388-9dab-38ae803d63d5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:07.504819 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:07.609871 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1373/2748] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:37:07 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:37:07.614226 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe331afc-d382-4cd3-9e91-77a892990cdb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:07.625438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe331afc-d382-4cd3-9e91-77a892990cdb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:07.630180 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5154fdc-2545-446e-9057-4e1c0869bbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:07.630800 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5154fdc-2545-446e-9057-4e1c0869bbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:07.637795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5154fdc-2545-446e-9057-4e1c0869bbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:07.637795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5154fdc-2545-446e-9057-4e1c0869bbf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:07.637795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5154fdc-2545-446e-9057-4e1c0869bbf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:07.637795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5154fdc-2545-446e-9057-4e1c0869bbf5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:07.644305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1376/2749] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:37:07.648892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9391a79-b057-4388-9dab-38ae803d63d5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:07.659285 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9391a79-b057-4388-9dab-38ae803d63d5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:07.665052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2f4e8-b4e1-4d79-8ae5-a06a0c208904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:07.665750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2f4e8-b4e1-4d79-8ae5-a06a0c208904 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:07.666094 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2f4e8-b4e1-4d79-8ae5-a06a0c208904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:07.666433 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2f4e8-b4e1-4d79-8ae5-a06a0c208904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:07.667139 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2f4e8-b4e1-4d79-8ae5-a06a0c208904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:07.668794 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2f4e8-b4e1-4d79-8ae5-a06a0c208904 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:07.679740 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1374/2750] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:37:07.684088 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5154fdc-2545-446e-9057-4e1c0869bbf5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:07.694086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5154fdc-2545-446e-9057-4e1c0869bbf5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:07.698631 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc523b6-91d6-4c5a-ae4f-5d6c489a2818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:07.699277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc523b6-91d6-4c5a-ae4f-5d6c489a2818 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:07.699551 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc523b6-91d6-4c5a-ae4f-5d6c489a2818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:07.699820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc523b6-91d6-4c5a-ae4f-5d6c489a2818 admin admin] PATH_INFO: `/v3/projects/99ec14c2ee6c4d279e968330f76fffab/users/ea120dde49da4bf2a7868ff93cfbef44/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:07.716817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc523b6-91d6-4c5a-ae4f-5d6c489a2818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ec14c2ee6c4d279e968330f76fffab, user_id=ea120dde49da4bf2a7868ff93cfbef44, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:07.719527 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc523b6-91d6-4c5a-ae4f-5d6c489a2818 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:07.826461 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1377/2751] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:37:07 2022] PUT /identity/v3/projects/99ec14c2ee6c4d279e968330f76fffab/users/ea120dde49da4bf2a7868ff93cfbef44/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:07.838675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec07e1-9d85-432f-adaa-b3efb4eec878 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:07.838959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec07e1-9d85-432f-adaa-b3efb4eec878 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:07.839228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec07e1-9d85-432f-adaa-b3efb4eec878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:07.867387 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f6ec07e1-9d85-432f-adaa-b3efb4eec878 None None] MFA Rules not processed for user `ea120dde49da4bf2a7868ff93cfbef44`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:07.868595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f6ec07e1-9d85-432f-adaa-b3efb4eec878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:07.931243 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1375/2752] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:07.942219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc523b6-91d6-4c5a-ae4f-5d6c489a2818 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:07.943926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ddc523b6-91d6-4c5a-ae4f-5d6c489a2818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:07.999702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc523b6-91d6-4c5a-ae4f-5d6c489a2818 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:08.003286 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe444f74-2742-4e67-99a1-4d1229cdf19f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:08.003873 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444f74-2742-4e67-99a1-4d1229cdf19f service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:08.004145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444f74-2742-4e67-99a1-4d1229cdf19f service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:08.004411 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe444f74-2742-4e67-99a1-4d1229cdf19f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:08.012936 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe444f74-2742-4e67-99a1-4d1229cdf19f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:08.014385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe444f74-2742-4e67-99a1-4d1229cdf19f service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:08.023604 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1378/2753] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:37:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:37:08.045539 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec07e1-9d85-432f-adaa-b3efb4eec878 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:08.108318 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec07e1-9d85-432f-adaa-b3efb4eec878 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:08.113038 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:08.113681 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:08.113958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:08.114227 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] PATH_INFO: `/v3/users/ea120dde49da4bf2a7868ff93cfbef44` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:08.115371 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea120dde49da4bf2a7868ff93cfbef44)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:08.117405 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:08.314341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea120dde49da4bf2a7868ff93cfbef44'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:08.374767 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea120dde49da4bf2a7868ff93cfbef44'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:08.375418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea120dde49da4bf2a7868ff93cfbef44'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:08.376031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea120dde49da4bf2a7868ff93cfbef44'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:08.383984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea120dde49da4bf2a7868ff93cfbef44'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:08.391204 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:08.401866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1376/2754] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:37:08 2022] DELETE /identity/v3/users/ea120dde49da4bf2a7868ff93cfbef44 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:08.406488 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bd207-f50d-490e-b38f-b0541d9158d3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:08.406777 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bd207-f50d-490e-b38f-b0541d9158d3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:08.407079 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bd207-f50d-490e-b38f-b0541d9158d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:08.425786 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-138bd207-f50d-490e-b38f-b0541d9158d3 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:08.427027 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-138bd207-f50d-490e-b38f-b0541d9158d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:08.479964 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:08.488429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1379/2755] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:08.498754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:08.500274 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:08.558035 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61ec26-9bca-4b4d-8776-8130cbb30aae admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:08.561692 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598484-0949-446f-a6fb-b98d9c217c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:08.562291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598484-0949-446f-a6fb-b98d9c217c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:08.562568 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598484-0949-446f-a6fb-b98d9c217c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:08.562838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598484-0949-446f-a6fb-b98d9c217c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:08.575160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1598484-0949-446f-a6fb-b98d9c217c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:08.575160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1598484-0949-446f-a6fb-b98d9c217c4a service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:08.583660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1377/2756] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:37:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:37:09.040091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bd207-f50d-490e-b38f-b0541d9158d3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:09.043775 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-138bd207-f50d-490e-b38f-b0541d9158d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:09.054106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bd207-f50d-490e-b38f-b0541d9158d3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:09.058722 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9cca59-c85c-4d64-a486-f6faa8c68135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:09.059361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cca59-c85c-4d64-a486-f6faa8c68135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:09.059639 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cca59-c85c-4d64-a486-f6faa8c68135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:09.059912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cca59-c85c-4d64-a486-f6faa8c68135 admin admin] PATH_INFO: `/v3/projects/99ec14c2ee6c4d279e968330f76fffab` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:09.061035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9cca59-c85c-4d64-a486-f6faa8c68135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ec14c2ee6c4d279e968330f76fffab)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:09.063004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9cca59-c85c-4d64-a486-f6faa8c68135 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:09.176409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5f9cca59-c85c-4d64-a486-f6faa8c68135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ec14c2ee6c4d279e968330f76fffab', 'request_id': 'req-5f9cca59-c85c-4d64-a486-f6faa8c68135'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:09.182513 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5f9cca59-c85c-4d64-a486-f6faa8c68135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ec14c2ee6c4d279e968330f76fffab', 'request_id': 'req-5f9cca59-c85c-4d64-a486-f6faa8c68135'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:09.248764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5f9cca59-c85c-4d64-a486-f6faa8c68135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ec14c2ee6c4d279e968330f76fffab', 'request_id': 'req-5f9cca59-c85c-4d64-a486-f6faa8c68135'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:09.259785 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5f9cca59-c85c-4d64-a486-f6faa8c68135 admin admin] The token cache is being invalidate because project 99ec14c2ee6c4d279e968330f76fffab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:37:09.260073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5f9cca59-c85c-4d64-a486-f6faa8c68135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:09.260694 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5f9cca59-c85c-4d64-a486-f6faa8c68135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:09.262208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1380/2757] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:37:09 2022] DELETE /identity/v3/projects/99ec14c2ee6c4d279e968330f76fffab => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:09.267360 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf557cd-8626-44b6-92cd-dd0a5919bfe7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:09.267643 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf557cd-8626-44b6-92cd-dd0a5919bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:09.267914 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf557cd-8626-44b6-92cd-dd0a5919bfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:09.289989 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cbf557cd-8626-44b6-92cd-dd0a5919bfe7 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:09.291191 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cbf557cd-8626-44b6-92cd-dd0a5919bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:09.349538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1378/2758] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:37:09.357938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0afef-34ee-4402-88d4-a42835614236 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:09.358220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0afef-34ee-4402-88d4-a42835614236 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:09.358491 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0afef-34ee-4402-88d4-a42835614236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:09.379213 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0ed0afef-34ee-4402-88d4-a42835614236 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:09.380438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0ed0afef-34ee-4402-88d4-a42835614236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:09.388220 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1381/2759] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:09.392403 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf557cd-8626-44b6-92cd-dd0a5919bfe7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:09.402438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf557cd-8626-44b6-92cd-dd0a5919bfe7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:09.407083 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd7a12-9579-46ec-aff2-476f2cf3fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:09.407693 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd7a12-9579-46ec-aff2-476f2cf3fbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:09.407966 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd7a12-9579-46ec-aff2-476f2cf3fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:09.408312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd7a12-9579-46ec-aff2-476f2cf3fbe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:09.408903 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd7a12-9579-46ec-aff2-476f2cf3fbe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:37:09.409200 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd7a12-9579-46ec-aff2-476f2cf3fbe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:09.410866 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd7a12-9579-46ec-aff2-476f2cf3fbe3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:09.423090 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1379/2760] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:37:09.427301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0afef-34ee-4402-88d4-a42835614236 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:09.436691 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0afef-34ee-4402-88d4-a42835614236 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:09.441396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333deab-2190-4a43-88ad-42cfa796aedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:09.441988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333deab-2190-4a43-88ad-42cfa796aedc admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:09.442267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333deab-2190-4a43-88ad-42cfa796aedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:09.442555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333deab-2190-4a43-88ad-42cfa796aedc admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:09.443173 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333deab-2190-4a43-88ad-42cfa796aedc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:09.445610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333deab-2190-4a43-88ad-42cfa796aedc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:09.536337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1382/2761] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:37:09 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:37:09.540477 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd7a12-9579-46ec-aff2-476f2cf3fbe3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:09.550719 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd7a12-9579-46ec-aff2-476f2cf3fbe3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:09.607549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa9dae-bb7e-487c-ad14-fbb6d4f1f2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:09.608145 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa9dae-bb7e-487c-ad14-fbb6d4f1f2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:09.608419 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa9dae-bb7e-487c-ad14-fbb6d4f1f2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:09.608687 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa9dae-bb7e-487c-ad14-fbb6d4f1f2d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:09.609337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa9dae-bb7e-487c-ad14-fbb6d4f1f2d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:09.611256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa9dae-bb7e-487c-ad14-fbb6d4f1f2d2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:09.672420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1380/2762] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:37:09 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:37:09.676754 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333deab-2190-4a43-88ad-42cfa796aedc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:09.687361 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333deab-2190-4a43-88ad-42cfa796aedc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:09.692309 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62b03d-9617-47a1-a229-6c529600893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:09.692904 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62b03d-9617-47a1-a229-6c529600893b admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:09.693186 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62b03d-9617-47a1-a229-6c529600893b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:09.693496 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62b03d-9617-47a1-a229-6c529600893b admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:09.694171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62b03d-9617-47a1-a229-6c529600893b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:09.696282 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62b03d-9617-47a1-a229-6c529600893b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:09.706783 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1383/2763] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:37:09.710650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa9dae-bb7e-487c-ad14-fbb6d4f1f2d2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:09.721435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa9dae-bb7e-487c-ad14-fbb6d4f1f2d2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:09.726047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716963f-74ae-45a0-abb4-92b3c9fdc15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:09.726661 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716963f-74ae-45a0-abb4-92b3c9fdc15c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:09.726961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716963f-74ae-45a0-abb4-92b3c9fdc15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:09.727235 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716963f-74ae-45a0-abb4-92b3c9fdc15c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:09.727883 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716963f-74ae-45a0-abb4-92b3c9fdc15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:09.729482 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716963f-74ae-45a0-abb4-92b3c9fdc15c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:09.731508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:09.740214 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1381/2764] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:37:09.746117 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62b03d-9617-47a1-a229-6c529600893b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:09.755907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62b03d-9617-47a1-a229-6c529600893b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:09.760971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a84d7-6f47-4703-82a7-63f8cc906f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:09.761683 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a84d7-6f47-4703-82a7-63f8cc906f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:09.761960 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a84d7-6f47-4703-82a7-63f8cc906f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:09.762234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a84d7-6f47-4703-82a7-63f8cc906f08 admin admin] PATH_INFO: `/v3/projects/edea61cc2f4e498b8eb299b49ab0dffc/users/a986e1a153d94d71bdfeb7c34350c5b7/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:09.777396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a84d7-6f47-4703-82a7-63f8cc906f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edea61cc2f4e498b8eb299b49ab0dffc, user_id=a986e1a153d94d71bdfeb7c34350c5b7, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:09.780131 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a84d7-6f47-4703-82a7-63f8cc906f08 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:09.848984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1384/2765] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:37:09 2022] PUT /identity/v3/projects/edea61cc2f4e498b8eb299b49ab0dffc/users/a986e1a153d94d71bdfeb7c34350c5b7/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:09.854242 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317552b-6b8f-4ede-9983-f5a148212b31 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:09.854532 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317552b-6b8f-4ede-9983-f5a148212b31 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:09.854894 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317552b-6b8f-4ede-9983-f5a148212b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:09.874347 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7317552b-6b8f-4ede-9983-f5a148212b31 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:09.875535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7317552b-6b8f-4ede-9983-f5a148212b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:09.932550 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1382/2766] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:37:09.942070 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a84d7-6f47-4703-82a7-63f8cc906f08 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:09.943795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-870a84d7-6f47-4703-82a7-63f8cc906f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:09.999390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a84d7-6f47-4703-82a7-63f8cc906f08 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:10.003141 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ee990-f460-404f-88c1-ac1c217641be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:10.003738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee990-f460-404f-88c1-ac1c217641be service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:10.004015 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee990-f460-404f-88c1-ac1c217641be service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:10.004555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee990-f460-404f-88c1-ac1c217641be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:10.014421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ee990-f460-404f-88c1-ac1c217641be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:10.015850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ee990-f460-404f-88c1-ac1c217641be service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:10.025366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1385/2767] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:37:14.783551 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae350a3-d886-4481-b504-c4ee5cf11fd8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:14.783551 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae350a3-d886-4481-b504-c4ee5cf11fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:14.783551 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae350a3-d886-4481-b504-c4ee5cf11fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:14.813825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-dae350a3-d886-4481-b504-c4ee5cf11fd8 None None] MFA Rules not processed for user `0faf7491acfa42ada54897410160eeb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:14.817907 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dae350a3-d886-4481-b504-c4ee5cf11fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:14.895481 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1383/2768] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:16.001833 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886929-1f3e-407d-86cf-db606c25182c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:16.002328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886929-1f3e-407d-86cf-db606c25182c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:16.002328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886929-1f3e-407d-86cf-db606c25182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:16.039015 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1b886929-1f3e-407d-86cf-db606c25182c None None] MFA Rules not processed for user `a986e1a153d94d71bdfeb7c34350c5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:16.040539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1b886929-1f3e-407d-86cf-db606c25182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:16.052645 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:16.128628 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1386/2769] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:16.133974 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae350a3-d886-4481-b504-c4ee5cf11fd8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:16.148329 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae350a3-d886-4481-b504-c4ee5cf11fd8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:16.153241 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c618-c8ff-442a-bcf6-8ec22c329855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:16.154007 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c618-c8ff-442a-bcf6-8ec22c329855 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:16.154359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c618-c8ff-442a-bcf6-8ec22c329855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:16.154704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c618-c8ff-442a-bcf6-8ec22c329855 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:16.155419 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c618-c8ff-442a-bcf6-8ec22c329855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:16.157520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c618-c8ff-442a-bcf6-8ec22c329855 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:16.256888 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1384/2770] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:37:16 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:37:16.260918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b886929-1f3e-407d-86cf-db606c25182c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:16.272033 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b886929-1f3e-407d-86cf-db606c25182c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:16.333849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddb65a-3432-470e-89d9-632b8e702394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:16.334479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddb65a-3432-470e-89d9-632b8e702394 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:16.334759 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddb65a-3432-470e-89d9-632b8e702394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:16.335041 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddb65a-3432-470e-89d9-632b8e702394 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:16.335694 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bddb65a-3432-470e-89d9-632b8e702394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:16.337911 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bddb65a-3432-470e-89d9-632b8e702394 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:16.392952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1387/2771] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:37:16 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:37:16.396786 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c618-c8ff-442a-bcf6-8ec22c329855 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:16.407168 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c618-c8ff-442a-bcf6-8ec22c329855 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:16.411910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b15cd-ed0d-4d67-91e1-23280727a2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:16.412505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b15cd-ed0d-4d67-91e1-23280727a2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:16.412783 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b15cd-ed0d-4d67-91e1-23280727a2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:16.413055 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b15cd-ed0d-4d67-91e1-23280727a2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:16.414238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b15cd-ed0d-4d67-91e1-23280727a2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:16.415824 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b15cd-ed0d-4d67-91e1-23280727a2a7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:16.426499 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1385/2772] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:37:16.431449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddb65a-3432-470e-89d9-632b8e702394 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:16.443373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddb65a-3432-470e-89d9-632b8e702394 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:16.448815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba8e50-b6c6-4950-940e-e667d8bf16f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:16.451478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba8e50-b6c6-4950-940e-e667d8bf16f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:16.451478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba8e50-b6c6-4950-940e-e667d8bf16f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:16.451478 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba8e50-b6c6-4950-940e-e667d8bf16f4 admin admin] PATH_INFO: `/v3/projects/5f520ed8c5ba445395e97448ac2e8a39/users/ad1c8a8dd4e24656b91f9489d584181d/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:16.465764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba8e50-b6c6-4950-940e-e667d8bf16f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f520ed8c5ba445395e97448ac2e8a39, user_id=ad1c8a8dd4e24656b91f9489d584181d, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:16.468403 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba8e50-b6c6-4950-940e-e667d8bf16f4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:16.530422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1388/2773] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:37:16 2022] PUT /identity/v3/projects/5f520ed8c5ba445395e97448ac2e8a39/users/ad1c8a8dd4e24656b91f9489d584181d/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:16.534399 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b15cd-ed0d-4d67-91e1-23280727a2a7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:16.545238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b15cd-ed0d-4d67-91e1-23280727a2a7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:16.602880 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704b23d-83ba-4e80-8918-35f4e2f05a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:16.603475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704b23d-83ba-4e80-8918-35f4e2f05a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:16.603751 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704b23d-83ba-4e80-8918-35f4e2f05a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:16.604019 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704b23d-83ba-4e80-8918-35f4e2f05a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:16.604639 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704b23d-83ba-4e80-8918-35f4e2f05a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:16.606321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704b23d-83ba-4e80-8918-35f4e2f05a3e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:16.620541 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1386/2774] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:37:16.622660 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba8e50-b6c6-4950-940e-e667d8bf16f4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:16.633755 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba8e50-b6c6-4950-940e-e667d8bf16f4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:16.638811 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff3d53-643c-4a0d-80ad-eec04ba4cf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:16.640366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff3d53-643c-4a0d-80ad-eec04ba4cf67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:16.640366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff3d53-643c-4a0d-80ad-eec04ba4cf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:16.640366 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff3d53-643c-4a0d-80ad-eec04ba4cf67 admin admin] PATH_INFO: `/v3/projects/5f520ed8c5ba445395e97448ac2e8a39/users/ad1c8a8dd4e24656b91f9489d584181d/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:16.642172 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff3d53-643c-4a0d-80ad-eec04ba4cf67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f520ed8c5ba445395e97448ac2e8a39, user_id=ad1c8a8dd4e24656b91f9489d584181d, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:16.645054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff3d53-643c-4a0d-80ad-eec04ba4cf67 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:16.657455 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1389/2775] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:37:16 2022] PUT /identity/v3/projects/5f520ed8c5ba445395e97448ac2e8a39/users/ad1c8a8dd4e24656b91f9489d584181d/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:37:20.205413 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704b23d-83ba-4e80-8918-35f4e2f05a3e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:20.207962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c704b23d-83ba-4e80-8918-35f4e2f05a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:20.235330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:20.335396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704b23d-83ba-4e80-8918-35f4e2f05a3e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:20.422572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68b8a2-ddcd-4677-a9c7-e6dfeff712ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:20.422807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68b8a2-ddcd-4677-a9c7-e6dfeff712ff service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:20.423304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68b8a2-ddcd-4677-a9c7-e6dfeff712ff service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:20.423629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68b8a2-ddcd-4677-a9c7-e6dfeff712ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:20.426324 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0a68b8a2-ddcd-4677-a9c7-e6dfeff712ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:20.439944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68b8a2-ddcd-4677-a9c7-e6dfeff712ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:20.441952 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68b8a2-ddcd-4677-a9c7-e6dfeff712ff service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:20.458868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1387/2776] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:37:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:37:22.759717 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf4d46-dd2c-4f14-af35-1c96c6b93eac None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:22.760262 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf4d46-dd2c-4f14-af35-1c96c6b93eac None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:22.760262 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf4d46-dd2c-4f14-af35-1c96c6b93eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:22.794972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cabf4d46-dd2c-4f14-af35-1c96c6b93eac None None] MFA Rules not processed for user `ad1c8a8dd4e24656b91f9489d584181d`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:22.796277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cabf4d46-dd2c-4f14-af35-1c96c6b93eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:22.851033 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:22.870223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1390/2777] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:22.884442 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68b8a2-ddcd-4677-a9c7-e6dfeff712ff service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:22.885873 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0a68b8a2-ddcd-4677-a9c7-e6dfeff712ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:22.900577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68b8a2-ddcd-4677-a9c7-e6dfeff712ff service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:22.906202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82595cef-1f92-4231-8247-b8cb38c85101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:22.906817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82595cef-1f92-4231-8247-b8cb38c85101 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:22.907096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82595cef-1f92-4231-8247-b8cb38c85101 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:22.907372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82595cef-1f92-4231-8247-b8cb38c85101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:22.967931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82595cef-1f92-4231-8247-b8cb38c85101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:22.969599 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82595cef-1f92-4231-8247-b8cb38c85101 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:22.979567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1388/2778] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:37:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:37:25.476224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f57a6-1926-42d9-b823-9312a5ab8064 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:25.476224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f57a6-1926-42d9-b823-9312a5ab8064 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:25.476224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f57a6-1926-42d9-b823-9312a5ab8064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:25.491471 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-741f57a6-1926-42d9-b823-9312a5ab8064 None None] MFA Rules not processed for user `a986e1a153d94d71bdfeb7c34350c5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:25.492929 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-741f57a6-1926-42d9-b823-9312a5ab8064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:25.509374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1391/2779] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:32.974646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=87 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:35.027632 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2b368-7e79-4b85-a07a-095b3e745e24 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:35.028152 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2b368-7e79-4b85-a07a-095b3e745e24 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:35.028152 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2b368-7e79-4b85-a07a-095b3e745e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:35.048282 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cab2b368-7e79-4b85-a07a-095b3e745e24 None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:35.050459 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cab2b368-7e79-4b85-a07a-095b3e745e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:35.105990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1389/2780] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:35.129137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f57a6-1926-42d9-b823-9312a5ab8064 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:35.130555 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-741f57a6-1926-42d9-b823-9312a5ab8064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:35.207312 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f57a6-1926-42d9-b823-9312a5ab8064 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:35.212509 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447b6c6-fa7b-4960-b4c0-35814cccc4ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:35.213114 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447b6c6-fa7b-4960-b4c0-35814cccc4ba service swift] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:35.213423 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447b6c6-fa7b-4960-b4c0-35814cccc4ba service swift] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:35.213695 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447b6c6-fa7b-4960-b4c0-35814cccc4ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:35.221769 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447b6c6-fa7b-4960-b4c0-35814cccc4ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:35.223349 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447b6c6-fa7b-4960-b4c0-35814cccc4ba service swift] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:35.231867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1392/2781] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:37:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 03:37:45.098612 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=25 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:45.228475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=40 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:37:53.362927 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d2b4-faee-4133-9024-aea0fed58bf7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:53.363502 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d2b4-faee-4133-9024-aea0fed58bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:53.363713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38d2b4-faee-4133-9024-aea0fed58bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:53.387269 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9d38d2b4-faee-4133-9024-aea0fed58bf7 None None] MFA Rules not processed for user `ec3ab00d1b2c498aa0160a0fa044e7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:53.388586 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9d38d2b4-faee-4133-9024-aea0fed58bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:53.468468 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1390/2782] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:37:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:55.661496 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4db4a8-a863-4921-9203-c47708b135a0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:55.662316 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4db4a8-a863-4921-9203-c47708b135a0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:55.662595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4db4a8-a863-4921-9203-c47708b135a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:55.689852 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9d4db4a8-a863-4921-9203-c47708b135a0 None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:37:55.691404 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9d4db4a8-a863-4921-9203-c47708b135a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:55.700442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1393/2783] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 13 03:37:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:37:55.717201 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38d2b4-faee-4133-9024-aea0fed58bf7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:55.730225 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38d2b4-faee-4133-9024-aea0fed58bf7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:55.736056 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b70592-0595-474c-ba08-74a5fbea6919 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:55.736673 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b70592-0595-474c-ba08-74a5fbea6919 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:55.736951 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b70592-0595-474c-ba08-74a5fbea6919 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:55.737222 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b70592-0595-474c-ba08-74a5fbea6919 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:55.747287 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b70592-0595-474c-ba08-74a5fbea6919 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:55.749017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b70592-0595-474c-ba08-74a5fbea6919 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:55.758651 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1391/2784] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:37:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 03:37:58.445892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4db4a8-a863-4921-9203-c47708b135a0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:58.447364 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9d4db4a8-a863-4921-9203-c47708b135a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:58.508849 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4db4a8-a863-4921-9203-c47708b135a0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:58.513067 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddab5ce-0258-4723-811b-72d3c3bf423f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:58.513699 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddab5ce-0258-4723-811b-72d3c3bf423f service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:58.514158 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddab5ce-0258-4723-811b-72d3c3bf423f service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:58.514602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddab5ce-0258-4723-811b-72d3c3bf423f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:58.525634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddab5ce-0258-4723-811b-72d3c3bf423f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:58.527264 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddab5ce-0258-4723-811b-72d3c3bf423f service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:58.541288 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1394/2785] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:37:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:37:59.168538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b70592-0595-474c-ba08-74a5fbea6919 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:59.170309 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e6b70592-0595-474c-ba08-74a5fbea6919 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:59.249299 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b70592-0595-474c-ba08-74a5fbea6919 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:59.254284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135937b-1d8a-46f1-9092-502dce07a85c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261a9485c3b4d2aa657a931e0388389', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:59.254885 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135937b-1d8a-46f1-9092-502dce07a85c service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:59.255155 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135937b-1d8a-46f1-9092-502dce07a85c service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:59.255420 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135937b-1d8a-46f1-9092-502dce07a85c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:59.257106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0135937b-1d8a-46f1-9092-502dce07a85c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:59.270192 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135937b-1d8a-46f1-9092-502dce07a85c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:59.271927 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135937b-1d8a-46f1-9092-502dce07a85c service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:59.283117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1392/2786] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:37:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:37:59.354044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddab5ce-0258-4723-811b-72d3c3bf423f service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:37:59.355736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4ddab5ce-0258-4723-811b-72d3c3bf423f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:37:59.422786 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddab5ce-0258-4723-811b-72d3c3bf423f service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:37:59.427375 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:37:59.427990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:37:59.428267 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:37:59.428538 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] PATH_INFO: `/v3/users/0faf7491acfa42ada54897410160eeb6` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:37:59.430193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0faf7491acfa42ada54897410160eeb6)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:37:59.432151 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:37:59.602573 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0faf7491acfa42ada54897410160eeb6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:59.603261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0faf7491acfa42ada54897410160eeb6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:59.603894 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0faf7491acfa42ada54897410160eeb6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:59.611869 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0faf7491acfa42ada54897410160eeb6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:59.625442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0faf7491acfa42ada54897410160eeb6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:37:59.707988 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1395/2787] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:37:59 2022] DELETE /identity/v3/users/0faf7491acfa42ada54897410160eeb6 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:38:00.068376 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135937b-1d8a-46f1-9092-502dce07a85c service placement] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:38:00.077234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135937b-1d8a-46f1-9092-502dce07a85c service placement] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:38:00.144794 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62afd2-16c7-4468-a905-8988333dd5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:38:00.145440 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62afd2-16c7-4468-a905-8988333dd5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:38:00.145713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62afd2-16c7-4468-a905-8988333dd5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:38:00.150059 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62afd2-16c7-4468-a905-8988333dd5a3 admin admin] PATH_INFO: `/v3/projects/a4365f146ef54b1b90e8ea1742d297c2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:38:00.150059 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62afd2-16c7-4468-a905-8988333dd5a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4365f146ef54b1b90e8ea1742d297c2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:38:00.150059 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62afd2-16c7-4468-a905-8988333dd5a3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:38:00.180356 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:38:00.263190 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6b62afd2-16c7-4468-a905-8988333dd5a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4365f146ef54b1b90e8ea1742d297c2', 'request_id': 'req-6b62afd2-16c7-4468-a905-8988333dd5a3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:38:00.272238 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6b62afd2-16c7-4468-a905-8988333dd5a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4365f146ef54b1b90e8ea1742d297c2', 'request_id': 'req-6b62afd2-16c7-4468-a905-8988333dd5a3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:38:00.352772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6b62afd2-16c7-4468-a905-8988333dd5a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4365f146ef54b1b90e8ea1742d297c2', 'request_id': 'req-6b62afd2-16c7-4468-a905-8988333dd5a3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:38:00.365097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6b62afd2-16c7-4468-a905-8988333dd5a3 admin admin] The token cache is being invalidate because project a4365f146ef54b1b90e8ea1742d297c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:38:00.365501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6b62afd2-16c7-4468-a905-8988333dd5a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:38:00.366152 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6b62afd2-16c7-4468-a905-8988333dd5a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:38:00.368305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1393/2788] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:38:00 2022] DELETE /identity/v3/projects/a4365f146ef54b1b90e8ea1742d297c2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:38:09.703983 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=82,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:38:10.426829 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:38:17.735071 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:38:17.736549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:38:17.873817 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ac00e-0c9f-48de-84ab-1b0f5a864c3c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:38:17.933885 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d91ff-7940-497b-ba49-97744884109b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261a9485c3b4d2aa657a931e0388389', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:38:17.934486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d91ff-7940-497b-ba49-97744884109b service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:38:17.934761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d91ff-7940-497b-ba49-97744884109b service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:38:17.935027 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d91ff-7940-497b-ba49-97744884109b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:38:17.936730 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-011d91ff-7940-497b-ba49-97744884109b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:38:17.948283 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d91ff-7940-497b-ba49-97744884109b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:38:17.949969 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d91ff-7940-497b-ba49-97744884109b service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:38:17.960310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1396/2789] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:38:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:38:27.955981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:39:03.813330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec82f1-1118-4833-9ca6-a08695c92fc2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:03.814343 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec82f1-1118-4833-9ca6-a08695c92fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:03.814839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec82f1-1118-4833-9ca6-a08695c92fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:03.848425 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-73ec82f1-1118-4833-9ca6-a08695c92fc2 None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:39:03.849698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-73ec82f1-1118-4833-9ca6-a08695c92fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:39:03.923992 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1394/2790] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:39:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:39:04.100240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d91ff-7940-497b-ba49-97744884109b service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:39:04.103013 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-011d91ff-7940-497b-ba49-97744884109b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:39:04.178917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d91ff-7940-497b-ba49-97744884109b service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:39:04.183746 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d064077-f1cd-4511-b557-3adab214fb9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:39:04.184347 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d064077-f1cd-4511-b557-3adab214fb9a service swift] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:04.184620 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d064077-f1cd-4511-b557-3adab214fb9a service swift] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:04.184888 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d064077-f1cd-4511-b557-3adab214fb9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:04.192819 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d064077-f1cd-4511-b557-3adab214fb9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:39:04.194426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d064077-f1cd-4511-b557-3adab214fb9a service swift] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:39:04.203004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1397/2791] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:39:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 03:39:13.915439 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=32 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:39:14.199297 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=32 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:39:19.069029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b2c1-868f-4e75-93a8-ed1a57565ecb None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:19.069622 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b2c1-868f-4e75-93a8-ed1a57565ecb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:19.069622 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2b2c1-868f-4e75-93a8-ed1a57565ecb None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:19.070959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1395/2792] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:39:19.076636 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d673ab9-883f-4dc5-8fa0-19d62ebf6c08 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:19.077130 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d673ab9-883f-4dc5-8fa0-19d62ebf6c08 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:19.077252 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d673ab9-883f-4dc5-8fa0-19d62ebf6c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:19.121143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9d673ab9-883f-4dc5-8fa0-19d62ebf6c08 None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:39:19.123004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9d673ab9-883f-4dc5-8fa0-19d62ebf6c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:39:19.205359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1398/2793] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:39:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:39:19.217497 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2b2c1-868f-4e75-93a8-ed1a57565ecb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:39:19.219182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5ab2b2c1-868f-4e75-93a8-ed1a57565ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:39:19.277438 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2b2c1-868f-4e75-93a8-ed1a57565ecb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:39:19.280910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a9e27-8aef-4998-86de-a359b872cc09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f746dd2ce4404b679db81794c4d23f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:39:19.281533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a9e27-8aef-4998-86de-a359b872cc09 service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:19.281813 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a9e27-8aef-4998-86de-a359b872cc09 service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:19.282082 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a9e27-8aef-4998-86de-a359b872cc09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:19.292050 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a9e27-8aef-4998-86de-a359b872cc09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:39:19.293508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a9e27-8aef-4998-86de-a359b872cc09 service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:39:19.304072 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1396/2794] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:39:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:39:19.496445 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892963c8-f0f0-402e-990c-874948027819 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:19.496737 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892963c8-f0f0-402e-990c-874948027819 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:19.497014 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892963c8-f0f0-402e-990c-874948027819 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:19.498429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1399/2795] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:39:19.503800 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97be515-89f6-41b8-9d00-a7c3d762754e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:19.504088 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97be515-89f6-41b8-9d00-a7c3d762754e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:19.504357 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97be515-89f6-41b8-9d00-a7c3d762754e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:19.535506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d97be515-89f6-41b8-9d00-a7c3d762754e None None] MFA Rules not processed for user `5bb4ef26660244ce90b0105113e252b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:39:19.536634 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d97be515-89f6-41b8-9d00-a7c3d762754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:39:19.597428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1397/2796] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:39:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:39:19.609227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892963c8-f0f0-402e-990c-874948027819 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:39:19.611422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-892963c8-f0f0-402e-990c-874948027819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:39:19.624637 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892963c8-f0f0-402e-990c-874948027819 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:39:19.628791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a57115-86aa-4b06-a592-fc14da6b98e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:39:19.629425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a57115-86aa-4b06-a592-fc14da6b98e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:19.629705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a57115-86aa-4b06-a592-fc14da6b98e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:19.629977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a57115-86aa-4b06-a592-fc14da6b98e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:19.636874 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a57115-86aa-4b06-a592-fc14da6b98e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:39:19.638339 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a57115-86aa-4b06-a592-fc14da6b98e6 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:39:19.646234 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1400/2797] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:39:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:39:19.727264 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b47aa-7b14-400a-872b-dbe386f7081d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:19.727549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b47aa-7b14-400a-872b-dbe386f7081d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:19.727825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b47aa-7b14-400a-872b-dbe386f7081d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:19.729173 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1398/2798] 10.222.0.48 () {54 vars in 921 bytes} [Tue Sep 13 03:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 03:39:19.734494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73ca5d-ba1f-4ba0-bf6e-496d58d7c4e2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:19.734779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73ca5d-ba1f-4ba0-bf6e-496d58d7c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:19.735051 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73ca5d-ba1f-4ba0-bf6e-496d58d7c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:19.755738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8a73ca5d-ba1f-4ba0-bf6e-496d58d7c4e2 None None] MFA Rules not processed for user `fcff121c9e974a6aabaa18775de65f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:39:19.756949 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8a73ca5d-ba1f-4ba0-bf6e-496d58d7c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:39:19.766209 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1401/2799] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Sep 13 03:39:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:39:19.776293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b47aa-7b14-400a-872b-dbe386f7081d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:39:19.787259 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b47aa-7b14-400a-872b-dbe386f7081d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:39:19.790768 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52772b3-0944-4b1a-a7e5-5dfa6bfd5096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:39:19.791375 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52772b3-0944-4b1a-a7e5-5dfa6bfd5096 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:19.791652 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52772b3-0944-4b1a-a7e5-5dfa6bfd5096 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:19.791924 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52772b3-0944-4b1a-a7e5-5dfa6bfd5096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:19.802485 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52772b3-0944-4b1a-a7e5-5dfa6bfd5096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:39:19.803887 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52772b3-0944-4b1a-a7e5-5dfa6bfd5096 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:39:19.815028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1399/2800] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:39:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:39:22.067405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df49077-9fea-470e-b646-e08737965d7c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:22.067877 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df49077-9fea-470e-b646-e08737965d7c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:22.067991 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df49077-9fea-470e-b646-e08737965d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:22.088878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2df49077-9fea-470e-b646-e08737965d7c None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:39:22.090149 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2df49077-9fea-470e-b646-e08737965d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:39:22.098091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1402/2801] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:39:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:39:22.109879 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52772b3-0944-4b1a-a7e5-5dfa6bfd5096 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:39:22.120908 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52772b3-0944-4b1a-a7e5-5dfa6bfd5096 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:39:22.125822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006388e-8b2f-40b7-b45d-2ff35e0642ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:39:22.126410 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006388e-8b2f-40b7-b45d-2ff35e0642ce service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:22.126685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006388e-8b2f-40b7-b45d-2ff35e0642ce service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:22.126955 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006388e-8b2f-40b7-b45d-2ff35e0642ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:22.134784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006388e-8b2f-40b7-b45d-2ff35e0642ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:39:22.136349 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006388e-8b2f-40b7-b45d-2ff35e0642ce service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:39:22.144938 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1400/2802] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:39:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 03:39:32.081912 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=56 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:39:32.141085 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=70 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:39:37.556782 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1996b81-5f66-4518-ac06-21037155d157 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:37.557247 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1996b81-5f66-4518-ac06-21037155d157 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:37.557381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1996b81-5f66-4518-ac06-21037155d157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:37.575843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c1996b81-5f66-4518-ac06-21037155d157 None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:39:37.577020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c1996b81-5f66-4518-ac06-21037155d157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:39:37.583959 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1403/2803] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 13 03:39:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:39:37.596953 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006388e-8b2f-40b7-b45d-2ff35e0642ce service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:39:37.607377 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006388e-8b2f-40b7-b45d-2ff35e0642ce service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:39:37.612853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19ba4a-12b2-4f66-96d3-ec80a87c8303 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:39:37.613466 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19ba4a-12b2-4f66-96d3-ec80a87c8303 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:39:37.613745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19ba4a-12b2-4f66-96d3-ec80a87c8303 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:39:37.614016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19ba4a-12b2-4f66-96d3-ec80a87c8303 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:39:37.621805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19ba4a-12b2-4f66-96d3-ec80a87c8303 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:39:37.623358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19ba4a-12b2-4f66-96d3-ec80a87c8303 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:39:37.631301 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1401/2804] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:39:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 03:39:47.570611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:39:47.628045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:04.597566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1996b81-5f66-4518-ac06-21037155d157 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:04.598977 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c1996b81-5f66-4518-ac06-21037155d157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:04.610549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1996b81-5f66-4518-ac06-21037155d157 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:04.614187 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418a6c4-6771-4c65-aae5-a78a4c34aa5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:04.614778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418a6c4-6771-4c65-aae5-a78a4c34aa5b service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:04.615056 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418a6c4-6771-4c65-aae5-a78a4c34aa5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:04.615329 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418a6c4-6771-4c65-aae5-a78a4c34aa5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:04.617000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c418a6c4-6771-4c65-aae5-a78a4c34aa5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:04.630431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418a6c4-6771-4c65-aae5-a78a4c34aa5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:04.631855 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418a6c4-6771-4c65-aae5-a78a4c34aa5b service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:04.642665 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1404/2805] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:40:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:40:05.820636 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19ba4a-12b2-4f66-96d3-ec80a87c8303 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:05.829948 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19ba4a-12b2-4f66-96d3-ec80a87c8303 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:05.833449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19b070-8bb4-46c0-8f7a-f15768e8cb13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:05.834031 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19b070-8bb4-46c0-8f7a-f15768e8cb13 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:05.834307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19b070-8bb4-46c0-8f7a-f15768e8cb13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:05.834574 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19b070-8bb4-46c0-8f7a-f15768e8cb13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:05.836246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bb19b070-8bb4-46c0-8f7a-f15768e8cb13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:05.849770 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19b070-8bb4-46c0-8f7a-f15768e8cb13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:05.851176 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19b070-8bb4-46c0-8f7a-f15768e8cb13 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:05.861790 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1402/2806] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:40:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:40:14.637851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=6 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:15.514177 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418a6c4-6771-4c65-aae5-a78a4c34aa5b service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:15.515649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c418a6c4-6771-4c65-aae5-a78a4c34aa5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:15.530609 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418a6c4-6771-4c65-aae5-a78a4c34aa5b service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:15.536330 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fd7c5-844f-40ae-8975-a736284d910b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:15.536927 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fd7c5-844f-40ae-8975-a736284d910b service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:15.537202 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fd7c5-844f-40ae-8975-a736284d910b service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:15.537502 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fd7c5-844f-40ae-8975-a736284d910b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:15.539215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-355fd7c5-844f-40ae-8975-a736284d910b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:15.599770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fd7c5-844f-40ae-8975-a736284d910b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:15.601409 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fd7c5-844f-40ae-8975-a736284d910b service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:15.610509 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1405/2807] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:40:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:40:15.857079 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:20.203617 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19b070-8bb4-46c0-8f7a-f15768e8cb13 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:20.212358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19b070-8bb4-46c0-8f7a-f15768e8cb13 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:20.215963 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a915bf-82c9-45bb-a0ae-cd9225c884a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:20.217638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a915bf-82c9-45bb-a0ae-cd9225c884a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:20.217638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a915bf-82c9-45bb-a0ae-cd9225c884a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:20.217638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a915bf-82c9-45bb-a0ae-cd9225c884a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:20.218856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-89a915bf-82c9-45bb-a0ae-cd9225c884a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:20.303062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a915bf-82c9-45bb-a0ae-cd9225c884a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:20.304486 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a915bf-82c9-45bb-a0ae-cd9225c884a1 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:20.322838 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1403/2808] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:40:23.890275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fd7c5-844f-40ae-8975-a736284d910b service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:23.894506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-355fd7c5-844f-40ae-8975-a736284d910b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:23.906465 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fd7c5-844f-40ae-8975-a736284d910b service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:23.911167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892b64f-6997-4c6b-ba91-e0aba20e1f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:23.911907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892b64f-6997-4c6b-ba91-e0aba20e1f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:23.912193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892b64f-6997-4c6b-ba91-e0aba20e1f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:23.912528 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892b64f-6997-4c6b-ba91-e0aba20e1f2d admin admin] PATH_INFO: `/v3/users/ec3ab00d1b2c498aa0160a0fa044e7e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:23.913702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892b64f-6997-4c6b-ba91-e0aba20e1f2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3ab00d1b2c498aa0160a0fa044e7e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:23.915659 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892b64f-6997-4c6b-ba91-e0aba20e1f2d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:24.057568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9892b64f-6997-4c6b-ba91-e0aba20e1f2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3ab00d1b2c498aa0160a0fa044e7e0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:24.058223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9892b64f-6997-4c6b-ba91-e0aba20e1f2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3ab00d1b2c498aa0160a0fa044e7e0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:24.058820 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9892b64f-6997-4c6b-ba91-e0aba20e1f2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3ab00d1b2c498aa0160a0fa044e7e0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:24.065959 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9892b64f-6997-4c6b-ba91-e0aba20e1f2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3ab00d1b2c498aa0160a0fa044e7e0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:24.078757 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9892b64f-6997-4c6b-ba91-e0aba20e1f2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3ab00d1b2c498aa0160a0fa044e7e0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:24.140274 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1406/2809] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:40:23 2022] DELETE /identity/v3/users/ec3ab00d1b2c498aa0160a0fa044e7e0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:24.381559 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a915bf-82c9-45bb-a0ae-cd9225c884a1 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:24.391476 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a915bf-82c9-45bb-a0ae-cd9225c884a1 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:24.448987 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad8e31-7b33-4c86-86b1-f25b8b741904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:24.449645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad8e31-7b33-4c86-86b1-f25b8b741904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:24.449921 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad8e31-7b33-4c86-86b1-f25b8b741904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:24.450189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad8e31-7b33-4c86-86b1-f25b8b741904 admin admin] PATH_INFO: `/v3/projects/9c9267f228cd406e900c81c80a0a610b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:24.451289 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad8e31-7b33-4c86-86b1-f25b8b741904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c9267f228cd406e900c81c80a0a610b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:24.453171 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad8e31-7b33-4c86-86b1-f25b8b741904 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:24.574895 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-46ad8e31-7b33-4c86-86b1-f25b8b741904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c9267f228cd406e900c81c80a0a610b', 'request_id': 'req-46ad8e31-7b33-4c86-86b1-f25b8b741904'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:24.581046 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-46ad8e31-7b33-4c86-86b1-f25b8b741904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c9267f228cd406e900c81c80a0a610b', 'request_id': 'req-46ad8e31-7b33-4c86-86b1-f25b8b741904'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:24.654482 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-46ad8e31-7b33-4c86-86b1-f25b8b741904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c9267f228cd406e900c81c80a0a610b', 'request_id': 'req-46ad8e31-7b33-4c86-86b1-f25b8b741904'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:24.659580 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:24.666215 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-46ad8e31-7b33-4c86-86b1-f25b8b741904 admin admin] The token cache is being invalidate because project 9c9267f228cd406e900c81c80a0a610b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:40:24.666494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-46ad8e31-7b33-4c86-86b1-f25b8b741904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:24.667186 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-46ad8e31-7b33-4c86-86b1-f25b8b741904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:24.668641 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1404/2810] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:40:24 2022] DELETE /identity/v3/projects/9c9267f228cd406e900c81c80a0a610b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:24.673549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668916-3fb5-46e6-b367-cb8d79b9fd1c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:24.673855 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668916-3fb5-46e6-b367-cb8d79b9fd1c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:24.674117 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2668916-3fb5-46e6-b367-cb8d79b9fd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:24.721514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b2668916-3fb5-46e6-b367-cb8d79b9fd1c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:24.722724 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b2668916-3fb5-46e6-b367-cb8d79b9fd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:24.766400 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:24.781790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1407/2811] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:24.790664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520723cd-820d-4c03-b439-66002dc52de9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:24.791058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520723cd-820d-4c03-b439-66002dc52de9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:24.791409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520723cd-820d-4c03-b439-66002dc52de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:24.810516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-520723cd-820d-4c03-b439-66002dc52de9 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:24.811698 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-520723cd-820d-4c03-b439-66002dc52de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:24.820043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1405/2812] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:24.823925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2668916-3fb5-46e6-b367-cb8d79b9fd1c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:24.833823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2668916-3fb5-46e6-b367-cb8d79b9fd1c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:24.838690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a3650-579f-422d-bf34-d7daa5e8b368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:24.839275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a3650-579f-422d-bf34-d7daa5e8b368 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:24.839558 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a3650-579f-422d-bf34-d7daa5e8b368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:24.839829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a3650-579f-422d-bf34-d7daa5e8b368 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:24.840469 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a3650-579f-422d-bf34-d7daa5e8b368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:40:24.840771 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a3650-579f-422d-bf34-d7daa5e8b368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:24.842490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a3650-579f-422d-bf34-d7daa5e8b368 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:24.855172 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1408/2813] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:40:24.859417 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520723cd-820d-4c03-b439-66002dc52de9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:24.868571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520723cd-820d-4c03-b439-66002dc52de9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:24.873285 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df754d-1c65-41e5-85e1-5fc0ad53d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:24.873888 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df754d-1c65-41e5-85e1-5fc0ad53d521 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:24.874162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df754d-1c65-41e5-85e1-5fc0ad53d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:24.874431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df754d-1c65-41e5-85e1-5fc0ad53d521 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:24.875059 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df754d-1c65-41e5-85e1-5fc0ad53d521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:24.876929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df754d-1c65-41e5-85e1-5fc0ad53d521 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:24.959258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1406/2814] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:40:24 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:40:24.963672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a3650-579f-422d-bf34-d7daa5e8b368 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:24.974487 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a3650-579f-422d-bf34-d7daa5e8b368 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:25.029425 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117eb4ee-6bdb-494b-9bea-2897248c9fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:25.030019 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eb4ee-6bdb-494b-9bea-2897248c9fef admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:25.030296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eb4ee-6bdb-494b-9bea-2897248c9fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:25.030560 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eb4ee-6bdb-494b-9bea-2897248c9fef admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:25.031208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117eb4ee-6bdb-494b-9bea-2897248c9fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:25.033113 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117eb4ee-6bdb-494b-9bea-2897248c9fef admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:25.122979 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1409/2815] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:40:24 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:40:25.127209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df754d-1c65-41e5-85e1-5fc0ad53d521 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:25.138286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df754d-1c65-41e5-85e1-5fc0ad53d521 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:25.143041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80790c43-28b2-49d4-a4e3-91b6da59d7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:25.146555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80790c43-28b2-49d4-a4e3-91b6da59d7bd admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:25.146555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80790c43-28b2-49d4-a4e3-91b6da59d7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:25.146555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80790c43-28b2-49d4-a4e3-91b6da59d7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:25.146555 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80790c43-28b2-49d4-a4e3-91b6da59d7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:25.147061 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80790c43-28b2-49d4-a4e3-91b6da59d7bd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:25.157553 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1407/2816] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:40:25.161608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117eb4ee-6bdb-494b-9bea-2897248c9fef admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:25.171843 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117eb4ee-6bdb-494b-9bea-2897248c9fef admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:25.176437 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206175f-fe91-4ba3-af63-f3096f4bcbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:25.177026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206175f-fe91-4ba3-af63-f3096f4bcbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:25.177334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206175f-fe91-4ba3-af63-f3096f4bcbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:25.177607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206175f-fe91-4ba3-af63-f3096f4bcbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:25.178264 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206175f-fe91-4ba3-af63-f3096f4bcbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:25.179874 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206175f-fe91-4ba3-af63-f3096f4bcbb6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:25.189591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1410/2817] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:40:25.194000 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80790c43-28b2-49d4-a4e3-91b6da59d7bd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:25.203760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80790c43-28b2-49d4-a4e3-91b6da59d7bd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:25.208941 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54077bcb-2f06-4ce9-84bf-72599ba884d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:25.209663 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54077bcb-2f06-4ce9-84bf-72599ba884d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:25.209888 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54077bcb-2f06-4ce9-84bf-72599ba884d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:25.210165 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54077bcb-2f06-4ce9-84bf-72599ba884d2 admin admin] PATH_INFO: `/v3/projects/d16fd8c695e34f318ccade7b7987c667/users/53742051ea434ef9ab47f960cb2740c9/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:25.225046 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54077bcb-2f06-4ce9-84bf-72599ba884d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16fd8c695e34f318ccade7b7987c667, user_id=53742051ea434ef9ab47f960cb2740c9, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:25.227784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54077bcb-2f06-4ce9-84bf-72599ba884d2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:25.294561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1408/2818] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:40:25 2022] PUT /identity/v3/projects/d16fd8c695e34f318ccade7b7987c667/users/53742051ea434ef9ab47f960cb2740c9/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:25.304952 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76e2a-f6ed-4208-9285-ddb9a2a87f24 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:25.305228 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76e2a-f6ed-4208-9285-ddb9a2a87f24 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:25.305534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76e2a-f6ed-4208-9285-ddb9a2a87f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:25.332944 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c4e76e2a-f6ed-4208-9285-ddb9a2a87f24 None None] MFA Rules not processed for user `53742051ea434ef9ab47f960cb2740c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:25.334793 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c4e76e2a-f6ed-4208-9285-ddb9a2a87f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:25.397502 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1411/2819] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:25.401857 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54077bcb-2f06-4ce9-84bf-72599ba884d2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:25.463418 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54077bcb-2f06-4ce9-84bf-72599ba884d2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:25.468022 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1041883-0591-4ca7-9158-710ad2e7d2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:25.468614 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1041883-0591-4ca7-9158-710ad2e7d2ff admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:25.468890 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1041883-0591-4ca7-9158-710ad2e7d2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:25.469158 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1041883-0591-4ca7-9158-710ad2e7d2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:25.469803 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1041883-0591-4ca7-9158-710ad2e7d2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:25.471807 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1041883-0591-4ca7-9158-710ad2e7d2ff admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:25.530135 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1409/2820] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:40:25 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:40:25.535928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e76e2a-f6ed-4208-9285-ddb9a2a87f24 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:25.545429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e76e2a-f6ed-4208-9285-ddb9a2a87f24 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:25.586607 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:25.600958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191a0b5-f3df-4447-81f4-405fa286a77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:25.601591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191a0b5-f3df-4447-81f4-405fa286a77b admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:25.601932 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191a0b5-f3df-4447-81f4-405fa286a77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:25.602208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191a0b5-f3df-4447-81f4-405fa286a77b admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:25.602834 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191a0b5-f3df-4447-81f4-405fa286a77b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:25.604859 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191a0b5-f3df-4447-81f4-405fa286a77b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:25.683923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1412/2821] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:40:25 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:40:25.687899 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1041883-0591-4ca7-9158-710ad2e7d2ff admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:25.698976 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1041883-0591-4ca7-9158-710ad2e7d2ff admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:25.703554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc71e0-0c57-4089-b36c-f5e5964adc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:25.704146 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc71e0-0c57-4089-b36c-f5e5964adc1f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:25.704428 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc71e0-0c57-4089-b36c-f5e5964adc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:25.704702 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc71e0-0c57-4089-b36c-f5e5964adc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:25.705373 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc71e0-0c57-4089-b36c-f5e5964adc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:25.706958 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc71e0-0c57-4089-b36c-f5e5964adc1f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:25.717749 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1410/2822] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:40:25.721905 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191a0b5-f3df-4447-81f4-405fa286a77b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:25.731897 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191a0b5-f3df-4447-81f4-405fa286a77b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:25.736440 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cc944-3bf1-40e8-8332-afbed409c931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:25.737082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cc944-3bf1-40e8-8332-afbed409c931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:25.737405 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cc944-3bf1-40e8-8332-afbed409c931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:25.737679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cc944-3bf1-40e8-8332-afbed409c931 admin admin] PATH_INFO: `/v3/projects/621d3f87d98d4d8ebbbe65f7a816bd96/users/f000c190fc544b9e8b11280bc1f441e7/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:25.752476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cc944-3bf1-40e8-8332-afbed409c931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621d3f87d98d4d8ebbbe65f7a816bd96, user_id=f000c190fc544b9e8b11280bc1f441e7, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:25.755799 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cc944-3bf1-40e8-8332-afbed409c931 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:25.826091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1413/2823] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:40:25 2022] PUT /identity/v3/projects/621d3f87d98d4d8ebbbe65f7a816bd96/users/f000c190fc544b9e8b11280bc1f441e7/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:25.830131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc71e0-0c57-4089-b36c-f5e5964adc1f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:25.840241 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc71e0-0c57-4089-b36c-f5e5964adc1f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:25.890053 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:25.895820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9e54a-17f0-40f8-a4c5-6180b5335e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:25.896419 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9e54a-17f0-40f8-a4c5-6180b5335e28 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:25.896705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9e54a-17f0-40f8-a4c5-6180b5335e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:25.896979 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9e54a-17f0-40f8-a4c5-6180b5335e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:25.902256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9e54a-17f0-40f8-a4c5-6180b5335e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:25.902256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9e54a-17f0-40f8-a4c5-6180b5335e28 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:25.908855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1411/2824] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:40:25.913514 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cc944-3bf1-40e8-8332-afbed409c931 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:25.923716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cc944-3bf1-40e8-8332-afbed409c931 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:25.930942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23033b-15e2-4fe7-8ff2-396f512522fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:25.930942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23033b-15e2-4fe7-8ff2-396f512522fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:25.930942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23033b-15e2-4fe7-8ff2-396f512522fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:25.930942 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23033b-15e2-4fe7-8ff2-396f512522fd admin admin] PATH_INFO: `/v3/projects/621d3f87d98d4d8ebbbe65f7a816bd96/users/f000c190fc544b9e8b11280bc1f441e7/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:25.932536 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23033b-15e2-4fe7-8ff2-396f512522fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=621d3f87d98d4d8ebbbe65f7a816bd96, user_id=f000c190fc544b9e8b11280bc1f441e7, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:25.935223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23033b-15e2-4fe7-8ff2-396f512522fd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:25.945694 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1414/2825] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:40:25 2022] PUT /identity/v3/projects/621d3f87d98d4d8ebbbe65f7a816bd96/users/f000c190fc544b9e8b11280bc1f441e7/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:25.956767 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f98a9-98b8-4002-9348-08604b5f7cba None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:25.957062 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f98a9-98b8-4002-9348-08604b5f7cba None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:25.957366 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f98a9-98b8-4002-9348-08604b5f7cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:25.985547 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-479f98a9-98b8-4002-9348-08604b5f7cba None None] MFA Rules not processed for user `f000c190fc544b9e8b11280bc1f441e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:25.988475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-479f98a9-98b8-4002-9348-08604b5f7cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:26.055024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1412/2826] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:26.066187 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23033b-15e2-4fe7-8ff2-396f512522fd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:26.068449 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9d23033b-15e2-4fe7-8ff2-396f512522fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:26.145509 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23033b-15e2-4fe7-8ff2-396f512522fd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:26.149807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295ee89-ece3-4d6c-afe4-fa5f686e1291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:26.150404 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ee89-ece3-4d6c-afe4-fa5f686e1291 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:26.150678 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ee89-ece3-4d6c-afe4-fa5f686e1291 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:26.150943 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ee89-ece3-4d6c-afe4-fa5f686e1291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:26.159971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295ee89-ece3-4d6c-afe4-fa5f686e1291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:26.161948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295ee89-ece3-4d6c-afe4-fa5f686e1291 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:26.174103 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1415/2827] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:40:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:40:26.439589 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f98a9-98b8-4002-9348-08604b5f7cba None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:26.450464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f98a9-98b8-4002-9348-08604b5f7cba None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:26.453864 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b320db-e1e8-4d10-8275-aa3875c341ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:26.454455 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b320db-e1e8-4d10-8275-aa3875c341ad service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:26.454731 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b320db-e1e8-4d10-8275-aa3875c341ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:26.454998 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b320db-e1e8-4d10-8275-aa3875c341ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:26.511206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b320db-e1e8-4d10-8275-aa3875c341ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:26.512631 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b320db-e1e8-4d10-8275-aa3875c341ad service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:26.522229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1413/2828] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:40:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:40:29.875351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295ee89-ece3-4d6c-afe4-fa5f686e1291 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:29.936476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295ee89-ece3-4d6c-afe4-fa5f686e1291 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:29.941217 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:29.941870 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:29.942147 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:29.942417 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] PATH_INFO: `/v3/users/53742051ea434ef9ab47f960cb2740c9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:29.943549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=53742051ea434ef9ab47f960cb2740c9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:29.945503 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:29.967641 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:30.085792 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53742051ea434ef9ab47f960cb2740c9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:30.086689 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53742051ea434ef9ab47f960cb2740c9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:30.087283 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53742051ea434ef9ab47f960cb2740c9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:30.094283 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53742051ea434ef9ab47f960cb2740c9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:30.106840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53742051ea434ef9ab47f960cb2740c9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:30.157670 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1416/2829] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:40:29 2022] DELETE /identity/v3/users/53742051ea434ef9ab47f960cb2740c9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:30.167986 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da1a15-c97f-4856-866c-3b0a2dc7f446 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:30.168431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da1a15-c97f-4856-866c-3b0a2dc7f446 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:30.168542 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da1a15-c97f-4856-866c-3b0a2dc7f446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:30.187317 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-45da1a15-c97f-4856-866c-3b0a2dc7f446 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:30.188527 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-45da1a15-c97f-4856-866c-3b0a2dc7f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:30.246219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1414/2830] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:30.255889 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:30.257341 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:30.313552 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282905ed-fd59-4d07-9025-607bce5405bc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:30.317183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e01dd6-0ef9-4ad6-9c15-9081d2ac1a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:30.317815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e01dd6-0ef9-4ad6-9c15-9081d2ac1a67 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:30.318092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e01dd6-0ef9-4ad6-9c15-9081d2ac1a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:30.318362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e01dd6-0ef9-4ad6-9c15-9081d2ac1a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:30.327408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e01dd6-0ef9-4ad6-9c15-9081d2ac1a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:30.328856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e01dd6-0ef9-4ad6-9c15-9081d2ac1a67 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:30.339022 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1417/2831] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:40:30.696983 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da1a15-c97f-4856-866c-3b0a2dc7f446 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:30.702314 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-45da1a15-c97f-4856-866c-3b0a2dc7f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:30.715036 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da1a15-c97f-4856-866c-3b0a2dc7f446 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:30.721116 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:30.721943 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:30.722179 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:30.722425 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] PATH_INFO: `/v3/projects/d16fd8c695e34f318ccade7b7987c667` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:30.723620 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16fd8c695e34f318ccade7b7987c667)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:30.725755 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:30.737429 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:30.809033 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16fd8c695e34f318ccade7b7987c667', 'request_id': 'req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:30.815335 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16fd8c695e34f318ccade7b7987c667', 'request_id': 'req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:30.872293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16fd8c695e34f318ccade7b7987c667', 'request_id': 'req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:30.884077 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] The token cache is being invalidate because project d16fd8c695e34f318ccade7b7987c667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:40:30.884365 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:30.885058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:30.886572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1415/2832] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:40:30 2022] DELETE /identity/v3/projects/d16fd8c695e34f318ccade7b7987c667 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:30.890517 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e01dd6-0ef9-4ad6-9c15-9081d2ac1a67 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:30.902581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e01dd6-0ef9-4ad6-9c15-9081d2ac1a67 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:30.959238 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2450c-1053-42e4-8702-ca35730f0784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:30.959780 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2450c-1053-42e4-8702-ca35730f0784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:30.960054 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2450c-1053-42e4-8702-ca35730f0784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:30.960321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2450c-1053-42e4-8702-ca35730f0784 admin admin] PATH_INFO: `/v3/users/f000c190fc544b9e8b11280bc1f441e7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:30.961710 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2450c-1053-42e4-8702-ca35730f0784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f000c190fc544b9e8b11280bc1f441e7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:30.963614 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2450c-1053-42e4-8702-ca35730f0784 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:31.117966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:31.120272 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2bb2450c-1053-42e4-8702-ca35730f0784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f000c190fc544b9e8b11280bc1f441e7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:31.120924 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2bb2450c-1053-42e4-8702-ca35730f0784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f000c190fc544b9e8b11280bc1f441e7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:31.121706 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2bb2450c-1053-42e4-8702-ca35730f0784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f000c190fc544b9e8b11280bc1f441e7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:31.128608 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2bb2450c-1053-42e4-8702-ca35730f0784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f000c190fc544b9e8b11280bc1f441e7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:31.142073 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2bb2450c-1053-42e4-8702-ca35730f0784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f000c190fc544b9e8b11280bc1f441e7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:31.244225 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1418/2833] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:40:30 2022] DELETE /identity/v3/users/f000c190fc544b9e8b11280bc1f441e7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:40:31.639276 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:31.640766 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:31.653929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae2bf1-ea2c-4b12-9bed-85ae9da8416d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:31.710058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:31.710685 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:31.710964 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:31.711488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f admin admin] PATH_INFO: `/v3/projects/621d3f87d98d4d8ebbbe65f7a816bd96` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:31.712608 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f admin admin] RBAC: Authorizing `identity:delete_project(project_id=621d3f87d98d4d8ebbbe65f7a816bd96)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:31.714547 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:31.809549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621d3f87d98d4d8ebbbe65f7a816bd96', 'request_id': 'req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:31.815508 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621d3f87d98d4d8ebbbe65f7a816bd96', 'request_id': 'req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:31.877595 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621d3f87d98d4d8ebbbe65f7a816bd96', 'request_id': 'req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:31.888117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f admin admin] The token cache is being invalidate because project 621d3f87d98d4d8ebbbe65f7a816bd96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:40:31.888405 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:31.889016 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-20f9a082-3a4e-4d66-9a88-ddf1a02be96f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:31.890480 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1416/2834] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:40:31 2022] DELETE /identity/v3/projects/621d3f87d98d4d8ebbbe65f7a816bd96 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:31.895454 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16b7bd-705e-47c4-82f6-aa3719b4bf58 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:31.895925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16b7bd-705e-47c4-82f6-aa3719b4bf58 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:31.896031 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16b7bd-705e-47c4-82f6-aa3719b4bf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:31.915953 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1e16b7bd-705e-47c4-82f6-aa3719b4bf58 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:31.917200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1e16b7bd-705e-47c4-82f6-aa3719b4bf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:31.974373 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1419/2835] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:31.982678 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332057c4-471b-43d1-8149-a3a25f2a2915 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:31.982962 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332057c4-471b-43d1-8149-a3a25f2a2915 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:31.983237 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332057c4-471b-43d1-8149-a3a25f2a2915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:32.003117 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-332057c4-471b-43d1-8149-a3a25f2a2915 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:32.004303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-332057c4-471b-43d1-8149-a3a25f2a2915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:32.012057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1417/2836] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:32.016200 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16b7bd-705e-47c4-82f6-aa3719b4bf58 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:32.026042 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16b7bd-705e-47c4-82f6-aa3719b4bf58 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:32.030672 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978258b-be89-4226-98af-b1c268b11ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:32.031296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978258b-be89-4226-98af-b1c268b11ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:32.031577 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978258b-be89-4226-98af-b1c268b11ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:32.031851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978258b-be89-4226-98af-b1c268b11ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:32.032496 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978258b-be89-4226-98af-b1c268b11ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:40:32.032801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978258b-be89-4226-98af-b1c268b11ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:32.034441 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978258b-be89-4226-98af-b1c268b11ee4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:32.046323 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1420/2837] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:40:32.050536 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332057c4-471b-43d1-8149-a3a25f2a2915 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:32.060341 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332057c4-471b-43d1-8149-a3a25f2a2915 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:32.064900 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a810f2-ac5a-46d8-8fdd-37844e14fb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:32.065511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a810f2-ac5a-46d8-8fdd-37844e14fb46 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:32.065791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a810f2-ac5a-46d8-8fdd-37844e14fb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:32.066065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a810f2-ac5a-46d8-8fdd-37844e14fb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:32.066683 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a810f2-ac5a-46d8-8fdd-37844e14fb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:32.068571 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a810f2-ac5a-46d8-8fdd-37844e14fb46 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:32.182464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1418/2838] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:40:32 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:40:32.186653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978258b-be89-4226-98af-b1c268b11ee4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:32.197515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978258b-be89-4226-98af-b1c268b11ee4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:32.252812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec800d8c-d22b-42d7-ae40-f00cbc82d1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:32.253486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec800d8c-d22b-42d7-ae40-f00cbc82d1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:32.253770 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec800d8c-d22b-42d7-ae40-f00cbc82d1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:32.254044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec800d8c-d22b-42d7-ae40-f00cbc82d1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:32.254681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec800d8c-d22b-42d7-ae40-f00cbc82d1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:32.257246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec800d8c-d22b-42d7-ae40-f00cbc82d1a5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:32.368865 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1421/2839] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:40:32 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:40:32.373174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a810f2-ac5a-46d8-8fdd-37844e14fb46 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:32.378785 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:32.384302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a810f2-ac5a-46d8-8fdd-37844e14fb46 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:32.388862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf30299-1366-49cb-bce5-754884fd1328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:32.389494 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf30299-1366-49cb-bce5-754884fd1328 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:32.389771 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf30299-1366-49cb-bce5-754884fd1328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:32.390045 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf30299-1366-49cb-bce5-754884fd1328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:32.390767 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf30299-1366-49cb-bce5-754884fd1328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:32.392300 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf30299-1366-49cb-bce5-754884fd1328 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:32.402588 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1419/2840] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:40:32.406591 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec800d8c-d22b-42d7-ae40-f00cbc82d1a5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:32.417501 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec800d8c-d22b-42d7-ae40-f00cbc82d1a5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:32.422137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fe0a4-ff88-4138-a9f7-8e3151be9303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:32.424756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fe0a4-ff88-4138-a9f7-8e3151be9303 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:32.424756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fe0a4-ff88-4138-a9f7-8e3151be9303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:32.424756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fe0a4-ff88-4138-a9f7-8e3151be9303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:32.424756 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fe0a4-ff88-4138-a9f7-8e3151be9303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:32.425630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fe0a4-ff88-4138-a9f7-8e3151be9303 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:32.436351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1422/2841] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:40:32.440379 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf30299-1366-49cb-bce5-754884fd1328 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:32.450535 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf30299-1366-49cb-bce5-754884fd1328 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:32.455017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1497b5-cc4b-4ecd-bd29-f1e5f7cadeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:32.455654 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1497b5-cc4b-4ecd-bd29-f1e5f7cadeed admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:32.455928 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1497b5-cc4b-4ecd-bd29-f1e5f7cadeed admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:32.456196 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1497b5-cc4b-4ecd-bd29-f1e5f7cadeed admin admin] PATH_INFO: `/v3/projects/87550889b2c94a468b0bc9fb6ba413ee/users/de7062952e634f6f81133783515ccc4b/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:32.471617 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1497b5-cc4b-4ecd-bd29-f1e5f7cadeed admin admin] RBAC: Authorizing `identity:create_grant(project_id=87550889b2c94a468b0bc9fb6ba413ee, user_id=de7062952e634f6f81133783515ccc4b, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:32.474436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1497b5-cc4b-4ecd-bd29-f1e5f7cadeed admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:32.575578 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1420/2842] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:40:32 2022] PUT /identity/v3/projects/87550889b2c94a468b0bc9fb6ba413ee/users/de7062952e634f6f81133783515ccc4b/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:40:32.587174 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05916ab0-5dbd-4a33-bcbe-790efd8b976c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:32.587468 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05916ab0-5dbd-4a33-bcbe-790efd8b976c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:32.587738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05916ab0-5dbd-4a33-bcbe-790efd8b976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:32.616741 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-05916ab0-5dbd-4a33-bcbe-790efd8b976c None None] MFA Rules not processed for user `de7062952e634f6f81133783515ccc4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:32.617990 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-05916ab0-5dbd-4a33-bcbe-790efd8b976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:32.630497 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:32.682736 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1423/2843] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:32.687312 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1497b5-cc4b-4ecd-bd29-f1e5f7cadeed admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:32.748934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1497b5-cc4b-4ecd-bd29-f1e5f7cadeed admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:32.753687 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eadc3-4b9b-4db0-b153-f8205d64f01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:32.754285 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eadc3-4b9b-4db0-b153-f8205d64f01f admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:32.754564 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eadc3-4b9b-4db0-b153-f8205d64f01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:32.754836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eadc3-4b9b-4db0-b153-f8205d64f01f admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:32.755492 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45eadc3-4b9b-4db0-b153-f8205d64f01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:32.757517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45eadc3-4b9b-4db0-b153-f8205d64f01f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:32.850014 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1421/2844] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:40:32 2022] POST /identity/v3/projects => generated 391 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:40:32.854170 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05916ab0-5dbd-4a33-bcbe-790efd8b976c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:32.864663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05916ab0-5dbd-4a33-bcbe-790efd8b976c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:32.919549 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507fb27-997e-4272-8669-ffbe6e987893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:32.920185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507fb27-997e-4272-8669-ffbe6e987893 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:32.920362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507fb27-997e-4272-8669-ffbe6e987893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:32.920632 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507fb27-997e-4272-8669-ffbe6e987893 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:32.921246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507fb27-997e-4272-8669-ffbe6e987893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:32.923191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507fb27-997e-4272-8669-ffbe6e987893 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:32.998442 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1424/2845] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:40:32 2022] POST /identity/v3/users => generated 302 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:40:33.002493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eadc3-4b9b-4db0-b153-f8205d64f01f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:33.013524 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eadc3-4b9b-4db0-b153-f8205d64f01f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:33.018224 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8e23c-e00d-45bd-9b32-7c7e90f0a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:33.018825 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8e23c-e00d-45bd-9b32-7c7e90f0a09e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:33.019110 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8e23c-e00d-45bd-9b32-7c7e90f0a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:33.019383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8e23c-e00d-45bd-9b32-7c7e90f0a09e admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:33.020018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8e23c-e00d-45bd-9b32-7c7e90f0a09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:33.021645 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8e23c-e00d-45bd-9b32-7c7e90f0a09e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:33.032181 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1422/2846] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:40:33.036336 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507fb27-997e-4272-8669-ffbe6e987893 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:33.046328 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507fb27-997e-4272-8669-ffbe6e987893 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:33.050879 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749a335-fdf4-404a-8d56-8c00cf6e402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:33.051520 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749a335-fdf4-404a-8d56-8c00cf6e402d admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:33.051805 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749a335-fdf4-404a-8d56-8c00cf6e402d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:33.052080 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749a335-fdf4-404a-8d56-8c00cf6e402d admin admin] PATH_INFO: `/v3/projects/2c29749ac99449ff82b9aee15c8e694e/users/0e605c9f2e5a4e528f8ba843890b1440/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:33.067099 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749a335-fdf4-404a-8d56-8c00cf6e402d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c29749ac99449ff82b9aee15c8e694e, user_id=0e605c9f2e5a4e528f8ba843890b1440, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:33.070367 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749a335-fdf4-404a-8d56-8c00cf6e402d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:33.170382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1425/2847] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:40:33 2022] PUT /identity/v3/projects/2c29749ac99449ff82b9aee15c8e694e/users/0e605c9f2e5a4e528f8ba843890b1440/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:33.174393 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8e23c-e00d-45bd-9b32-7c7e90f0a09e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:33.184368 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8e23c-e00d-45bd-9b32-7c7e90f0a09e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:33.240960 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373803f2-d36f-48a5-9224-2b6da5526531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:33.241584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373803f2-d36f-48a5-9224-2b6da5526531 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:33.241862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373803f2-d36f-48a5-9224-2b6da5526531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:33.242128 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373803f2-d36f-48a5-9224-2b6da5526531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:33.242750 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373803f2-d36f-48a5-9224-2b6da5526531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:33.244336 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373803f2-d36f-48a5-9224-2b6da5526531 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:33.253816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1423/2848] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:40:33.257992 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749a335-fdf4-404a-8d56-8c00cf6e402d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:33.268275 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749a335-fdf4-404a-8d56-8c00cf6e402d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:33.273398 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001d26c-f79e-47bb-b8e7-3aa2a971553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:33.274084 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001d26c-f79e-47bb-b8e7-3aa2a971553c admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:33.274362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001d26c-f79e-47bb-b8e7-3aa2a971553c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:33.274637 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001d26c-f79e-47bb-b8e7-3aa2a971553c admin admin] PATH_INFO: `/v3/projects/2c29749ac99449ff82b9aee15c8e694e/users/0e605c9f2e5a4e528f8ba843890b1440/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:33.276575 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001d26c-f79e-47bb-b8e7-3aa2a971553c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c29749ac99449ff82b9aee15c8e694e, user_id=0e605c9f2e5a4e528f8ba843890b1440, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:33.279271 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001d26c-f79e-47bb-b8e7-3aa2a971553c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:33.290000 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1426/2849] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:40:33 2022] PUT /identity/v3/projects/2c29749ac99449ff82b9aee15c8e694e/users/0e605c9f2e5a4e528f8ba843890b1440/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:33.299862 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550f4ba-e8bb-493f-b562-07df3a17c13a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:33.300149 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550f4ba-e8bb-493f-b562-07df3a17c13a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:33.300427 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550f4ba-e8bb-493f-b562-07df3a17c13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:33.328053 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e550f4ba-e8bb-493f-b562-07df3a17c13a None None] MFA Rules not processed for user `0e605c9f2e5a4e528f8ba843890b1440`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:33.329404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e550f4ba-e8bb-493f-b562-07df3a17c13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:33.355780 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:33.398079 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1424/2850] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:33 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:33.408789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001d26c-f79e-47bb-b8e7-3aa2a971553c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:33.410554 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7001d26c-f79e-47bb-b8e7-3aa2a971553c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:33.468161 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001d26c-f79e-47bb-b8e7-3aa2a971553c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:33.471782 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1cfae-8688-4e2d-ac08-6a15b6313fb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:33.472377 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1cfae-8688-4e2d-ac08-6a15b6313fb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:33.472653 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1cfae-8688-4e2d-ac08-6a15b6313fb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:33.472925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1cfae-8688-4e2d-ac08-6a15b6313fb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:33.481848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1cfae-8688-4e2d-ac08-6a15b6313fb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:33.483274 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1cfae-8688-4e2d-ac08-6a15b6313fb0 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:33.492812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1427/2851] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:40:33 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:40:33.539017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550f4ba-e8bb-493f-b562-07df3a17c13a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:33.540402 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e550f4ba-e8bb-493f-b562-07df3a17c13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:33.552353 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550f4ba-e8bb-493f-b562-07df3a17c13a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:33.556124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed474f1-87b3-4940-9f07-fe3f433438ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:33.556711 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed474f1-87b3-4940-9f07-fe3f433438ff service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:33.556988 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed474f1-87b3-4940-9f07-fe3f433438ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:33.557283 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed474f1-87b3-4940-9f07-fe3f433438ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:33.613098 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed474f1-87b3-4940-9f07-fe3f433438ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:33.614549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed474f1-87b3-4940-9f07-fe3f433438ff service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:33.623304 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1425/2852] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:40:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:40:38.229781 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1cfae-8688-4e2d-ac08-6a15b6313fb0 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:38.242224 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:38.291183 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1cfae-8688-4e2d-ac08-6a15b6313fb0 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:38.295764 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:38.296387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:38.296666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:38.296940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] PATH_INFO: `/v3/users/de7062952e634f6f81133783515ccc4b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:38.298102 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7062952e634f6f81133783515ccc4b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:38.300082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:38.451311 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7062952e634f6f81133783515ccc4b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:38.451882 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7062952e634f6f81133783515ccc4b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:38.452490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7062952e634f6f81133783515ccc4b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:38.459353 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7062952e634f6f81133783515ccc4b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:38.471305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7062952e634f6f81133783515ccc4b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:38.568766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1428/2853] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:40:38 2022] DELETE /identity/v3/users/de7062952e634f6f81133783515ccc4b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:38.573281 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01581932-f6af-4f7b-b684-b9bd4e3560fa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:38.573815 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01581932-f6af-4f7b-b684-b9bd4e3560fa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:38.573815 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01581932-f6af-4f7b-b684-b9bd4e3560fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:38.593161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-01581932-f6af-4f7b-b684-b9bd4e3560fa None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:38.594382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-01581932-f6af-4f7b-b684-b9bd4e3560fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:38.652291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1426/2854] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:38.661956 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:38.663362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:38.720382 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c76f6-0ecf-4b9f-a1d1-8b25294f925c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:38.723980 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a7206-2614-4a7c-8c56-5da86bc9abde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:38.724576 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a7206-2614-4a7c-8c56-5da86bc9abde service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:38.724850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a7206-2614-4a7c-8c56-5da86bc9abde service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:38.725110 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a7206-2614-4a7c-8c56-5da86bc9abde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:38.734547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a7206-2614-4a7c-8c56-5da86bc9abde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:38.735975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a7206-2614-4a7c-8c56-5da86bc9abde service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:38.745802 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1429/2855] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:40:39.108199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01581932-f6af-4f7b-b684-b9bd4e3560fa None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:39.109670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-01581932-f6af-4f7b-b684-b9bd4e3560fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:39.124135 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01581932-f6af-4f7b-b684-b9bd4e3560fa None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:39.128882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:39.129549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:39.129965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:39.130246 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] PATH_INFO: `/v3/projects/87550889b2c94a468b0bc9fb6ba413ee` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:39.131390 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87550889b2c94a468b0bc9fb6ba413ee)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:39.133351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:39.244695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87550889b2c94a468b0bc9fb6ba413ee', 'request_id': 'req-825692bd-9f8f-4754-bc16-9fc90207d116'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:39.250959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87550889b2c94a468b0bc9fb6ba413ee', 'request_id': 'req-825692bd-9f8f-4754-bc16-9fc90207d116'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:39.253453 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:39.311975 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87550889b2c94a468b0bc9fb6ba413ee', 'request_id': 'req-825692bd-9f8f-4754-bc16-9fc90207d116'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:39.322990 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] The token cache is being invalidate because project 87550889b2c94a468b0bc9fb6ba413ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:40:39.323278 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:39.323900 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:39.325398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1427/2856] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:40:39 2022] DELETE /identity/v3/projects/87550889b2c94a468b0bc9fb6ba413ee => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:39.329351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a7206-2614-4a7c-8c56-5da86bc9abde service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:39.339723 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a7206-2614-4a7c-8c56-5da86bc9abde service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:39.368163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:39.394344 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40876a7-8c42-4c77-9edc-b50eb08fa692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:39.394966 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40876a7-8c42-4c77-9edc-b50eb08fa692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:39.395246 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40876a7-8c42-4c77-9edc-b50eb08fa692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:39.395516 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40876a7-8c42-4c77-9edc-b50eb08fa692 admin admin] PATH_INFO: `/v3/users/0e605c9f2e5a4e528f8ba843890b1440` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:39.396652 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40876a7-8c42-4c77-9edc-b50eb08fa692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e605c9f2e5a4e528f8ba843890b1440)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:39.398605 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40876a7-8c42-4c77-9edc-b50eb08fa692 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:39.605840 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a40876a7-8c42-4c77-9edc-b50eb08fa692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e605c9f2e5a4e528f8ba843890b1440'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:39.606499 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a40876a7-8c42-4c77-9edc-b50eb08fa692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e605c9f2e5a4e528f8ba843890b1440'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:39.607093 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a40876a7-8c42-4c77-9edc-b50eb08fa692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e605c9f2e5a4e528f8ba843890b1440'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:39.614117 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a40876a7-8c42-4c77-9edc-b50eb08fa692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e605c9f2e5a4e528f8ba843890b1440'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:39.626681 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a40876a7-8c42-4c77-9edc-b50eb08fa692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e605c9f2e5a4e528f8ba843890b1440'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:39.705719 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1430/2857] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:40:39 2022] DELETE /identity/v3/users/0e605c9f2e5a4e528f8ba843890b1440 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:40.084776 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:40.091986 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:40.099984 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825692bd-9f8f-4754-bc16-9fc90207d116 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:40.158436 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:40.159076 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:40.159334 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:40.159602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb admin admin] PATH_INFO: `/v3/projects/2c29749ac99449ff82b9aee15c8e694e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:40.160695 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c29749ac99449ff82b9aee15c8e694e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:40.162618 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:40.294097 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c29749ac99449ff82b9aee15c8e694e', 'request_id': 'req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:40.300211 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c29749ac99449ff82b9aee15c8e694e', 'request_id': 'req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:40.357327 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c29749ac99449ff82b9aee15c8e694e', 'request_id': 'req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:40.367820 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb admin admin] The token cache is being invalidate because project 2c29749ac99449ff82b9aee15c8e694e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:40:40.368108 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:40.368724 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9779bfee-7c21-4046-87f7-4c6de9f1a3bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:40.370234 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1428/2858] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:40:40 2022] DELETE /identity/v3/projects/2c29749ac99449ff82b9aee15c8e694e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:40.375085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a3f52-5cfa-4816-a2c6-ea049c30ac12 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:40.375584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a3f52-5cfa-4816-a2c6-ea049c30ac12 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:40.375693 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a3f52-5cfa-4816-a2c6-ea049c30ac12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:40.395207 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1b2a3f52-5cfa-4816-a2c6-ea049c30ac12 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:40.396434 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1b2a3f52-5cfa-4816-a2c6-ea049c30ac12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:40.455786 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1431/2859] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:40.463853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37725ff8-7b5c-49c9-906a-6b3221e1b636 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:40.464130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37725ff8-7b5c-49c9-906a-6b3221e1b636 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:40.464409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37725ff8-7b5c-49c9-906a-6b3221e1b636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:40.483823 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-37725ff8-7b5c-49c9-906a-6b3221e1b636 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:40.485024 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-37725ff8-7b5c-49c9-906a-6b3221e1b636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:40.493460 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1429/2860] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:40.497581 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a3f52-5cfa-4816-a2c6-ea049c30ac12 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:40.507277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a3f52-5cfa-4816-a2c6-ea049c30ac12 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:40.512430 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c589b0-85ed-428c-9893-7c6c5e2eafa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:40.513019 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c589b0-85ed-428c-9893-7c6c5e2eafa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:40.513321 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c589b0-85ed-428c-9893-7c6c5e2eafa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:40.513595 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c589b0-85ed-428c-9893-7c6c5e2eafa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:40.514266 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c589b0-85ed-428c-9893-7c6c5e2eafa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:40:40.514566 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c589b0-85ed-428c-9893-7c6c5e2eafa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:40.516139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c589b0-85ed-428c-9893-7c6c5e2eafa5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:40.527285 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1432/2861] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:40:40.531464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37725ff8-7b5c-49c9-906a-6b3221e1b636 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:40.540689 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37725ff8-7b5c-49c9-906a-6b3221e1b636 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:40.545441 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76563d-b3ab-460d-af6a-ca9021b2988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:40.546040 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76563d-b3ab-460d-af6a-ca9021b2988c admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:40.546303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76563d-b3ab-460d-af6a-ca9021b2988c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:40.546577 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76563d-b3ab-460d-af6a-ca9021b2988c admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:40.547208 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76563d-b3ab-460d-af6a-ca9021b2988c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:40.549136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76563d-b3ab-460d-af6a-ca9021b2988c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:40.615864 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1430/2862] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:40:40 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:40:40.620431 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c589b0-85ed-428c-9893-7c6c5e2eafa5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:40.630528 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c589b0-85ed-428c-9893-7c6c5e2eafa5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:40.669162 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:40.687368 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369ee3a-ce74-491e-9b6a-8717b05fe139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:40.687971 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369ee3a-ce74-491e-9b6a-8717b05fe139 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:40.688438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369ee3a-ce74-491e-9b6a-8717b05fe139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:40.688774 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369ee3a-ce74-491e-9b6a-8717b05fe139 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:40.689660 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369ee3a-ce74-491e-9b6a-8717b05fe139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:40.691778 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369ee3a-ce74-491e-9b6a-8717b05fe139 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:40.802913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1433/2863] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:40:40 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:40:40.807637 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76563d-b3ab-460d-af6a-ca9021b2988c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:40.818202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76563d-b3ab-460d-af6a-ca9021b2988c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:40.822809 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3398b-47f4-4ebf-82d4-a626c0161273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:40.823392 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3398b-47f4-4ebf-82d4-a626c0161273 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:40.823665 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3398b-47f4-4ebf-82d4-a626c0161273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:40.823933 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3398b-47f4-4ebf-82d4-a626c0161273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:40.824582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3398b-47f4-4ebf-82d4-a626c0161273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:40.826216 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3398b-47f4-4ebf-82d4-a626c0161273 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:40.836307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1431/2864] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:40:40.839907 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369ee3a-ce74-491e-9b6a-8717b05fe139 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:40.849928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369ee3a-ce74-491e-9b6a-8717b05fe139 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:40.854985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd0d0a-8417-4d95-bdc6-cf723a34383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:40.855569 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd0d0a-8417-4d95-bdc6-cf723a34383a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:40.855850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd0d0a-8417-4d95-bdc6-cf723a34383a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:40.856121 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd0d0a-8417-4d95-bdc6-cf723a34383a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:40.856791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd0d0a-8417-4d95-bdc6-cf723a34383a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:40.858400 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd0d0a-8417-4d95-bdc6-cf723a34383a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:40.869704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1434/2865] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:40:40.873646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3398b-47f4-4ebf-82d4-a626c0161273 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:40.885871 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3398b-47f4-4ebf-82d4-a626c0161273 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:40.890549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a89867-6b5c-449f-a737-e22defdd1687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:40.891193 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a89867-6b5c-449f-a737-e22defdd1687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:40.891469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a89867-6b5c-449f-a737-e22defdd1687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:40.891738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a89867-6b5c-449f-a737-e22defdd1687 admin admin] PATH_INFO: `/v3/projects/e78fda11c7354d409df70d1817e952b1/users/813d1d8610fe4df6b4ce23ff5a2e8cd2/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:40.906075 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a89867-6b5c-449f-a737-e22defdd1687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78fda11c7354d409df70d1817e952b1, user_id=813d1d8610fe4df6b4ce23ff5a2e8cd2, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:40.908707 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a89867-6b5c-449f-a737-e22defdd1687 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:41.009487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1432/2866] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:40:40 2022] PUT /identity/v3/projects/e78fda11c7354d409df70d1817e952b1/users/813d1d8610fe4df6b4ce23ff5a2e8cd2/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:40:41.072422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff7f77-9c04-4e6f-b2ba-19acbbc7eded None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:41.072703 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff7f77-9c04-4e6f-b2ba-19acbbc7eded None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:41.072976 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff7f77-9c04-4e6f-b2ba-19acbbc7eded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:41.100379 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1eff7f77-9c04-4e6f-b2ba-19acbbc7eded None None] MFA Rules not processed for user `813d1d8610fe4df6b4ce23ff5a2e8cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:41.101602 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1eff7f77-9c04-4e6f-b2ba-19acbbc7eded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:41.165913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1435/2867] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:40:41.170473 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a89867-6b5c-449f-a737-e22defdd1687 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:41.183877 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:41.233816 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a89867-6b5c-449f-a737-e22defdd1687 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:41.238560 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725dd39-75af-44d3-a104-f66828ca53b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:41.239182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725dd39-75af-44d3-a104-f66828ca53b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:41.239457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725dd39-75af-44d3-a104-f66828ca53b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:41.239728 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725dd39-75af-44d3-a104-f66828ca53b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:41.240359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725dd39-75af-44d3-a104-f66828ca53b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:41.242300 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725dd39-75af-44d3-a104-f66828ca53b8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:41.333512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1433/2868] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:40:41 2022] POST /identity/v3/projects => generated 389 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:40:41.334807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff7f77-9c04-4e6f-b2ba-19acbbc7eded None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:41.345748 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff7f77-9c04-4e6f-b2ba-19acbbc7eded None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:41.401799 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de02dde-90ba-46ea-8df4-1960b128b6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:41.402436 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de02dde-90ba-46ea-8df4-1960b128b6ac admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:41.402656 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de02dde-90ba-46ea-8df4-1960b128b6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:41.402926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de02dde-90ba-46ea-8df4-1960b128b6ac admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:41.403544 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de02dde-90ba-46ea-8df4-1960b128b6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:41.405534 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de02dde-90ba-46ea-8df4-1960b128b6ac admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:41.494890 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1436/2869] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:40:41 2022] POST /identity/v3/users => generated 301 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:40:41.498939 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725dd39-75af-44d3-a104-f66828ca53b8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:41.509512 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725dd39-75af-44d3-a104-f66828ca53b8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:41.514779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057d78-d886-4d6c-8d87-0e08696286d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:41.515398 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057d78-d886-4d6c-8d87-0e08696286d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:41.515675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057d78-d886-4d6c-8d87-0e08696286d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:41.515947 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057d78-d886-4d6c-8d87-0e08696286d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:41.516583 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3057d78-d886-4d6c-8d87-0e08696286d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:41.518258 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3057d78-d886-4d6c-8d87-0e08696286d3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:41.529743 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1434/2870] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:40:41.533795 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de02dde-90ba-46ea-8df4-1960b128b6ac admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:41.543702 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de02dde-90ba-46ea-8df4-1960b128b6ac admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:41.548298 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e9895-5f9e-4434-a804-0f2a4492b42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:41.548940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e9895-5f9e-4434-a804-0f2a4492b42e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:41.549219 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e9895-5f9e-4434-a804-0f2a4492b42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:41.549523 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e9895-5f9e-4434-a804-0f2a4492b42e admin admin] PATH_INFO: `/v3/projects/816aa1e8aef34da7932979b4d8c3da27/users/9ed559da4b8c402b954eb9dec50516cf/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:41.563825 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e9895-5f9e-4434-a804-0f2a4492b42e admin admin] RBAC: Authorizing `identity:create_grant(project_id=816aa1e8aef34da7932979b4d8c3da27, user_id=9ed559da4b8c402b954eb9dec50516cf, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:41.566510 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e9895-5f9e-4434-a804-0f2a4492b42e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:41.614128 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1437/2871] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:40:41 2022] PUT /identity/v3/projects/816aa1e8aef34da7932979b4d8c3da27/users/9ed559da4b8c402b954eb9dec50516cf/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:41.618153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057d78-d886-4d6c-8d87-0e08696286d3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:41.628115 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057d78-d886-4d6c-8d87-0e08696286d3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:41.684068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579922b9-5214-4c4f-b1e2-3596a9ee5c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:41.684661 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579922b9-5214-4c4f-b1e2-3596a9ee5c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:41.684941 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579922b9-5214-4c4f-b1e2-3596a9ee5c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:41.685213 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579922b9-5214-4c4f-b1e2-3596a9ee5c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:41.685868 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579922b9-5214-4c4f-b1e2-3596a9ee5c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:41.687461 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579922b9-5214-4c4f-b1e2-3596a9ee5c1c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:41.696982 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1435/2872] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:40:41.701679 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e9895-5f9e-4434-a804-0f2a4492b42e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:41.712205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e9895-5f9e-4434-a804-0f2a4492b42e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:41.717406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54662270-f78c-4f60-bf30-e0a3bcb7791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:41.718026 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54662270-f78c-4f60-bf30-e0a3bcb7791e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:41.718301 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54662270-f78c-4f60-bf30-e0a3bcb7791e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:41.718568 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54662270-f78c-4f60-bf30-e0a3bcb7791e admin admin] PATH_INFO: `/v3/projects/816aa1e8aef34da7932979b4d8c3da27/users/9ed559da4b8c402b954eb9dec50516cf/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:41.720450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54662270-f78c-4f60-bf30-e0a3bcb7791e admin admin] RBAC: Authorizing `identity:create_grant(project_id=816aa1e8aef34da7932979b4d8c3da27, user_id=9ed559da4b8c402b954eb9dec50516cf, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:41.723086 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54662270-f78c-4f60-bf30-e0a3bcb7791e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:41.729144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:41.733401 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1438/2873] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:40:41 2022] PUT /identity/v3/projects/816aa1e8aef34da7932979b4d8c3da27/users/9ed559da4b8c402b954eb9dec50516cf/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:41.743104 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa2180-5c6d-427d-9aa6-1654b53e23d5 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:41.743388 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa2180-5c6d-427d-9aa6-1654b53e23d5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:41.743656 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa2180-5c6d-427d-9aa6-1654b53e23d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:41.771407 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-28fa2180-5c6d-427d-9aa6-1654b53e23d5 None None] MFA Rules not processed for user `9ed559da4b8c402b954eb9dec50516cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:41.772538 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-28fa2180-5c6d-427d-9aa6-1654b53e23d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:41.839218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1436/2874] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:41.849973 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54662270-f78c-4f60-bf30-e0a3bcb7791e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:41.851739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-54662270-f78c-4f60-bf30-e0a3bcb7791e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:41.908281 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54662270-f78c-4f60-bf30-e0a3bcb7791e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:41.911915 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae27aab-875d-40bc-b24f-40519cd99f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:41.912512 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae27aab-875d-40bc-b24f-40519cd99f05 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:41.912789 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae27aab-875d-40bc-b24f-40519cd99f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:41.913094 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae27aab-875d-40bc-b24f-40519cd99f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:41.921970 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae27aab-875d-40bc-b24f-40519cd99f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:41.923406 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae27aab-875d-40bc-b24f-40519cd99f05 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:41.933137 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1439/2875] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:40:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:40:42.064624 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa2180-5c6d-427d-9aa6-1654b53e23d5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:42.073029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:42.126174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa2180-5c6d-427d-9aa6-1654b53e23d5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:42.130839 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:42.131471 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:42.131755 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:42.132032 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] PATH_INFO: `/v3/users/813d1d8610fe4df6b4ce23ff5a2e8cd2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:42.133150 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] RBAC: Authorizing `identity:delete_user(user_id=813d1d8610fe4df6b4ce23ff5a2e8cd2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:42.135138 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:42.308469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813d1d8610fe4df6b4ce23ff5a2e8cd2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:42.386041 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813d1d8610fe4df6b4ce23ff5a2e8cd2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:42.386660 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813d1d8610fe4df6b4ce23ff5a2e8cd2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:42.387268 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813d1d8610fe4df6b4ce23ff5a2e8cd2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:42.394500 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813d1d8610fe4df6b4ce23ff5a2e8cd2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:42.411882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1437/2876] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:40:42 2022] DELETE /identity/v3/users/813d1d8610fe4df6b4ce23ff5a2e8cd2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:42.416394 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652cba6-e80d-4f0f-b3ac-63f32d27bc67 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:42.421829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652cba6-e80d-4f0f-b3ac-63f32d27bc67 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:42.421829 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652cba6-e80d-4f0f-b3ac-63f32d27bc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:42.436630 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d652cba6-e80d-4f0f-b3ac-63f32d27bc67 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:42.437855 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d652cba6-e80d-4f0f-b3ac-63f32d27bc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:42.496422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1440/2877] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:42.506229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:42.507619 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:42.565359 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406668f2-cec7-4529-bbdc-a60d898f39be admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:42.569130 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b6e7-7308-4739-9f1f-da1c907c40ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:42.569759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b6e7-7308-4739-9f1f-da1c907c40ed service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:42.570036 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b6e7-7308-4739-9f1f-da1c907c40ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:42.570305 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b6e7-7308-4739-9f1f-da1c907c40ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:42.581017 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9b6e7-7308-4739-9f1f-da1c907c40ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:42.582472 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9b6e7-7308-4739-9f1f-da1c907c40ed service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:42.592684 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1438/2878] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:40:42.993531 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652cba6-e80d-4f0f-b3ac-63f32d27bc67 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:42.995050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d652cba6-e80d-4f0f-b3ac-63f32d27bc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:43.007244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652cba6-e80d-4f0f-b3ac-63f32d27bc67 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:43.012763 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:43.013474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:43.013752 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:43.014024 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] PATH_INFO: `/v3/projects/e78fda11c7354d409df70d1817e952b1` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:43.015144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78fda11c7354d409df70d1817e952b1)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:43.017050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:43.132421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78fda11c7354d409df70d1817e952b1', 'request_id': 'req-ed24a1df-0966-4567-83f3-ceabcdb7cb31'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:43.138582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78fda11c7354d409df70d1817e952b1', 'request_id': 'req-ed24a1df-0966-4567-83f3-ceabcdb7cb31'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:43.220413 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78fda11c7354d409df70d1817e952b1', 'request_id': 'req-ed24a1df-0966-4567-83f3-ceabcdb7cb31'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:43.231490 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] The token cache is being invalidate because project e78fda11c7354d409df70d1817e952b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:40:43.231776 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:43.232393 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:43.235634 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1441/2879] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:40:42 2022] DELETE /identity/v3/projects/e78fda11c7354d409df70d1817e952b1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:43.237975 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b6e7-7308-4739-9f1f-da1c907c40ed service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:43.247501 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b6e7-7308-4739-9f1f-da1c907c40ed service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:43.273307 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:43.303696 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573176d2-a739-44c0-a875-165ad1aaa9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:43.304315 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573176d2-a739-44c0-a875-165ad1aaa9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:43.304594 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573176d2-a739-44c0-a875-165ad1aaa9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:43.304892 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573176d2-a739-44c0-a875-165ad1aaa9b8 admin admin] PATH_INFO: `/v3/users/9ed559da4b8c402b954eb9dec50516cf` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:43.306065 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573176d2-a739-44c0-a875-165ad1aaa9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed559da4b8c402b954eb9dec50516cf)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:43.307985 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573176d2-a739-44c0-a875-165ad1aaa9b8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:43.502969 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-573176d2-a739-44c0-a875-165ad1aaa9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed559da4b8c402b954eb9dec50516cf'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:43.574922 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-573176d2-a739-44c0-a875-165ad1aaa9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed559da4b8c402b954eb9dec50516cf'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:43.575549 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-573176d2-a739-44c0-a875-165ad1aaa9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed559da4b8c402b954eb9dec50516cf'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:43.576154 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-573176d2-a739-44c0-a875-165ad1aaa9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed559da4b8c402b954eb9dec50516cf'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:43.583351 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-573176d2-a739-44c0-a875-165ad1aaa9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed559da4b8c402b954eb9dec50516cf'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:43.600610 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1439/2880] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:40:43 2022] DELETE /identity/v3/users/9ed559da4b8c402b954eb9dec50516cf => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:43.982098 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:43.983631 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:43.999699 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24a1df-0966-4567-83f3-ceabcdb7cb31 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:44.025791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:44.056532 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf4c51-edc0-48e8-a2cc-a313d64ef527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:44.057095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf4c51-edc0-48e8-a2cc-a313d64ef527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:44.057410 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf4c51-edc0-48e8-a2cc-a313d64ef527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:44.057699 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf4c51-edc0-48e8-a2cc-a313d64ef527 admin admin] PATH_INFO: `/v3/projects/816aa1e8aef34da7932979b4d8c3da27` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:44.059384 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf4c51-edc0-48e8-a2cc-a313d64ef527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816aa1e8aef34da7932979b4d8c3da27)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:44.061320 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf4c51-edc0-48e8-a2cc-a313d64ef527 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:44.163547 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-58bf4c51-edc0-48e8-a2cc-a313d64ef527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816aa1e8aef34da7932979b4d8c3da27', 'request_id': 'req-58bf4c51-edc0-48e8-a2cc-a313d64ef527'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:44.170429 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-58bf4c51-edc0-48e8-a2cc-a313d64ef527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816aa1e8aef34da7932979b4d8c3da27', 'request_id': 'req-58bf4c51-edc0-48e8-a2cc-a313d64ef527'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:44.215044 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-58bf4c51-edc0-48e8-a2cc-a313d64ef527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816aa1e8aef34da7932979b4d8c3da27', 'request_id': 'req-58bf4c51-edc0-48e8-a2cc-a313d64ef527'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:44.225822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-58bf4c51-edc0-48e8-a2cc-a313d64ef527 admin admin] The token cache is being invalidate because project 816aa1e8aef34da7932979b4d8c3da27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:40:44.227107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-58bf4c51-edc0-48e8-a2cc-a313d64ef527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:44.227107 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-58bf4c51-edc0-48e8-a2cc-a313d64ef527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:40:44.228179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1442/2881] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:40:43 2022] DELETE /identity/v3/projects/816aa1e8aef34da7932979b4d8c3da27 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:44.233567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425d7ce-9ab8-4dd4-b486-9a98d202c5ab None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:44.233853 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425d7ce-9ab8-4dd4-b486-9a98d202c5ab None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:44.234126 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425d7ce-9ab8-4dd4-b486-9a98d202c5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:44.253505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e425d7ce-9ab8-4dd4-b486-9a98d202c5ab None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:44.254699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e425d7ce-9ab8-4dd4-b486-9a98d202c5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:44.313147 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1440/2882] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:44.320704 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992fb98-4298-44ff-bae9-88d13a37c316 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:44.320981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992fb98-4298-44ff-bae9-88d13a37c316 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:44.321248 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992fb98-4298-44ff-bae9-88d13a37c316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:44.341790 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3992fb98-4298-44ff-bae9-88d13a37c316 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:44.342969 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3992fb98-4298-44ff-bae9-88d13a37c316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:44.350647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1443/2883] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:44.354872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425d7ce-9ab8-4dd4-b486-9a98d202c5ab None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:44.364931 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425d7ce-9ab8-4dd4-b486-9a98d202c5ab None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:44.369514 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cde673-f8d8-45df-8d13-7f2992153944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:44.370103 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cde673-f8d8-45df-8d13-7f2992153944 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:44.370381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cde673-f8d8-45df-8d13-7f2992153944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:44.370650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cde673-f8d8-45df-8d13-7f2992153944 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:44.371854 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cde673-f8d8-45df-8d13-7f2992153944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:40:44.372153 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cde673-f8d8-45df-8d13-7f2992153944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:44.373769 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cde673-f8d8-45df-8d13-7f2992153944 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:44.384999 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1441/2884] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:40:44.389642 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992fb98-4298-44ff-bae9-88d13a37c316 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:44.398698 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992fb98-4298-44ff-bae9-88d13a37c316 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:44.403317 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7c488-12ed-4cde-8bbe-01da79850dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:44.403914 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7c488-12ed-4cde-8bbe-01da79850dad admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:44.404171 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7c488-12ed-4cde-8bbe-01da79850dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:44.404438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7c488-12ed-4cde-8bbe-01da79850dad admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:44.405050 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7c488-12ed-4cde-8bbe-01da79850dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:44.406976 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7c488-12ed-4cde-8bbe-01da79850dad admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:44.495582 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1444/2885] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:40:44 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:40:44.500259 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cde673-f8d8-45df-8d13-7f2992153944 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:44.510525 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cde673-f8d8-45df-8d13-7f2992153944 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:44.543916 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:44.567878 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33f013-cfb4-4eea-a9e6-24aa4f7b2c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:44.568409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33f013-cfb4-4eea-a9e6-24aa4f7b2c9b admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:44.568691 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33f013-cfb4-4eea-a9e6-24aa4f7b2c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:44.568965 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33f013-cfb4-4eea-a9e6-24aa4f7b2c9b admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:44.569616 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33f013-cfb4-4eea-a9e6-24aa4f7b2c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:44.571526 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33f013-cfb4-4eea-a9e6-24aa4f7b2c9b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:44.654507 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1442/2886] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:40:44 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:40:44.658732 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7c488-12ed-4cde-8bbe-01da79850dad admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:44.670363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7c488-12ed-4cde-8bbe-01da79850dad admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:44.675001 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5d527-2dff-4f1d-a6bb-75d8a4ce5b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:44.675587 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5d527-2dff-4f1d-a6bb-75d8a4ce5b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:44.675861 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5d527-2dff-4f1d-a6bb-75d8a4ce5b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:44.676182 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5d527-2dff-4f1d-a6bb-75d8a4ce5b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:44.676825 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5d527-2dff-4f1d-a6bb-75d8a4ce5b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:44.678474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5d527-2dff-4f1d-a6bb-75d8a4ce5b44 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:44.689179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1445/2887] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:40:44.693028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33f013-cfb4-4eea-a9e6-24aa4f7b2c9b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:44.702821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33f013-cfb4-4eea-a9e6-24aa4f7b2c9b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:44.707949 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09910b1-761e-4f9a-b843-79022b1e2b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:44.708533 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09910b1-761e-4f9a-b843-79022b1e2b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:44.708810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09910b1-761e-4f9a-b843-79022b1e2b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:44.709080 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09910b1-761e-4f9a-b843-79022b1e2b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:44.709752 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09910b1-761e-4f9a-b843-79022b1e2b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:44.711591 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09910b1-761e-4f9a-b843-79022b1e2b4d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:44.722020 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1443/2888] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:40:44.725928 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5d527-2dff-4f1d-a6bb-75d8a4ce5b44 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:44.736483 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5d527-2dff-4f1d-a6bb-75d8a4ce5b44 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:44.741244 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762900dd-8fa4-4afc-b143-324e131749c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:44.741902 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762900dd-8fa4-4afc-b143-324e131749c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:44.742178 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762900dd-8fa4-4afc-b143-324e131749c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:44.742450 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762900dd-8fa4-4afc-b143-324e131749c0 admin admin] PATH_INFO: `/v3/projects/6e762a38b2e34637bf98f15ceaff45ee/users/c2ae5885d3f24e8db598eba933edc6e8/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:44.757195 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762900dd-8fa4-4afc-b143-324e131749c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e762a38b2e34637bf98f15ceaff45ee, user_id=c2ae5885d3f24e8db598eba933edc6e8, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:44.760117 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762900dd-8fa4-4afc-b143-324e131749c0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:44.825819 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1446/2889] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:40:44 2022] PUT /identity/v3/projects/6e762a38b2e34637bf98f15ceaff45ee/users/c2ae5885d3f24e8db598eba933edc6e8/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:40:44.837469 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024c237-3bc6-42f4-b533-961535adb6f9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:44.837756 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024c237-3bc6-42f4-b533-961535adb6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:44.838028 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024c237-3bc6-42f4-b533-961535adb6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:44.868869 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a024c237-3bc6-42f4-b533-961535adb6f9 None None] MFA Rules not processed for user `c2ae5885d3f24e8db598eba933edc6e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:40:44.870100 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a024c237-3bc6-42f4-b533-961535adb6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:44.932374 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1444/2890] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:40:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:40:44.944376 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762900dd-8fa4-4afc-b143-324e131749c0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:40:44.946064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-762900dd-8fa4-4afc-b143-324e131749c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:40:45.001651 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762900dd-8fa4-4afc-b143-324e131749c0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:40:45.005281 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79338670-424b-4218-bc84-ecfdd1391ba2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f746dd2ce4404b679db81794c4d23f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:40:45.005866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79338670-424b-4218-bc84-ecfdd1391ba2 service glance] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:40:45.006140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79338670-424b-4218-bc84-ecfdd1391ba2 service glance] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:40:45.006408 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79338670-424b-4218-bc84-ecfdd1391ba2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:40:45.013143 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:45.015438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79338670-424b-4218-bc84-ecfdd1391ba2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:40:45.016850 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79338670-424b-4218-bc84-ecfdd1391ba2 service glance] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:40:45.026057 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1447/2891] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:40:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:40:54.929518 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=50,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:40:55.106196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:00.075372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024c237-3bc6-42f4-b533-961535adb6f9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:00.137011 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024c237-3bc6-42f4-b533-961535adb6f9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:00.141664 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:00.142293 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:00.142594 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:00.142856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] PATH_INFO: `/v3/users/c2ae5885d3f24e8db598eba933edc6e8` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:00.143986 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ae5885d3f24e8db598eba933edc6e8)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:00.145950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:00.330792 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ae5885d3f24e8db598eba933edc6e8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:00.397511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ae5885d3f24e8db598eba933edc6e8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:00.398157 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ae5885d3f24e8db598eba933edc6e8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:00.398763 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ae5885d3f24e8db598eba933edc6e8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:00.405929 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ae5885d3f24e8db598eba933edc6e8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:00.423717 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1445/2892] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:41:00 2022] DELETE /identity/v3/users/c2ae5885d3f24e8db598eba933edc6e8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:41:00.428232 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e1b03-6b74-4b3e-b324-d73bf8c38f6b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:00.428714 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e1b03-6b74-4b3e-b324-d73bf8c38f6b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:00.428823 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e1b03-6b74-4b3e-b324-d73bf8c38f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:00.448145 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b04e1b03-6b74-4b3e-b324-d73bf8c38f6b None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:41:00.449381 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b04e1b03-6b74-4b3e-b324-d73bf8c38f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:00.507474 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1448/2893] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:41:00.517819 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:00.519230 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:00.575569 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64a561-7717-4064-bedb-cdbd603c00cc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:00.579860 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace87a2c-dd55-4d71-b7bf-5e42be1a9301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:00.580458 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87a2c-dd55-4d71-b7bf-5e42be1a9301 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:00.580737 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87a2c-dd55-4d71-b7bf-5e42be1a9301 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:00.581068 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87a2c-dd55-4d71-b7bf-5e42be1a9301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:00.590196 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace87a2c-dd55-4d71-b7bf-5e42be1a9301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:00.591613 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace87a2c-dd55-4d71-b7bf-5e42be1a9301 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:00.600923 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1446/2894] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:41:00.958941 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e1b03-6b74-4b3e-b324-d73bf8c38f6b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:00.960362 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b04e1b03-6b74-4b3e-b324-d73bf8c38f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:00.972596 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e1b03-6b74-4b3e-b324-d73bf8c38f6b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:00.977227 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d44b82-92ed-4689-b095-8bbda35e7dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:00.977884 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d44b82-92ed-4689-b095-8bbda35e7dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:00.978296 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d44b82-92ed-4689-b095-8bbda35e7dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:00.978612 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d44b82-92ed-4689-b095-8bbda35e7dc5 admin admin] PATH_INFO: `/v3/projects/6e762a38b2e34637bf98f15ceaff45ee` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:00.980020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d44b82-92ed-4689-b095-8bbda35e7dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e762a38b2e34637bf98f15ceaff45ee)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:00.981647 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d44b82-92ed-4689-b095-8bbda35e7dc5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:01.071814 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-12d44b82-92ed-4689-b095-8bbda35e7dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e762a38b2e34637bf98f15ceaff45ee', 'request_id': 'req-12d44b82-92ed-4689-b095-8bbda35e7dc5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:01.078066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-12d44b82-92ed-4689-b095-8bbda35e7dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e762a38b2e34637bf98f15ceaff45ee', 'request_id': 'req-12d44b82-92ed-4689-b095-8bbda35e7dc5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:01.140387 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-12d44b82-92ed-4689-b095-8bbda35e7dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e762a38b2e34637bf98f15ceaff45ee', 'request_id': 'req-12d44b82-92ed-4689-b095-8bbda35e7dc5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:01.151326 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-12d44b82-92ed-4689-b095-8bbda35e7dc5 admin admin] The token cache is being invalidate because project 6e762a38b2e34637bf98f15ceaff45ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:41:01.151610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-12d44b82-92ed-4689-b095-8bbda35e7dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:01.152242 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-12d44b82-92ed-4689-b095-8bbda35e7dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:01.153773 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1449/2895] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:41:00 2022] DELETE /identity/v3/projects/6e762a38b2e34637bf98f15ceaff45ee => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:41:01.158609 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a7dc9-c8c1-4a51-b08a-6c95466ab5bb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:01.159063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a7dc9-c8c1-4a51-b08a-6c95466ab5bb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:01.159174 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a7dc9-c8c1-4a51-b08a-6c95466ab5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:01.179279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-aa6a7dc9-c8c1-4a51-b08a-6c95466ab5bb None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:41:01.181232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aa6a7dc9-c8c1-4a51-b08a-6c95466ab5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:01.197676 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:01.240811 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1447/2896] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:41:01.248763 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b908551-3704-477b-a087-e551668a0572 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:01.249052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b908551-3704-477b-a087-e551668a0572 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:01.249359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b908551-3704-477b-a087-e551668a0572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:01.268917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2b908551-3704-477b-a087-e551668a0572 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:41:01.271996 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2b908551-3704-477b-a087-e551668a0572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:01.277919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1450/2897] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:41:01.282584 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a7dc9-c8c1-4a51-b08a-6c95466ab5bb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:01.292446 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a7dc9-c8c1-4a51-b08a-6c95466ab5bb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:01.297724 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec634a01-ebbc-4b28-892a-2e33594408a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:01.298321 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec634a01-ebbc-4b28-892a-2e33594408a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:01.298598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec634a01-ebbc-4b28-892a-2e33594408a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:01.298871 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec634a01-ebbc-4b28-892a-2e33594408a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:01.299510 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec634a01-ebbc-4b28-892a-2e33594408a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:41:01.299810 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec634a01-ebbc-4b28-892a-2e33594408a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:01.301451 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec634a01-ebbc-4b28-892a-2e33594408a6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:01.313182 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1448/2898] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:41:01.317276 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b908551-3704-477b-a087-e551668a0572 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:01.326447 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b908551-3704-477b-a087-e551668a0572 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:01.331114 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a5826-238a-4819-9a41-71b97d54a84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:01.331716 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a5826-238a-4819-9a41-71b97d54a84f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:01.331997 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a5826-238a-4819-9a41-71b97d54a84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:01.332274 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a5826-238a-4819-9a41-71b97d54a84f admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:01.332937 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a5826-238a-4819-9a41-71b97d54a84f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:01.334893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a5826-238a-4819-9a41-71b97d54a84f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:01.410254 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1451/2899] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:41:01 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:41:01.413434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec634a01-ebbc-4b28-892a-2e33594408a6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:01.424042 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec634a01-ebbc-4b28-892a-2e33594408a6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:01.479919 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b6b24-dea4-418c-affa-852550ef0964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:01.480522 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b6b24-dea4-418c-affa-852550ef0964 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:01.480804 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b6b24-dea4-418c-affa-852550ef0964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:01.481079 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b6b24-dea4-418c-affa-852550ef0964 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:01.481754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b6b24-dea4-418c-affa-852550ef0964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:01.483679 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b6b24-dea4-418c-affa-852550ef0964 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:01.556947 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1449/2900] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:41:01 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:41:01.561135 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a5826-238a-4819-9a41-71b97d54a84f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:01.571456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a5826-238a-4819-9a41-71b97d54a84f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:01.576039 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624d4c-6120-4c4a-a9f7-f939502cee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:01.576629 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624d4c-6120-4c4a-a9f7-f939502cee58 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:01.581610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624d4c-6120-4c4a-a9f7-f939502cee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:01.581610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624d4c-6120-4c4a-a9f7-f939502cee58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:01.581610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a624d4c-6120-4c4a-a9f7-f939502cee58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:01.581610 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a624d4c-6120-4c4a-a9f7-f939502cee58 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:01.590108 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1452/2901] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:41:01.594336 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b6b24-dea4-418c-affa-852550ef0964 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:01.604052 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b6b24-dea4-418c-affa-852550ef0964 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:01.608672 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29256a20-8db2-4f91-ba55-bd3ddc34553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:01.609249 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29256a20-8db2-4f91-ba55-bd3ddc34553f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:01.609552 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29256a20-8db2-4f91-ba55-bd3ddc34553f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:01.609822 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29256a20-8db2-4f91-ba55-bd3ddc34553f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:01.610448 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29256a20-8db2-4f91-ba55-bd3ddc34553f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:01.612021 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29256a20-8db2-4f91-ba55-bd3ddc34553f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:01.622450 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1450/2902] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:41:01.626338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624d4c-6120-4c4a-a9f7-f939502cee58 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:01.636114 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624d4c-6120-4c4a-a9f7-f939502cee58 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:01.641157 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60489c-860f-4f45-b307-b32ae653da04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:01.641830 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60489c-860f-4f45-b307-b32ae653da04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:01.642109 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60489c-860f-4f45-b307-b32ae653da04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:01.642383 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60489c-860f-4f45-b307-b32ae653da04 admin admin] PATH_INFO: `/v3/projects/3006188b74f24e03ac7e94751f523986/users/ea12f4e6bc6d4f52a25fa52da55cc220/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:01.657458 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60489c-860f-4f45-b307-b32ae653da04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3006188b74f24e03ac7e94751f523986, user_id=ea12f4e6bc6d4f52a25fa52da55cc220, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:01.660155 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60489c-860f-4f45-b307-b32ae653da04 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:01.717035 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1453/2903] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:41:01 2022] PUT /identity/v3/projects/3006188b74f24e03ac7e94751f523986/users/ea12f4e6bc6d4f52a25fa52da55cc220/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:41:01.735489 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8eb429-d39b-49f1-b257-4d5d61f369e3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:01.735780 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8eb429-d39b-49f1-b257-4d5d61f369e3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:01.736054 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8eb429-d39b-49f1-b257-4d5d61f369e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:01.763819 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-eb8eb429-d39b-49f1-b257-4d5d61f369e3 None None] MFA Rules not processed for user `ea12f4e6bc6d4f52a25fa52da55cc220`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:41:01.765554 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-eb8eb429-d39b-49f1-b257-4d5d61f369e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:01.835159 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1451/2904] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:41:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:41:01.847064 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60489c-860f-4f45-b307-b32ae653da04 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:01.848761 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bb60489c-860f-4f45-b307-b32ae653da04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:01.870697 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:01.904705 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60489c-860f-4f45-b307-b32ae653da04 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:01.908313 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26720354-ea68-4d0d-a058-c423025df55d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92e0ce020fb448bc9d470e918a022ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:01.908909 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720354-ea68-4d0d-a058-c423025df55d service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:01.909179 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720354-ea68-4d0d-a058-c423025df55d service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:01.909798 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720354-ea68-4d0d-a058-c423025df55d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:01.918640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26720354-ea68-4d0d-a058-c423025df55d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:01.920167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26720354-ea68-4d0d-a058-c423025df55d service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:01.929506 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1454/2905] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:41:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:41:11.832277 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:11.967815 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=17 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:22.444980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8eb429-d39b-49f1-b257-4d5d61f369e3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:22.449857 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-eb8eb429-d39b-49f1-b257-4d5d61f369e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:22.507475 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8eb429-d39b-49f1-b257-4d5d61f369e3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:22.511582 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063b8df-ab1a-42e4-9a20-a040db4da704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:22.512434 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063b8df-ab1a-42e4-9a20-a040db4da704 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:22.512713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063b8df-ab1a-42e4-9a20-a040db4da704 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:22.513167 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063b8df-ab1a-42e4-9a20-a040db4da704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:22.514954 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5063b8df-ab1a-42e4-9a20-a040db4da704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:22.525690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063b8df-ab1a-42e4-9a20-a040db4da704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:22.527125 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063b8df-ab1a-42e4-9a20-a040db4da704 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:22.535383 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1452/2906] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:41:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:41:32.531530 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=26 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:34.658063 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26720354-ea68-4d0d-a058-c423025df55d service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:34.747318 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26720354-ea68-4d0d-a058-c423025df55d service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:34.753185 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:34.754175 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:34.754619 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:34.755052 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] PATH_INFO: `/v3/users/ea12f4e6bc6d4f52a25fa52da55cc220` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:34.756421 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea12f4e6bc6d4f52a25fa52da55cc220)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:34.759124 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:34.891167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea12f4e6bc6d4f52a25fa52da55cc220'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:34.891978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea12f4e6bc6d4f52a25fa52da55cc220'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:34.892609 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea12f4e6bc6d4f52a25fa52da55cc220'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:34.900578 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea12f4e6bc6d4f52a25fa52da55cc220'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:34.912848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea12f4e6bc6d4f52a25fa52da55cc220'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:34.974972 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1455/2907] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:41:34 2022] DELETE /identity/v3/users/ea12f4e6bc6d4f52a25fa52da55cc220 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:41:34.976691 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fff75-64bb-4d6d-aace-2397fd39cb2c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:34.977219 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fff75-64bb-4d6d-aace-2397fd39cb2c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:34.977449 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fff75-64bb-4d6d-aace-2397fd39cb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:35.001977 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f51fff75-64bb-4d6d-aace-2397fd39cb2c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:41:35.003189 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f51fff75-64bb-4d6d-aace-2397fd39cb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:35.072730 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1453/2908] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:41:35.084114 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:35.085981 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:35.165396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71bf0a-e648-4b20-b6f9-25459fba3f92 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:35.169048 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53079f-2b02-4a3b-b131-16a220854f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:35.169690 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53079f-2b02-4a3b-b131-16a220854f55 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:35.169965 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53079f-2b02-4a3b-b131-16a220854f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:35.172999 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53079f-2b02-4a3b-b131-16a220854f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:35.179979 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53079f-2b02-4a3b-b131-16a220854f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:35.181978 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53079f-2b02-4a3b-b131-16a220854f55 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:35.192305 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1456/2909] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:41:35.787474 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fff75-64bb-4d6d-aace-2397fd39cb2c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:35.789197 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f51fff75-64bb-4d6d-aace-2397fd39cb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:35.803188 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fff75-64bb-4d6d-aace-2397fd39cb2c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:35.810284 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef65635-c415-4617-b50b-5d5b83cc66c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:35.810836 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef65635-c415-4617-b50b-5d5b83cc66c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:35.811121 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef65635-c415-4617-b50b-5d5b83cc66c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:35.811384 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef65635-c415-4617-b50b-5d5b83cc66c2 admin admin] PATH_INFO: `/v3/projects/3006188b74f24e03ac7e94751f523986` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:35.820704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef65635-c415-4617-b50b-5d5b83cc66c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3006188b74f24e03ac7e94751f523986)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:35.822706 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef65635-c415-4617-b50b-5d5b83cc66c2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:35.923291 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2ef65635-c415-4617-b50b-5d5b83cc66c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3006188b74f24e03ac7e94751f523986', 'request_id': 'req-2ef65635-c415-4617-b50b-5d5b83cc66c2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:35.929659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2ef65635-c415-4617-b50b-5d5b83cc66c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3006188b74f24e03ac7e94751f523986', 'request_id': 'req-2ef65635-c415-4617-b50b-5d5b83cc66c2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:36.013761 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2ef65635-c415-4617-b50b-5d5b83cc66c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3006188b74f24e03ac7e94751f523986', 'request_id': 'req-2ef65635-c415-4617-b50b-5d5b83cc66c2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:36.026330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2ef65635-c415-4617-b50b-5d5b83cc66c2 admin admin] The token cache is being invalidate because project 3006188b74f24e03ac7e94751f523986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:41:36.026616 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2ef65635-c415-4617-b50b-5d5b83cc66c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:36.027229 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2ef65635-c415-4617-b50b-5d5b83cc66c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:36.028700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1454/2910] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:41:35 2022] DELETE /identity/v3/projects/3006188b74f24e03ac7e94751f523986 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:41:36.033649 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153575d-491f-407b-ac54-19766954d983 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:36.034085 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153575d-491f-407b-ac54-19766954d983 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:36.034205 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153575d-491f-407b-ac54-19766954d983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:36.054160 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9153575d-491f-407b-ac54-19766954d983 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:41:36.055359 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9153575d-491f-407b-ac54-19766954d983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:36.072043 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:36.113948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1457/2911] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:41:36.121898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f14d3-4b00-44b0-a443-a3a187eb6102 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:36.122184 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f14d3-4b00-44b0-a443-a3a187eb6102 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:36.122463 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f14d3-4b00-44b0-a443-a3a187eb6102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:36.142199 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-569f14d3-4b00-44b0-a443-a3a187eb6102 None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:41:36.144473 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-569f14d3-4b00-44b0-a443-a3a187eb6102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:36.151961 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1455/2912] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:41:36.156253 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153575d-491f-407b-ac54-19766954d983 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:36.166918 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153575d-491f-407b-ac54-19766954d983 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:36.187346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bc5dc-b4ff-4e38-b77a-c907140216a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:36.187346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bc5dc-b4ff-4e38-b77a-c907140216a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:36.187346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bc5dc-b4ff-4e38-b77a-c907140216a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:36.187346 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bc5dc-b4ff-4e38-b77a-c907140216a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:36.187801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bc5dc-b4ff-4e38-b77a-c907140216a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 03:41:36.187801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bc5dc-b4ff-4e38-b77a-c907140216a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:36.187801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bc5dc-b4ff-4e38-b77a-c907140216a6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:36.187801 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1458/2913] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Sep 13 03:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 03:41:36.191043 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f14d3-4b00-44b0-a443-a3a187eb6102 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:36.200894 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f14d3-4b00-44b0-a443-a3a187eb6102 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:36.205635 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cf0bd-8a60-47f1-b8d4-1d77c6ea26e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:36.206232 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cf0bd-8a60-47f1-b8d4-1d77c6ea26e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:36.206511 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cf0bd-8a60-47f1-b8d4-1d77c6ea26e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:36.206784 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cf0bd-8a60-47f1-b8d4-1d77c6ea26e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:36.207404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cf0bd-8a60-47f1-b8d4-1d77c6ea26e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:36.209310 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cf0bd-8a60-47f1-b8d4-1d77c6ea26e4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:36.306576 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1456/2914] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:41:36 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:41:36.310814 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bc5dc-b4ff-4e38-b77a-c907140216a6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:36.321069 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bc5dc-b4ff-4e38-b77a-c907140216a6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:36.376262 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ef955-e84f-4906-8ee6-612770b8efd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:36.376856 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ef955-e84f-4906-8ee6-612770b8efd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:36.377129 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ef955-e84f-4906-8ee6-612770b8efd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:36.377432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ef955-e84f-4906-8ee6-612770b8efd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:36.378055 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ef955-e84f-4906-8ee6-612770b8efd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:36.379958 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ef955-e84f-4906-8ee6-612770b8efd9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:36.449743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1459/2915] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:41:36 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:41:36.453898 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cf0bd-8a60-47f1-b8d4-1d77c6ea26e4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:36.465670 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cf0bd-8a60-47f1-b8d4-1d77c6ea26e4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:36.470362 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af2219-1d12-450d-9384-951ea9ccc6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:36.470967 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af2219-1d12-450d-9384-951ea9ccc6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:36.471991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af2219-1d12-450d-9384-951ea9ccc6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:36.471991 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af2219-1d12-450d-9384-951ea9ccc6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:36.472228 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af2219-1d12-450d-9384-951ea9ccc6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:36.473745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af2219-1d12-450d-9384-951ea9ccc6b1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:36.484260 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1457/2916] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:41:36.488356 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ef955-e84f-4906-8ee6-612770b8efd9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:36.499072 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ef955-e84f-4906-8ee6-612770b8efd9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:36.503668 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a013f92-9ea7-4f82-9b5e-562cc5dd7e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:36.504266 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a013f92-9ea7-4f82-9b5e-562cc5dd7e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:36.504539 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a013f92-9ea7-4f82-9b5e-562cc5dd7e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:36.504807 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a013f92-9ea7-4f82-9b5e-562cc5dd7e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:36.505486 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a013f92-9ea7-4f82-9b5e-562cc5dd7e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:36.507082 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a013f92-9ea7-4f82-9b5e-562cc5dd7e1c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:36.518186 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1460/2917] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 03:41:36.522488 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af2219-1d12-450d-9384-951ea9ccc6b1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:36.533372 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af2219-1d12-450d-9384-951ea9ccc6b1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:36.538409 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c02ef-5730-4654-b0d6-fb181884a4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:36.539162 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c02ef-5730-4654-b0d6-fb181884a4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:36.539447 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c02ef-5730-4654-b0d6-fb181884a4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:36.539721 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c02ef-5730-4654-b0d6-fb181884a4b0 admin admin] PATH_INFO: `/v3/projects/15cbbc4a102f4da3b11d73fc5932f4f0/users/c617bd9eab0948fca599e89051729bc2/roles/367ec0d2bcdc49f09b0772bbd737e5ce` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:36.554457 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c02ef-5730-4654-b0d6-fb181884a4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cbbc4a102f4da3b11d73fc5932f4f0, user_id=c617bd9eab0948fca599e89051729bc2, role_id=367ec0d2bcdc49f09b0772bbd737e5ce)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:36.557669 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c02ef-5730-4654-b0d6-fb181884a4b0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:36.638805 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1458/2918] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:41:36 2022] PUT /identity/v3/projects/15cbbc4a102f4da3b11d73fc5932f4f0/users/c617bd9eab0948fca599e89051729bc2/roles/367ec0d2bcdc49f09b0772bbd737e5ce => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:41:36.644028 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae70c-c6a6-468d-97b4-3f0b371d3a5c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:36.644338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae70c-c6a6-468d-97b4-3f0b371d3a5c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:36.644663 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae70c-c6a6-468d-97b4-3f0b371d3a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:36.667213 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5f8ae70c-c6a6-468d-97b4-3f0b371d3a5c None None] MFA Rules not processed for user `809e7dc455e844f6967aa616532e4eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:41:36.667527 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5f8ae70c-c6a6-468d-97b4-3f0b371d3a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:36.743175 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1461/2919] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:41:36.780355 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c02ef-5730-4654-b0d6-fb181884a4b0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:36.782290 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d37c02ef-5730-4654-b0d6-fb181884a4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:36.809303 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:36.869058 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c02ef-5730-4654-b0d6-fb181884a4b0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:36.873344 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19228bb6-7ea1-40fb-b5ff-57e9d81079ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:36.874047 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19228bb6-7ea1-40fb-b5ff-57e9d81079ce service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:36.874328 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19228bb6-7ea1-40fb-b5ff-57e9d81079ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:36.874659 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19228bb6-7ea1-40fb-b5ff-57e9d81079ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:36.883642 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19228bb6-7ea1-40fb-b5ff-57e9d81079ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:36.885106 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19228bb6-7ea1-40fb-b5ff-57e9d81079ce service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:36.894972 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1459/2920] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:41:37.352540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ae70c-c6a6-468d-97b4-3f0b371d3a5c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:37.354023 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5f8ae70c-c6a6-468d-97b4-3f0b371d3a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:37.386589 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:37.429822 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ae70c-c6a6-468d-97b4-3f0b371d3a5c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:37.436144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a1e49-6288-46f0-8e3b-7fde758facbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:37.436766 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a1e49-6288-46f0-8e3b-7fde758facbd service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:37.437045 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a1e49-6288-46f0-8e3b-7fde758facbd service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:37.437355 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a1e49-6288-46f0-8e3b-7fde758facbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:37.439138 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bd7a1e49-6288-46f0-8e3b-7fde758facbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:37.452374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a1e49-6288-46f0-8e3b-7fde758facbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:37.454020 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a1e49-6288-46f0-8e3b-7fde758facbd service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:37.466175 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1462/2921] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:41:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:41:43.176744 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944581-5177-47dd-a297-5009b27c9e4f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:43.177646 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944581-5177-47dd-a297-5009b27c9e4f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:43.177920 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944581-5177-47dd-a297-5009b27c9e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:43.217119 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-36944581-5177-47dd-a297-5009b27c9e4f None None] MFA Rules not processed for user `c617bd9eab0948fca599e89051729bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:41:43.218796 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-36944581-5177-47dd-a297-5009b27c9e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:43.323675 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1460/2922] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:41:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:41:43.328215 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a1e49-6288-46f0-8e3b-7fde758facbd service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:43.344453 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a1e49-6288-46f0-8e3b-7fde758facbd service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:43.350457 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f95ef7-70c9-46e2-9bf6-6cb65407e9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:43.353139 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f95ef7-70c9-46e2-9bf6-6cb65407e9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:43.353938 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f95ef7-70c9-46e2-9bf6-6cb65407e9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:43.354278 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f95ef7-70c9-46e2-9bf6-6cb65407e9b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:43.355091 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f95ef7-70c9-46e2-9bf6-6cb65407e9b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:43.357092 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f95ef7-70c9-46e2-9bf6-6cb65407e9b1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:43.457209 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36944581-5177-47dd-a297-5009b27c9e4f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:43.458127 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1463/2923] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Sep 13 03:41:43 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 03:41:43.470330 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36944581-5177-47dd-a297-5009b27c9e4f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:43.531529 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13994717-529a-4043-a134-def728d0432d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:43.532140 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994717-529a-4043-a134-def728d0432d admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:43.532422 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994717-529a-4043-a134-def728d0432d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:43.532694 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994717-529a-4043-a134-def728d0432d admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:43.533352 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13994717-529a-4043-a134-def728d0432d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:43.535302 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13994717-529a-4043-a134-def728d0432d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:43.659095 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f95ef7-70c9-46e2-9bf6-6cb65407e9b1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:43.665505 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1461/2924] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Sep 13 03:41:43 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 03:41:43.672786 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f95ef7-70c9-46e2-9bf6-6cb65407e9b1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:43.680825 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3444d38-6dd0-4277-8390-c34b27db9c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:43.680825 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3444d38-6dd0-4277-8390-c34b27db9c19 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:43.681168 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3444d38-6dd0-4277-8390-c34b27db9c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:43.681666 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3444d38-6dd0-4277-8390-c34b27db9c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:43.682332 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3444d38-6dd0-4277-8390-c34b27db9c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:43.683940 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3444d38-6dd0-4277-8390-c34b27db9c19 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:43.699925 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1464/2925] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:41:43.703745 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13994717-529a-4043-a134-def728d0432d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:43.725497 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13994717-529a-4043-a134-def728d0432d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:43.730517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e95358-bf91-4703-9140-28ad7387dd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:43.731202 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e95358-bf91-4703-9140-28ad7387dd4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:43.731473 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e95358-bf91-4703-9140-28ad7387dd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:43.731741 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e95358-bf91-4703-9140-28ad7387dd4b admin admin] PATH_INFO: `/v3/projects/62a8314e718a40e9803f1cf728b725e2/users/1e040ae501cf45bba121760ec99e6b26/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:43.750002 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e95358-bf91-4703-9140-28ad7387dd4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a8314e718a40e9803f1cf728b725e2, user_id=1e040ae501cf45bba121760ec99e6b26, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:43.752934 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e95358-bf91-4703-9140-28ad7387dd4b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:43.841087 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1462/2926] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:41:43 2022] PUT /identity/v3/projects/62a8314e718a40e9803f1cf728b725e2/users/1e040ae501cf45bba121760ec99e6b26/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:41:43.845919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3444d38-6dd0-4277-8390-c34b27db9c19 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:43.858010 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3444d38-6dd0-4277-8390-c34b27db9c19 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:43.922848 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20d00c-7e1b-4a15-a5e9-4e0f927c30bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:43.923457 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20d00c-7e1b-4a15-a5e9-4e0f927c30bf admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:43.923734 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20d00c-7e1b-4a15-a5e9-4e0f927c30bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:43.924004 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20d00c-7e1b-4a15-a5e9-4e0f927c30bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:43.924796 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20d00c-7e1b-4a15-a5e9-4e0f927c30bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:43.927338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20d00c-7e1b-4a15-a5e9-4e0f927c30bf admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:43.941310 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1465/2927] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Sep 13 03:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 03:41:43.943029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e95358-bf91-4703-9140-28ad7387dd4b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:43.957408 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e95358-bf91-4703-9140-28ad7387dd4b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:43.965470 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001fff-3c9c-467c-8a1e-42b1d75f7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:43.966435 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001fff-3c9c-467c-8a1e-42b1d75f7ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:43.966904 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001fff-3c9c-467c-8a1e-42b1d75f7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:43.967243 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001fff-3c9c-467c-8a1e-42b1d75f7ae1 admin admin] PATH_INFO: `/v3/projects/62a8314e718a40e9803f1cf728b725e2/users/1e040ae501cf45bba121760ec99e6b26/roles/d5e165a3cc334fcf92d7b94730dc0816` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:43.972629 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1001fff-3c9c-467c-8a1e-42b1d75f7ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a8314e718a40e9803f1cf728b725e2, user_id=1e040ae501cf45bba121760ec99e6b26, role_id=d5e165a3cc334fcf92d7b94730dc0816)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:43.980723 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1001fff-3c9c-467c-8a1e-42b1d75f7ae1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:44.015561 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1463/2928] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Sep 13 03:41:43 2022] PUT /identity/v3/projects/62a8314e718a40e9803f1cf728b725e2/users/1e040ae501cf45bba121760ec99e6b26/roles/d5e165a3cc334fcf92d7b94730dc0816 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:41:48.852134 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20d00c-7e1b-4a15-a5e9-4e0f927c30bf admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:48.854338 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7f20d00c-7e1b-4a15-a5e9-4e0f927c30bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:48.885390 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20d00c-7e1b-4a15-a5e9-4e0f927c30bf admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:48.993460 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6637-6329-4e06-a006-99b425d1d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:48.994515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6637-6329-4e06-a006-99b425d1d912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:48.995308 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6637-6329-4e06-a006-99b425d1d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:48.995583 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6637-6329-4e06-a006-99b425d1d912 admin admin] PATH_INFO: `/v3/users/a986e1a153d94d71bdfeb7c34350c5b7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:48.998570 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe6637-6329-4e06-a006-99b425d1d912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a986e1a153d94d71bdfeb7c34350c5b7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:49.001676 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe6637-6329-4e06-a006-99b425d1d912 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:49.040142 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:49.201926 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5ffe6637-6329-4e06-a006-99b425d1d912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a986e1a153d94d71bdfeb7c34350c5b7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:49.202579 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5ffe6637-6329-4e06-a006-99b425d1d912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a986e1a153d94d71bdfeb7c34350c5b7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:49.203208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5ffe6637-6329-4e06-a006-99b425d1d912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a986e1a153d94d71bdfeb7c34350c5b7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:49.221933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5ffe6637-6329-4e06-a006-99b425d1d912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a986e1a153d94d71bdfeb7c34350c5b7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:49.249456 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5ffe6637-6329-4e06-a006-99b425d1d912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a986e1a153d94d71bdfeb7c34350c5b7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:49.381385 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1466/2929] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:41:48 2022] DELETE /identity/v3/users/a986e1a153d94d71bdfeb7c34350c5b7 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:41:49.815136 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001fff-3c9c-467c-8a1e-42b1d75f7ae1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:49.820572 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b1001fff-3c9c-467c-8a1e-42b1d75f7ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:49.836212 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:49.841396 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001fff-3c9c-467c-8a1e-42b1d75f7ae1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:49.951704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:49.951704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:49.951704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:49.951704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203 admin admin] PATH_INFO: `/v3/projects/edea61cc2f4e498b8eb299b49ab0dffc` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:49.952057 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edea61cc2f4e498b8eb299b49ab0dffc)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:49.953358 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:50.140066 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edea61cc2f4e498b8eb299b49ab0dffc', 'request_id': 'req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:50.151567 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edea61cc2f4e498b8eb299b49ab0dffc', 'request_id': 'req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:50.265878 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edea61cc2f4e498b8eb299b49ab0dffc', 'request_id': 'req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:50.278705 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203 admin admin] The token cache is being invalidate because project edea61cc2f4e498b8eb299b49ab0dffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:41:50.278994 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:50.279760 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c6e26a61-35e1-4dc6-a92f-1a9cf567e203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:50.284378 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1464/2930] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:41:49 2022] DELETE /identity/v3/projects/edea61cc2f4e498b8eb299b49ab0dffc => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:41:50.285567 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6637-6329-4e06-a006-99b425d1d912 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:50.297223 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6637-6329-4e06-a006-99b425d1d912 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:50.314754 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4440f-793a-4ed5-9a89-6b776cf023d3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:50.315063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4440f-793a-4ed5-9a89-6b776cf023d3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:50.315319 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4440f-793a-4ed5-9a89-6b776cf023d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:50.351932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f6e4440f-793a-4ed5-9a89-6b776cf023d3 None None] MFA Rules not processed for user `1e040ae501cf45bba121760ec99e6b26`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:41:50.354161 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f6e4440f-793a-4ed5-9a89-6b776cf023d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:50.377222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:50.377910 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:50.378196 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:50.378584 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] PATH_INFO: `/v3/users/ad1c8a8dd4e24656b91f9489d584181d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:50.381479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1c8a8dd4e24656b91f9489d584181d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:50.383668 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:50.437748 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1465/2931] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:41:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:41:50.450279 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4440f-793a-4ed5-9a89-6b776cf023d3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:50.451720 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f6e4440f-793a-4ed5-9a89-6b776cf023d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:50.477653 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:50.538074 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4440f-793a-4ed5-9a89-6b776cf023d3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:50.545431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67be315-27ee-4d3b-bff6-bc1fdff71187 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f746dd2ce4404b679db81794c4d23f26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:50.545431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67be315-27ee-4d3b-bff6-bc1fdff71187 service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:50.545431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67be315-27ee-4d3b-bff6-bc1fdff71187 service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:50.545431 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67be315-27ee-4d3b-bff6-bc1fdff71187 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:50.545817 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b67be315-27ee-4d3b-bff6-bc1fdff71187 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:50.601066 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1c8a8dd4e24656b91f9489d584181d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:50.602274 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1c8a8dd4e24656b91f9489d584181d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:50.602913 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1c8a8dd4e24656b91f9489d584181d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:50.610708 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67be315-27ee-4d3b-bff6-bc1fdff71187 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:50.611115 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1c8a8dd4e24656b91f9489d584181d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:50.613029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67be315-27ee-4d3b-bff6-bc1fdff71187 service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:50.624950 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1466/2932] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:41:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 03:41:50.628032 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1c8a8dd4e24656b91f9489d584181d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:50.700556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1467/2933] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:41:50 2022] DELETE /identity/v3/users/ad1c8a8dd4e24656b91f9489d584181d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 03:41:50.900872 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f619c-01ad-4217-aea0-753f09cadbfa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:50.901400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f619c-01ad-4217-aea0-753f09cadbfa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:50.901517 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f619c-01ad-4217-aea0-753f09cadbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:50.951846 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-dd3f619c-01ad-4217-aea0-753f09cadbfa None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:41:50.953063 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dd3f619c-01ad-4217-aea0-753f09cadbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:50.960144 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:50.961175 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:50.993968 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:51.028821 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1467/2934] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:41:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:41:51.045308 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea23623-21a1-46b6-b390-03971756ea93 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:51.051029 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:51.051671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:51.051948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:51.052221 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c admin admin] PATH_INFO: `/v3/projects/5f520ed8c5ba445395e97448ac2e8a39` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:51.053422 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f520ed8c5ba445395e97448ac2e8a39)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:51.055354 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:51.142733 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f619c-01ad-4217-aea0-753f09cadbfa None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:41:51.144534 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dd3f619c-01ad-4217-aea0-753f09cadbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:51.146632 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f520ed8c5ba445395e97448ac2e8a39', 'request_id': 'req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:51.154374 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f520ed8c5ba445395e97448ac2e8a39', 'request_id': 'req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:51.175018 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:41:51.213891 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f520ed8c5ba445395e97448ac2e8a39', 'request_id': 'req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:51.224933 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c admin admin] The token cache is being invalidate because project 5f520ed8c5ba445395e97448ac2e8a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:41:51.225222 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:51.225893 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7db0d69b-7a00-4c03-ac5a-bba78ee1563c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:41:51.227609 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1468/2935] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:41:50 2022] DELETE /identity/v3/projects/5f520ed8c5ba445395e97448ac2e8a39 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:41:51.239131 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f619c-01ad-4217-aea0-753f09cadbfa None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:41:51.312263 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a20f4f-4f81-4bd0-b369-79b10791419c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:41:51.313053 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a20f4f-4f81-4bd0-b369-79b10791419c service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:41:51.313400 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a20f4f-4f81-4bd0-b369-79b10791419c service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:41:51.313789 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a20f4f-4f81-4bd0-b369-79b10791419c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:41:51.315713 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-50a20f4f-4f81-4bd0-b369-79b10791419c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:41:51.381932 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a20f4f-4f81-4bd0-b369-79b10791419c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:41:51.383563 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a20f4f-4f81-4bd0-b369-79b10791419c service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:41:51.392941 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1468/2936] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:41:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 03:42:01.221779 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:42:01.389089 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=77 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:42:01.955337 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b02d1-c5f4-4076-a10f-d7e7995874c0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:42:01.955680 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b02d1-c5f4-4076-a10f-d7e7995874c0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:42:01.955963 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b02d1-c5f4-4076-a10f-d7e7995874c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:42:01.975866 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-617b02d1-c5f4-4076-a10f-d7e7995874c0 None None] MFA Rules not processed for user `c617bd9eab0948fca599e89051729bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:42:01.978948 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-617b02d1-c5f4-4076-a10f-d7e7995874c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:42:02.030750 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1469/2937] 10.222.0.48 () {58 vars in 958 bytes} [Tue Sep 13 03:42:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:42:02.285690 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a20f4f-4f81-4bd0-b369-79b10791419c service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:42:02.287296 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-50a20f4f-4f81-4bd0-b369-79b10791419c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:42:02.343464 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a20f4f-4f81-4bd0-b369-79b10791419c service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:42:02.346980 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cda5d-cf93-468e-9379-1609eaa1e87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:42:02.347576 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cda5d-cf93-468e-9379-1609eaa1e87d service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:42:02.347855 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cda5d-cf93-468e-9379-1609eaa1e87d service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:42:02.348127 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cda5d-cf93-468e-9379-1609eaa1e87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:42:02.349856 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-420cda5d-cf93-468e-9379-1609eaa1e87d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:42:02.359286 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cda5d-cf93-468e-9379-1609eaa1e87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:42:02.360699 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cda5d-cf93-468e-9379-1609eaa1e87d service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:42:02.369215 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1469/2938] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:42:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:42:03.040515 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b02d1-c5f4-4076-a10f-d7e7995874c0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:42:03.042867 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-617b02d1-c5f4-4076-a10f-d7e7995874c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:42:03.119165 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b02d1-c5f4-4076-a10f-d7e7995874c0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:42:03.124289 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a5bfc-5e1c-44b4-93a3-2f468c70d6e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261a9485c3b4d2aa657a931e0388389', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:42:03.124896 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a5bfc-5e1c-44b4-93a3-2f468c70d6e1 service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:42:03.125176 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a5bfc-5e1c-44b4-93a3-2f468c70d6e1 service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:42:03.125479 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a5bfc-5e1c-44b4-93a3-2f468c70d6e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:42:03.127252 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-992a5bfc-5e1c-44b4-93a3-2f468c70d6e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:42:03.138814 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a5bfc-5e1c-44b4-93a3-2f468c70d6e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:42:03.140334 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a5bfc-5e1c-44b4-93a3-2f468c70d6e1 service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:42:03.151540 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1470/2939] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:42:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:42:05.684467 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8638f-dd01-4a5e-bdb8-3eefaf96d4d0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:42:05.684945 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8638f-dd01-4a5e-bdb8-3eefaf96d4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:42:05.685171 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8638f-dd01-4a5e-bdb8-3eefaf96d4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:42:05.704921 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4ab8638f-dd01-4a5e-bdb8-3eefaf96d4d0 None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:42:05.706256 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4ab8638f-dd01-4a5e-bdb8-3eefaf96d4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:42:05.714598 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1470/2940] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Sep 13 03:42:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 03:42:05.728684 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a5bfc-5e1c-44b4-93a3-2f468c70d6e1 service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:42:05.728684 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-992a5bfc-5e1c-44b4-93a3-2f468c70d6e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:42:05.742206 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a5bfc-5e1c-44b4-93a3-2f468c70d6e1 service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:42:05.747266 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02a51e-3847-4571-b4cf-c74c6ad05e9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:42:05.747886 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02a51e-3847-4571-b4cf-c74c6ad05e9b service swift] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:42:05.748163 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02a51e-3847-4571-b4cf-c74c6ad05e9b service swift] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:42:05.748432 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02a51e-3847-4571-b4cf-c74c6ad05e9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:42:05.756426 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02a51e-3847-4571-b4cf-c74c6ad05e9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:42:05.758047 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02a51e-3847-4571-b4cf-c74c6ad05e9b service swift] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:42:05.766603 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1471/2941] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:42:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 03:42:15.699815 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=29 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:42:15.763322 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=63 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:42:18.820008 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8638f-dd01-4a5e-bdb8-3eefaf96d4d0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:42:18.821520 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4ab8638f-dd01-4a5e-bdb8-3eefaf96d4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:42:18.894936 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8638f-dd01-4a5e-bdb8-3eefaf96d4d0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:42:18.900381 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d5ca7-95d1-43b3-a04f-1468e0374c60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:42:18.900963 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d5ca7-95d1-43b3-a04f-1468e0374c60 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:42:18.901240 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d5ca7-95d1-43b3-a04f-1468e0374c60 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:42:18.901546 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d5ca7-95d1-43b3-a04f-1468e0374c60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:42:18.904196 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7e7d5ca7-95d1-43b3-a04f-1468e0374c60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:42:18.916738 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d5ca7-95d1-43b3-a04f-1468e0374c60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:42:18.918382 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d5ca7-95d1-43b3-a04f-1468e0374c60 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:42:18.930210 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1471/2942] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:42:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:42:27.664900 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02a51e-3847-4571-b4cf-c74c6ad05e9b service swift] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:42:27.674240 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02a51e-3847-4571-b4cf-c74c6ad05e9b service swift] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:42:27.677812 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b406f3-8e77-4532-bb12-9128996ad913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bb4ef26660244ce90b0105113e252b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:42:27.678396 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b406f3-8e77-4532-bb12-9128996ad913 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:42:27.678673 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b406f3-8e77-4532-bb12-9128996ad913 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:42:27.678944 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b406f3-8e77-4532-bb12-9128996ad913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:42:27.680671 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-09b406f3-8e77-4532-bb12-9128996ad913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:42:27.742995 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b406f3-8e77-4532-bb12-9128996ad913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:42:27.744438 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b406f3-8e77-4532-bb12-9128996ad913 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:42:27.754504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1472/2943] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:42:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:42:28.924756 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=34 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:42:29.599791 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d5ca7-95d1-43b3-a04f-1468e0374c60 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:42:29.601587 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7e7d5ca7-95d1-43b3-a04f-1468e0374c60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:42:29.615759 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d5ca7-95d1-43b3-a04f-1468e0374c60 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:42:29.621602 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109cd26-34a9-4898-99bc-a49dae5c5ca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcff121c9e974a6aabaa18775de65f63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:42:29.622203 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109cd26-34a9-4898-99bc-a49dae5c5ca1 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:42:29.622487 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109cd26-34a9-4898-99bc-a49dae5c5ca1 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:42:29.623320 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109cd26-34a9-4898-99bc-a49dae5c5ca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:42:29.625029 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0109cd26-34a9-4898-99bc-a49dae5c5ca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:42:29.637444 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109cd26-34a9-4898-99bc-a49dae5c5ca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:42:29.639059 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109cd26-34a9-4898-99bc-a49dae5c5ca1 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:42:29.650412 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1472/2944] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:42:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:42:37.750167 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=30 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:42:39.645091 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:43:18.678485 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b406f3-8e77-4532-bb12-9128996ad913 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:43:18.679985 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-09b406f3-8e77-4532-bb12-9128996ad913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:43:18.697556 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b406f3-8e77-4532-bb12-9128996ad913 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:43:18.699561 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16cfcc-6d99-4b3f-8a8c-2ba61b980a5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261a9485c3b4d2aa657a931e0388389', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:43:18.700160 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16cfcc-6d99-4b3f-8a8c-2ba61b980a5d service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:43:18.700435 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16cfcc-6d99-4b3f-8a8c-2ba61b980a5d service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:43:18.700729 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16cfcc-6d99-4b3f-8a8c-2ba61b980a5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:43:18.702524 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0c16cfcc-6d99-4b3f-8a8c-2ba61b980a5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:43:18.714917 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16cfcc-6d99-4b3f-8a8c-2ba61b980a5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:43:18.721074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16cfcc-6d99-4b3f-8a8c-2ba61b980a5d service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:43:18.727191 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1473/2945] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:43:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:43:28.722791 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=6 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:43:46.749218 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dea5f5-2dfc-4418-af66-42ed13f5d2bb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:43:46.749772 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dea5f5-2dfc-4418-af66-42ed13f5d2bb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:43:46.749882 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dea5f5-2dfc-4418-af66-42ed13f5d2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:43:46.769516 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-44dea5f5-2dfc-4418-af66-42ed13f5d2bb None None] MFA Rules not processed for user `18e869f4ca35451583107ca7607e1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 03:43:46.770700 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-44dea5f5-2dfc-4418-af66-42ed13f5d2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:43:46.777906 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1473/2946] 10.222.0.48 () {58 vars in 967 bytes} [Tue Sep 13 03:43:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 03:43:46.818878 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16cfcc-6d99-4b3f-8a8c-2ba61b980a5d service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:43:46.830931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16cfcc-6d99-4b3f-8a8c-2ba61b980a5d service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:43:46.836598 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a93dda-e96c-4a2e-9979-42882197bec9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3284a5c047425d8148f178eee4069d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:43:46.837208 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a93dda-e96c-4a2e-9979-42882197bec9 service swift] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:43:46.837533 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a93dda-e96c-4a2e-9979-42882197bec9 service swift] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:43:46.837808 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a93dda-e96c-4a2e-9979-42882197bec9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:43:46.846979 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a93dda-e96c-4a2e-9979-42882197bec9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:43:46.848618 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a93dda-e96c-4a2e-9979-42882197bec9 service swift] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:43:46.856851 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1474/2947] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Sep 13 03:43:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 03:43:51.147385 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dea5f5-2dfc-4418-af66-42ed13f5d2bb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:43:51.161704 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dea5f5-2dfc-4418-af66-42ed13f5d2bb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:43:51.166638 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dada2c6-6529-48ac-9331-52e35e19a7e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261a9485c3b4d2aa657a931e0388389', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:43:51.167230 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dada2c6-6529-48ac-9331-52e35e19a7e5 service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:43:51.167506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dada2c6-6529-48ac-9331-52e35e19a7e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:43:51.167778 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dada2c6-6529-48ac-9331-52e35e19a7e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:43:51.169526 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8dada2c6-6529-48ac-9331-52e35e19a7e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:43:51.188132 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dada2c6-6529-48ac-9331-52e35e19a7e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:43:51.190367 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dada2c6-6529-48ac-9331-52e35e19a7e5 service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:43:51.200506 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1474/2948] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:43:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:43:54.857090 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a93dda-e96c-4a2e-9979-42882197bec9 service swift] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:43:54.858626 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-37a93dda-e96c-4a2e-9979-42882197bec9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:43:54.922920 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a93dda-e96c-4a2e-9979-42882197bec9 service swift] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:43:54.929658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:43:54.929658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:43:54.929658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:43:54.929658 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] PATH_INFO: `/v3/users/c617bd9eab0948fca599e89051729bc2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:43:54.930074 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c617bd9eab0948fca599e89051729bc2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:43:54.931738 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:43:55.099494 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c617bd9eab0948fca599e89051729bc2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.100140 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c617bd9eab0948fca599e89051729bc2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.100743 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c617bd9eab0948fca599e89051729bc2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.108307 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c617bd9eab0948fca599e89051729bc2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.120261 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c617bd9eab0948fca599e89051729bc2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.204495 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1475/2949] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:43:54 2022] DELETE /identity/v3/users/c617bd9eab0948fca599e89051729bc2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:43:55.434650 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dada2c6-6529-48ac-9331-52e35e19a7e5 service placement] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:43:55.445910 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dada2c6-6529-48ac-9331-52e35e19a7e5 service placement] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:43:55.503779 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:43:55.504404 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:43:55.504682 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:43:55.504957 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] PATH_INFO: `/v3/projects/15cbbc4a102f4da3b11d73fc5932f4f0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:43:55.506160 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] RBAC: Authorizing `identity:delete_project(project_id=15cbbc4a102f4da3b11d73fc5932f4f0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:43:55.508086 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:43:55.628096 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15cbbc4a102f4da3b11d73fc5932f4f0', 'request_id': 'req-8295acce-9311-4c58-920c-36e7595d753c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.634124 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15cbbc4a102f4da3b11d73fc5932f4f0', 'request_id': 'req-8295acce-9311-4c58-920c-36e7595d753c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.713109 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15cbbc4a102f4da3b11d73fc5932f4f0', 'request_id': 'req-8295acce-9311-4c58-920c-36e7595d753c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.724337 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] The token cache is being invalidate because project 15cbbc4a102f4da3b11d73fc5932f4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:43:55.724625 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.725272 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.726847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1475/2950] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:43:55 2022] DELETE /identity/v3/projects/15cbbc4a102f4da3b11d73fc5932f4f0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:43:55.730923 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:43:55.732511 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:43:55.746475 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daa124-069f-49ee-9f29-996e16dc5fed admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:43:55.804012 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:43:55.804640 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:43:55.804919 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:43:55.805193 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] PATH_INFO: `/v3/users/1e040ae501cf45bba121760ec99e6b26` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:43:55.806351 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e040ae501cf45bba121760ec99e6b26)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:43:55.808611 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:43:55.813892 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:43:55.962643 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e040ae501cf45bba121760ec99e6b26'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.963357 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e040ae501cf45bba121760ec99e6b26'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.963880 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e040ae501cf45bba121760ec99e6b26'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.971256 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e040ae501cf45bba121760ec99e6b26'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:55.983489 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e040ae501cf45bba121760ec99e6b26'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:56.050739 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1476/2951] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Sep 13 03:43:55 2022] DELETE /identity/v3/users/1e040ae501cf45bba121760ec99e6b26 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:43:56.293944 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:43:56.295452 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:43:56.311013 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295acce-9311-4c58-920c-36e7595d753c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:43:56.367912 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416766f2-c71a-461e-b235-113d5a52c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '809e7dc455e844f6967aa616532e4eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '579008ca5633416b90d9e0cc4088e0c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:43:56.368537 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416766f2-c71a-461e-b235-113d5a52c110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:43:56.368814 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416766f2-c71a-461e-b235-113d5a52c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:43:56.369084 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416766f2-c71a-461e-b235-113d5a52c110 admin admin] PATH_INFO: `/v3/projects/62a8314e718a40e9803f1cf728b725e2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:43:56.370206 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416766f2-c71a-461e-b235-113d5a52c110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a8314e718a40e9803f1cf728b725e2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:43:56.372105 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416766f2-c71a-461e-b235-113d5a52c110 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:43:56.382992 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:43:56.479250 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-416766f2-c71a-461e-b235-113d5a52c110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a8314e718a40e9803f1cf728b725e2', 'request_id': 'req-416766f2-c71a-461e-b235-113d5a52c110'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:56.485493 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-416766f2-c71a-461e-b235-113d5a52c110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a8314e718a40e9803f1cf728b725e2', 'request_id': 'req-416766f2-c71a-461e-b235-113d5a52c110'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:56.566445 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-416766f2-c71a-461e-b235-113d5a52c110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a8314e718a40e9803f1cf728b725e2', 'request_id': 'req-416766f2-c71a-461e-b235-113d5a52c110'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:56.576847 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-416766f2-c71a-461e-b235-113d5a52c110 admin admin] The token cache is being invalidate because project 62a8314e718a40e9803f1cf728b725e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 03:43:56.577342 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-416766f2-c71a-461e-b235-113d5a52c110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:56.578070 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-416766f2-c71a-461e-b235-113d5a52c110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 03:43:56.580545 dv-cinder-857075-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1476/2952] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Sep 13 03:43:56 2022] DELETE /identity/v3/projects/62a8314e718a40e9803f1cf728b725e2 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 03:44:06.046504 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:44:06.578959 dv-cinder-857075-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 03:48:22.658984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 03:48:22.660428 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:48:22.795476 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeabc02-0905-451e-848d-772b75dcd54c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 03:48:22.852106 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea91d9-330e-427a-b738-6637bc183a04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261a9485c3b4d2aa657a931e0388389', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ad922f6e2414214abe3ba1de67fc8de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 03:48:22.852709 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea91d9-330e-427a-b738-6637bc183a04 service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 03:48:22.852984 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea91d9-330e-427a-b738-6637bc183a04 service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 03:48:22.853277 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea91d9-330e-427a-b738-6637bc183a04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 03:48:22.854975 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b6ea91d9-330e-427a-b738-6637bc183a04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 03:48:22.866363 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea91d9-330e-427a-b738-6637bc183a04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 03:48:22.867931 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea91d9-330e-427a-b738-6637bc183a04 service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 03:48:22.878159 dv-cinder-857075-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1477/2953] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Sep 13 03:48:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 03:48:32.874083 dv-cinder-857075-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}